I am presuming you had the tank repaired to fix a leak in that location? If so, if you bolt it back up you may encounter the same problem before long.
A number of owners, including me, have eliminated the bottom bolt because of the tendency to crack at that location. I put some sturdy closed cell foam under the tank with a hole cut out where the bolt boss is located. Many tanks crack and leak around the bolt location from vibration when the bolt is used. Eliminating the bolt and placing rubber pads under the tank stops the cracking. The tank is then mounted only with the two top straps. You might want to use better rubber mounts on these too. Some people fit the exhaust isolastic mounts or a HD part, don't know the part number.
I then pit a thin, about 1/4" thick, piece of foam on the outside of the oil tank. Once you mount the oil tank cover, the tank stays put and your problem is solved.
Others when repairing the tank cut off the bolt boss and weld/braze a plate over the bottom area reinforcing it and then doing the rubber mounting described above.
Chris Moore