DO NOT, I REPEAT DO NOT use rustoleum, kilz, or any other type paint on a fiberglass boat! You Will be doing it again about the time you make one pass down the lake if your talking about the bottom of the boat! .. if you talking about the top ABOVE the water line, your best be is to get removall 620
RemovALL to take off the old paint.
Then after you remove the paint, wet sand the boat area that removed the paint with 300, and then 600 grit, then fill any gouges etc with epoxy filler such as Interlux InterProtect Watertite Epoxy Filler , then sand smooth.
After than you can the paint if its above water line with epoxy primer, then base coat or urethane auto paint, then clear coat with2k clear urethane these need to be sprayed on with air sprayer.
Or you can use Awlgrip, or Interlux paints, either top coat paint for above water line or bottom paint for below the water line, but you still need to prime with the primer form the brand of paint you intend to use for top coat, dont mix brands.
The awlgrip and interlux are not cheap, but if you wont the longest lasting paint that you can do with brush .. use one of these two brands. If you try and skimp on painting a boat it will soon look like crapola, and you will be doing it again or selling or giving to someone else!