Let's start with a gear ratio. If you don't know an example would be 2:1 used on my current engine. The flywheel makes 2 complete revolutiions for one complete revolution of the prop.
Mark a reference, starting point on the flywheel (spark plugs out makes it easier) and on the prop. Start turning the flywheel and continue till the prop has made one complete revolution. Count the flywheel rotations.
On partial revolutions, take a sewing cloth tape and measure the circumference of the flywheel. Call that dimension A. Then measure around the flywheel the distance that didn't complete a full turn. Call that dimension B. Ratio is number of full revs plus B/A. I'd expect your answer would come out 2.33:1.
Boat something like this...name changed since then:
https://www.loweboats.com/hunting-boats/roughneck-1860-big-river/
Guessing again 3 cyl looper, Wide open operating range 5000-5500 RPM. Guessing a 13+ inch diameter prop fits the LU...(divide by 2 subtract 1.4" for the radius from the Anti Ventilation plate to the center of the prop shaft for fit). Guessing on that boat prop slip wouldn't be over 10% so I'll use that.
Go-fast.com prop slip calculator, dialing in for the correct pitch shows:
My gut feel is 13+x15P, 3 blade, 15 spline, aluminum...iboats sells them go to parts, props, enter the data for your engine and make your selection.
First guess for that and 10% slip and 5300 RPM at wide open throttle, best trim/tilt angle, boat loaded to suit decent speed...not bow heavy, would be 29 mph.....a good speed for a flat bottom, aluminum fishing boat. If something magically happened and your rpms went on up to 5500 design max, then your speed would increase to 31. If your slip was no more than 7% you could squeak by at 32 for 5500.
That's what I'd do with no prior reference for a place to start. These props run about a hundred bucks and sometimes free shippig so you aren't out a bundle if you miss your guess. If 15P puts you below mid mark.(5250 RPM) with the 15, you need to drop on down to 13 or so. Usual RPM change used on this forum is 150-200 RPM change per inch of pitch change.
Gotta remember a lot of things can affect what you get out of the prop you select. Sometimes you can have unsatisfactory performance only because the tilt wasn't set right, or you loaded the bow or stern of the boat too heavy, or the boat is overloaded, the hull is full of barnacles, or slime, on and on.