I've concluded that my fuel line has an issue somewhere between the fill up and where it exits to connect to the engine.
After I've been running the boat for a bit it would start acting like it was being starved of fuel and would eventually die. I noticed the inline ball was starting to deflate...
