It is normal for the wakeboarder to pull the boat side to side. I'd be a bit concerned about using skinny gas pipe for a wakeboard tower. That type of tubing isn't really meant to carry a load or be welded.
The best part about the list you get when a boarder pulls the boat over is that it cleans up the wake on that side so that the boarder has a nice shape to cross if they cut well.