Since an electric fuel pump is not supposed to come on just by turning the key to the run position, means you have 2 problems. Both (at this point) are very dangerous.
Did you by some chance just install an electric fuel pump and now you have this problem?
Explain what you mean by "When I turn the ignition". I assumed that meant when you turned the ignition key to the on or run position. Which with a mechanical fuel pump won't do anything.
So does this mean while cranking/starting the engine?
If so, then you have carb problems.
Like Don said it's not right! make sure none of your linkages are binding and if so remove the throttle cable and try starting it without the cable attached and see if the issue still occurs.