Try starting it as Scott describes above. If that works, then you know it was just your starting procedure. Those of us who learned to drive in the 60s and 70s when all cars had carbs intuitively know this lol.
If not then you should verify proper choke function:
with a cold engine, remove the nut retaining the flame arrestor, remove the arrestor and then advance the throttle all the way forward (shift system dis-engaged) the choke plate (top flap in the carb) should close nearly all the way or all the way.
When the engine starts, there is a vacuum operated linkage that will pull the choke open a fraction of an inch (typically 1/8 to 1/4") to give the engine enough air to keep running but that is also the reason why after priming the engine you must advance the throttle 1/3 or so forward, it needs that fast idle to keep running.
As the engine warms up the choke should gradually open all the way. If it does not close it may just need a good cleaning of the choke blade and shaft & surrounding area in the opening of the top of the carb and linkage. These attract dirt and can get sticky. If it still doesn't close you may need to replace the thermostatic spring that closes it. If it does not open up you have to find out why, some chokes are opened by a spring mounted to the intake manifold above an exhaust crossover (Rochester style) others are electrically heated (Holley and Edelbrock/Weber style). In the case of the former, dirt on the choke and linkage can stop it from opening, or a cold running engine that never heats the intake up enough (on my Q jet it would have to get to about 120 on the top of the manifold to open), in the case of the latter (electric) a lack of 12V to the positive terminal on the choke cap or a defective choke coil.