Yes, that's how it would have probably worked.
You might try a bungee to hold it in place, but make sure it can travel up if you hit something.
Alternatively, consider making or buying a new one. They're not cheap to buy new, but if you're any good with woodworking they're not terribly hard to...