I like to say the fun stops at 12 knots of wind. Whitecaps start at about 11 knots. Below that, everybody on board is happy. Above 12 knots whitecaps form, and the boat starts rocking, and some people aboard might be getting scared.
For more experienced types, 15 knots is a reasonable cutoff.