JT, from a quick look at your profile, I would say when you think it's time to get off the water go. Don't wait for later and see if you can make it, just go. In therory your boat is safe in the right hands in 3 foot waves, but can you do that. I know the first time I did in a smaller boat it scared the Sh** out of me. Even riding with legends like Woo Daves in a 929 the 4 to 6 footers still scare the crap out of me. It's better to learn with seat time and practice than to be fished out of the river.
Welcome Aboard
BF