You'll be just fine. I camp there in the fall when the lake is on the way down. Also, the lake has come up some recently making it less of an issue.
But if you're too worried, Sugar Bay is another that's close by and I use it in Jan. to launch my duck boat.