Take a spare change of clothes with you in your kayak, packed in a dry bag.

That way, if you do flip, you can get out of the wet clothes at the nearest shore line.