Thanks for all the suggestions.

I ended up getting a couple of those EZ Floats and they work great. They cost about $3 each.

Now I just have to actually catch a striper. Took my second trip yesterday and finally caught a fish - 6-7lb. catfish. We were in an area with striper though. Saw many individual jumps or swirls and other striper boats in the area.