If this happens mainly when your catching panfish, you need to stop fishing where the little ones are. If your catching tiny fish, I guarantee there will be no quality fish among them. Try fishing deeper, or move on to another location. Crappie and Bluegill usually hang out in groups by size, so they don't have to compete for food. Back off the bank 15' or 20' and adjust your depths. Use a long shank cricket hook, they give you best chance of fish not swallowing your hook.