when you can see the fish try to sneak up on them without them seeing you and downsize throw a small grub.