It's hard to say without being there, could be you are waiting to long to swing? Try a more sensitive line, if you are using mono try fluorocarbon. Watch the line for any "ticks", if so reel down fast and swing. Also try trimming up your weed guard, those things are usually over kill, so try trimming them down to where when pushed down toward the hook, they barely clear the hook. JMO...