When fishing in areas near where people are filling a spell summoning quest, it forces your player to turn towards the summoning so you can no longer see the water. Example, standing by bridge back to library fishing by entrance to Pavillion. Someone earns a spell in front of the library... you are forced to turn around with no way to see lure, so you automatically lose fish and energy.
It does that but fishing summoning doesn't always manage you to face the other way while summoning. I keep seeing 5 wizards facing the other way while in a fishing animation while fish randomly appear. So maybe contact support to see what is up with your little problem DevReplied