With the pet games, gardening, and fishing all costing from the same energy orb, it's very hard to do more than one in the same day.
I think that one of them should switch to using mana instead.
I love both gardening and fishing, but I find that once I have finished tending to my garden for the day I have no energy left to go fishing like I want. And if I go fishing for a bit I don't have enough energy to take care of all of my garden. I'll bet it's even worse for those who enjoy the pet games too.
Even with the energy orb boost for those over level 7 it isn't enough. Either switch one of them to mana or increase the energy by a lot more.