I think that if you make 1 pet or gardening energy (forgot the name) per 1000 experience available to legendary wizards, you would see them more in battles and quests, instead of hiding in "their special dungeons". Making battles and quests worthwhile, even in the slightest, would be nice.
