I think Mana should be restored like health is when walking around in a safe world. The orbs are nice for quickening the process but mana should be restored like health.
Ok. So are you ok then with health restoring over time in safe areas? Both are the same thing in game. Both use Orbs to restore quickly. They both work hand in hand as far as I see it so both should regenerate over time in "safe" areas.
Now when you are in zones where you have to fight then only orbs. But if im walking around wizard city or other "safe" areas then mana should restore also imo.