Not at all. I got to Celestia on my latest wizard at lvl 44 which is really too early, so I'm doing GH and WT to level up for it. Celestia is really made for 50's levels. You are right where you should be. If you have trouble, go work on Wintertusk and craft the lvl 56 gear there.
well, i got to celestia at level 53 soooo... probably because i was busy doing side quests because i thought the tower in marleybone was necessary and i was stalling. the higher a level you are the better, also, you were probably able to learn lots of astral spells right away so you arent to high of a level, youre just lucky.
I'm level 56 and still not on Celestia. Don't feel there's too high a level for a certain place. The only downside to being so high level is not being able to go somewhere for a spell quest (I've had that problem too many times).