>Is it always true that if you go somewhere and you're not
>right in the area levels that you won't get the xp?

No.

>If you do go when you're younger, does that mean you've ruined
>the place or can you go back when you are in the level range
>and get it?

The latter. Nothing can "ruin" a spot for you.