If you rank out of the levels where mages are speedbumps for fighter classes (which, by the way, are also the levels where you really have no business having any rager powers to begin with), they'll actually start coming after you instead, the only difference is that now you're the underdog as opposed to them.