Since I'm pretty sure..I know which AP you are. There is more to your problem then just RNG

The rager in question has 3-5 lvls on you.

Lvls play a much bigger part in melee/spells/etc than general stats/resists etc.

I always find that fighting a rager higher lvl is a hell of a lot tougher than one lower lvl..