When mobs are away from their home for too long, they like to return, even if you're currently tormenting them viciously.