You would only getting a 20% chance of being pulled to the gang IF you had someone with you. And only 20% chance of a backfire when the summoning magic works. i.e. a failed summon can't backfire, but 1 in 5 that would otherwise be successful could if you had someone with you.