Because in general there should be some penalties for fighting an imperial at centurions, otherwise they become a simple hassle power. Considering the restrictions on them, I'd say that's fair really. Can't stack multiple sets in an area, can't summon to or from, etc.