If you are hidden and a duergar summons you it automatically brings you out of hiding now even if the room is still civilized. I don't think this was a purposeful change because it would only encourage ganging and have no other benefits.
Deal with it.