Often you really wouldn't know. It's more a concern of the paranoid.

On the other hand, if you keep seeing an out of place chicken on the road in Imperial Lands or outside the Fortress or whatever, people have been known to put two and two together.