The path outside Fortress is wilderness and Outlander has a home turf advantage in wilderness while in civilized terrain they pretty much lose their powers. It's really as simple as that. Fort doesn't need to call in Outlanders. Outlanders just check Fort frequently because that's where the action is and they have the home turf near them as well.