It is definitely hard to decide which places are acceptable enough in my mind for a villager to go through or if there should even be a restriction, but I never felt comfortable with the fact when villagers used the portals to escape from enemies, especially the ol' strike Nexus then gtfo through chesstower.