Same issue, two different situations, and I don't know what you'll want as design.

You can use the Tribunal pillars for transportation both when affected by insect swarms, and while holding a cabal item of power.

I've figured it was intentional with the swarms, but didn't know what the opinion would be with someone's item.

n/t