Is it always the case that a limited item should not be able to be
put inside a PC-holdable container, or are there some more nuanced
rules I don't know about?

I found a limited item in a takeable container, and can put that
container, with the item, into one of my own.

*snipped a small bit of commentary*