Yes, although if you're dealing with people with spellcraft or some other way to kick their casting level up it's hard (but not impossible) to hit the point of pointlessness, although diminishing returns is definitely a relevant thing.

Because INT/WIS are a factor in saves, you tend to have your saves as good as possible or close to it a lot more easily as a smart character than a dumb one.