If you can outdamage them, no worries. If they have spell saves & outdamage you, you are screwed. Eyes make it very difficult to finesse them.

One of the worst fights I've had, and I've had plenty, was when some mid-20s hunter Baer follower was granted maran and went after my AP. Your AP doesn't have dodge, they have ambush and pursuit. Add to that the maran had a decent suit, and CF for Quixotic was just a game of 'regear and farm gold.' It wasn't even a game of tag or avoidance because of the mismatch. Miserably unfun.