Tough job. Maybe you could have some house rules (no swearing) with a punishment that applies to everyone. Break the rule every now and then and let him see how you deal with the same punishment he'd get (assuming you don't cry about it). :)

Then he might feel like he's not being singled out. You're doing a world of good for him whether he knows it now or not. Just ask my step-dad.