Singles vs.Couples

I have been experiencing a problem lately with a couple. Or more appropriately, the husband of the couple. He gets on my nerves. A lot. He has been for a while, but once you have reached a certain threshold, it's to the point of not even wanting to be around the couple because of the husband. The wife is super sweet. A little uptight and i have to do a lot of personality juggling because we are a tad bit different but in a LOT of ways. But i like her. I enjoy her company, and seek it moderately frequently.
I don't know what to do. I don't know what to say. She is aware that i am not completely fond of him. We had a moment when neither of us was particularly fond of him. It's to the point now though that neither one of us is very fond of each other. We speak out of politeness and that's about it. I'm really tired of even making the effort. It's very taxing. But i don't know how to make it better or what to say to make it different even.
I have a feeling that it will end up being one of those things that kind of slips away and i eventually just won't be friends with her anymore. He's too overbearing for it to happen any other way and the effort would become too great after a while.
I feel very sorry for him and all of his insecurities. But it wouldn't bother me much if i never saw him again. In the process of all of that, i may end up never seeing her again instead.