Well to me, I would never consider this idea, just because of my faith. But in your case, it sounds like a band aid to fix your unhappiness.
Your sex is boring, so you want to basically not wrapping it up nicely, sleep with someone other than the spouse you commited to. Your spouse doesnt like the sports you like, so you want another man?(im assuming male) to participate with these things with you. This is what I am hearing. Your spouse gets on your nerves sometimes(dont they all?) and you would like someone there to vent to or hang out with instead of him.
How about 1. divorce your dh...find your happiness. You deserve to be happy, but so does your dh. He does not sound happy in this idea at all, and I do not blame him.
2. cheat on your spouse, get the sex you need.(not a very good idea, but a choice nevertheless)
3. find some friends who you can hang out with. ones that like sporting events. ones that like girls nights out. ones that you can call for a coffee when dh is annoying.
Thats about your choices, while your dh is not on board with your needs. I would feel let down if the person that married me, and commited to me for life, decided one day I wasnt enough and wanted to move more people in. It would really hurt me.
Maybe you and your husband need counselling? of if you have gone and its not working out for you, maybe you just need to get a divorce so you can find what it is that makes you happy.
What if you move two more in and then you get tired of them. What if the sex with other man becomes *vanilla* and the other woman starts getting on your nerves??Are you going to move two more in to replace them??
Basically what I am saying is.....if you arent happy now, you arent going to be happy then.
I dont intend to sound snarky if I do, I am sorry. I am just putting it out there for you.

I keep it real.
Follow Mothering