No matter what you end up choosing, I'd say that if you had a meltdown in the car on the way from that place, it might be a pretty good sign that it's not for you! Who knows - maybe a second visit would change that, but I'd say trust your instincts if you still feel iffy after that!
I've had to accept that in my rural town, nothing is going to be ideal for me, so I think a degree of willingness to work with what you have is important. But if you have other options, it's certainly worth exploring! Maybe if you and your husband had a meeting with a homebirth midwife he would feel better about the process. Or maybe you'd find that your local hospital is more comfortable than you thought it might be. Who knows? You've got plenty of time to explore your options, and you can even do it before you end your relationship with your current practice.
What a tough way to spend your first appointment. I'm so sorry it didn't go the way you'd hoped!