I'm pregnant with #2 now, and not finding out (for the second time). But I agree, OP, people do look at me like I'm an alien! Or else they say, "Oh, good for you, I could never do that!" as if we've chosen to take on some monumental feat.
I'm also annoyed by the, "Oh, you want to be surprised," comments. For me, it has nothing to do with "wanting to be surprised." It's just that I don't think sex matters that much, especially when you're little, and I think the stuff people PROJECT onto babies and children based on what's between their ladies is ridiculous. So I sort of feel like it's a small gift to ourselves and our baby to have nine (or so) months when we're free of all that b.s. It would be fine with me not to know the sex for at least several years, and just to get to parent a child, without worrying about gender at all.
We have gender-neutral baby clothes and girly clothes (gifts) from when DD was small. If this one is a boy, he'll wear gender-neutral and some girly stuff until boy hand-me-downs make their way into our lives. No big deal.
I'm still baffled by the limited color choices in most baby clothes, too. So almost everything is pink or blue, and then there's the obligatory pastel yellow, green, and white, for we aliens who don't find out in advance. But there are plenty of other colors in the world -- why can't babies wear red, orange, purple, brown, black turquoise, most of which (it seems to me) should still be safely gender-neutral?