In answer to some of your obstacles...
Money: You wouldn't believe what a ridiculous amount of money public schooling was costing us. Our 11 year old went to public school this fall from homeschooling and...what a shock! We ended up withdrawing her from public school about a month ago, and in the 3 months she was in school I spent several hundred dollars that I wish I had put towards a great hs curriculum
There were fees for lockers, locks, lunches, uniforms, field trips, supplies (for this they wanted money, PLUS I had to send in a bunch of actual supplies!), special colored notebooks and binders and an official agenda, fundraisers, crappy school pictures...it really just goes on and on.
Socialization: I don't know where you live of course, but I live in a small-to-medium sized city and there are at least three large homeschool groups here. The one we participate in has at least 70 families, a weekly park date, field trips for different age groups (good way to get group rates!), holiday parties for every kind of holiday (Halloween, Valentine's Day, Christmas, etc) plus a swimming date every other week in the summer, a large soccer group that is coached by an ex-professional soccer player...I'm sure there is a lot more that is not coming immediately to mind. How much of this type of thing did we do in the few months my dd was in public school? Not much! In fact most of her social activities were meeting up with the hs group even though she was not hs'ing at the time.
Fear of being different: My dh felt the same way, I think, before we started homeschooling ourselves and he started to meet other homeschooling families. DH and I don't look 'different' on the outside...we live in a newer subdivision, he works for a Fortune 500 company, we don't dress in all natural hemp fiber clothing that I wove myself, etc. HOWEVER...I am still nursing my 3-1/2 year old, we recycle everything, we subscribe to a CSA 10 months out of the year, we coslept until our kids were old enough to move in with each other ( only a few weeks ago! lol and they are 11 and 3) blablabla. What I want to ask him is, what is so great about the herd? Does he *really* want his children to be like everyone else...or does he want them to be able to think for themselves, to question authority...not that hs'ing automatically makes this happen but I think it's a good start!
for #4 and 5...you feel distracted...you don't know if you can offer everything the school does...Well, how much individual attention do you think your kids are going to get in a classroom? So much of school time is just 'busywork' to occupy the kids. Say school is from 9 to 3:30. If there is a half hour lunch, that's 6 hours of school time, probably no recess. If there are 25 kids in the classroom, the MOST individual time your child could get from the teacher is 24 minutes...and that is if the teacher spent EVERY MINUTE devoting individual attention to each child, which we know can't happen. There are walks to the library or music room or art room, class instruction, morning announcements, standing in line time...all I'm saying is that your child would be lucky to get 15 minutes a day of individual attention and that is not likely.
As for what the school offers in 'special areas'... surely you can sing a song with your child once a week, and have her glue cotton balls to a pre printed snowman once a week, or something similar. That's all they're doing in school. What your child will be missing is the peer pressure to conform, the lessons in naughty words and disrespect, and all the other BAD parts of school.
You CAN do it. I know you will hear this from a hundred other moms here who are homeschooling and are not superwomen, just like me...and you!