I'm LDS and I live in Springville just south of Provo. There is lots to love about this area, but the winters KILL me. They last forever and they are bitter cold and often windy. It is, however, a great place for outdoor adventure. Camping, hiking, rock climbing, horseback riding, skiing, snowboarding, all that. But in the winter I hate this place. I can handle the heat of summer, but the bitter cold winters? UGH!
I'm not a huge fan of the overarching Utah LDS culture, which is different from the LDS culture outside of Utah, but my neighborhood is awesome. Very accepting and friendly regardless of religious beliefs. There are several homebirthing, homeschooling, non-vaxing, etc. families in my neighborhood and in the community in general. This is a GREAT area for homeschooling families--LOTS of support for that! And it's just a matter of filling out a form as far as legalities. Homebirthing is a piece of cake--just find a midwife you like and you're good to go.
Oh, and traffic right now is kind of a pain. They're widening the freeway all through the valley so rush hour is no fun and at random other times they will close down the freeway (usually in the middle of the night) to move a bridge into place or something.
If the culture is your major hang-up, you can for sure find an area that suits you but you will still get asked what ward you're in and other LDS base questions. There's also a certain camaraderie among people who aren't LDS, like my non-member aunt got free treats from our non-member waiter simply because they had a "we're not LDS" connection. I'd say that no matter what one believes, it is very nice to live in a community that generally has very high moral values and lots of integrity. LDS folks certainly have their faults, but there is nothing like losing something valuable and finding it right where you left it or having it turned in to a lost and found completely intact. But if 6 months of winter would be a problem, I'd suggest you opt out of Utah entirely and find an area with a milder climate.
Oh, one more thing. The Provo area has LOTS of cheap entertainment. Dollar theaters, the zoo is $8 for adults and $5 for kids, you can go to pools (indoor and outdoor) with climbing apparatuses IN the pools for $5 for adults and $3 for kids, mini golf, bowling, lazer tag, paintballing, comedy club--all kinds of stuff for really cheap.
Good luck finding a new location that suits your family!