You've answered your own question. It is possible to go out in cold weather but you have to prepare.
You can read lots about families in Scandinavian countries that take their babies out every day throughout some fairly harsh winters. There are lots of stories about infants sleeping in strollers parked outside daily.
My babies were born in the spring, so I only had a few weeks of cold weather when they were newborns. DS was born during a severe winter storm in early March. When he was about a week old we were out for long walks in below freezing weather. They were both still infants, less than a year old, when deep winter rolled around again. I didn't want to stay cooped up all winter. It isn't healthy - for them or for me. I suffer a little with SAD and I need to get outside as much as possible during the winter months. Post-partum, I was a little concerned about good mental health and the need for exercise, fresh air and daylight, and stress relief, So they spent a lot of time outside when they were older infants. To me, it was worth it to get out of the house, so we did invest in really warm snowsuits for them.
We found that other families were often very generous with that kind of stuff. We got a lot of hand-me-downs. Because winter gear is often only used for a short time, they were often gently used and in very good condition, especially the newborn stuff.
Goodwill or consignment shops are often a good source too.
As they get a little older, another good idea is to shop the end-of-season sales for next year's winter gear.
YMMV. If you are content snuggling inside with a babe and feel you don't need the exercise and change of scenery, then I wouldn't be too concerned. As you point out, it is just for a fairly short time.
Follow Mothering