If you want fresh milk on a regular basis, especially during pregnancy, I'd go for option 3. #1 and #2 don't sound good to me, personally. Duct tape wouldn't bother me; I have an old house myself, and while we wouldn't let it just totally fall apart, some deferred maintenance doesn't bother me -- different people have different priorities. Rusty lids and milk that smells like feces would bother me a lot, especially for drinking during pg and by young kids. Option #4 doesn't sound like a bad option either, except for being far away. Perhaps you could find friends who are willing to take turns with you in picking it up, or perhaps the farmer offers delivery or a coop closer to you? Maybe alternate between that and the goat's milk?
As far as how important raw milk is to a diet, I personally think it's very, very important. Our family goes through multiple gallons a week, but I think it is a huge factor in why we're really pretty darn healthy. And if you look back a page or two in this forum, I just posted about my TF pregnancy and how awesome my baby's placenta looked -- raw milk is one of the foods I consumed large amounts of every week of that pregnancy. I would consider it to be at the absolute top of my "must have" list.