We have mice, too. Blecchh.
I just throw all the stuff they've been gross on into the washer and use soap or vinegar spray on everything else. I keep everything unless they've shredded it into a nest so badly that it's not usable. They've done that to some of my favorite baby clothes stored out in our shop. :( If they've gotten into food, I don't keep it.
We've tried poison and traps. I find glue traps work the very best (Amazon has them in bulk). But they are horrific- I don't just leave the poor mice on them to suffer to death, I take them off and put them out of their misery quickly. One of my most un-favorite homestead jobs. I only trap them in our house, not in the shop or anywhere else. Out there I try to replace all my bins and bags they get into with mouse-proof bins and cans.
I figure that humans have been living with mice forever and ever and I'm not extremely worried about them. I'm grossed out by them, but I figure that the ingredients in Lysol are more toxic to me than the mice actually are. ~shrug~
Good luck with your battle!