I think saying I mostly love my job is fair. I used to nearly always love my job. The big thing for me is we do a lot of travel and that went from being sometimes a nice break or at worst an annoying disruption to infringing on my family time to the point where I have had to cut back my travel severely which also doesn't feel fair to everyone else who is picking up the slack and even when I do travel, every little delay is a huge stressor as getting home at a reasonable time is so important to me. The only other thing is that we are a small company, so when the $#$# hits the fan, there is an expectation to work long hours to get things done, but I am very resistant to that now, but since I manage my own projects I can at least control everything I have to get done and try to leave time each day to deal with emergencies. I do enjoy my job a lot though. I have considered looking for a new job that doesn't have any travel, but I haven't started seriously looking yet as there are a lot of great things about my job, it's very flexible hours-wise, great benefits, good pay, great work environment and coworkers, great boss, etc.
To the OP, I do think a different job would help since it sounds like you never liked this job, but you may still want to not have a job at all sure, but since it sounds like right now you really have to have a job, I think it would be worthwhile to look for something you enjoy more. I'm one who definitely wants to work, I think more part-time hours would be perfect for me, but there just aren't many (if any) jobs like that available in my field.