I prefer staying home (I do work some days), I don't know that it's easier.
One of the main things that make it harder:
When my husband would get home from a long day at work, he's wonder how I could possibly have a tiring day (this was after they were infants.) Well, I told him that he wasn't at work with his clients standing behind him every minute crying about something, demanding his attention, fighting his decisions. When he took his lunch break, it was really a break. No help with potties or straightening little blankets on the floor for their game because WAAAAH! It is so frustrating for 3yo hands to get the blanket perfectly flat!
If I had a job with a boss/client relationship like that, would I work even though I was getting paid?? Hell, no. That's why I was so tired. In fact, when the waters get rough here I have to remind myself where I was just 5 years ago.
That said, I don't think I would like to work much more than I do. I don't think there is an obvious right answer, but I don't envy the moms with careers, like my mother had. I do know that being in the house with the kids full time (we homeschool) does a number on the mess and chaos!