Yup, I know exactly what you're talking about. That's why my 33 month old dd is still an only. Honestly, it's only been since the past 6 months or so that I've truly been able to consider having another one. At this age she's more independent and more of a daddy's girl so I'm feeling like I have a lot more breathing room and the mental reserves to parent another one.
My guess is that in a year from now, you'll feel differently than you do now!
My guess is that in a year from now, you'll feel differently than you do now!