Hm. I echo everyone else who said this is a highly individual decision.
That said, it is true that there is a biologically limited window for having babies, and there is *not* a biologically limited window for working on your career. (There are other kinds of time-window limitations depending on your career, but they are more flexible than age-related infertility is.)
If I were in your position - and especially since you say your priority is a family, not your career - I would probably just start doing the baby thing, and let the career thing work itself out. Since you plan to be out of the work force for some years, I really doubt 1-2 years' experience is going to make a huge difference for if/when you start trying to get back in. (If you do ultimately want to return to work, your best bet is probably to keep a toe in the water by doing some part-time or volunteer work, either way.)
On the other hand, if you do happen to run into infertility or other problems like repeated losses, 1-2 years could be very important.
Even if you don't run into infertility, waiting till 32 to TTC your first puts some pressure on your child spacing. Eg if you deliver your first at 33, you may feel pressured to have a smaller spacing than you are comfortable with in order to avoid delivering in your late 30s. You may feel just fine with a 1-2 year spacing but OTOH you may find yourself with a 1 year old thinking you REALLY are not ready to TTC again. Or you may be just fine having 2 kids in 2 years but then realize you really really want a third, and you have a very limited window left for that. You don't really know how it will be until you get there.