It's worth it for both your health and your baby's health to buy low or no VOC paints. (VOCs are volatile organic compounds). Paints can offgas for years and affect you and your baby directly when you breathe the vapors in. Really not healthy for either of you to breathe, especially a little baby.
Benjamin Moore makes Ecospec, a low VOC paint, and I think some of the other big companies make them as well.