well I lost 5 lbs in the first trimester, and still haven't gotten back up to my pre pregnancy weight. So now at 21 weeks I'm -1 lb. My midwife isn't too concerned. I eat well and that is all that matters. So I'd say as long as you're fundal height is fine and you eat well, I wouldn't worry.