Thanks everyone for the advice. We have elimated peanuts as well. I started giving him probiotics and he started having daily bowels (sometimes 2x a day), but then he got really gassy. They are Natren probiotics and have dairy so I just ordered some from Klaire without dairy to see if that helps the gas.
I have always offered both sides, although at 2 weeks of age I was told to always start on the left side as he preferred the right and would barely nurse on the left. Problem is that the right is my major producer and I think it caused him to get a lot of foremilk and not drain the right breast a lot of the time(and my day of a swollen right breast that wouldn't empty and milk blister). We fed that way till about 16 weeks when I was told to slowly switch to one side per feeding. When I did that he began to wake more at night (was previously going anywhere from 6-9 hours at night, and started waking every 2-3), his weight gain slowed, and he got more fussy. So the past week I've gone back to giving both breasts but alternating which one I start with. His sleep seems to be getting better at night, but he is screaming when it's time to nurse and not wanting to eat. In the middle of the night and in the morning he's ok, but as the day goes on he gets bad. I believe it's my supply and trying to increase it, but think it also has to do with him trying to suck at the end of my nipple and me trying to hold him on.
Tonight I had to pump because he wouldn't eat at all from me for 2 feeds, so I broke down, pumped what I could and had hubby give him his first bottle. It took a while to get it in (actually it took me giving it to him). He had a hard time figuring it out. Tonight at bedtime he started to scream when it was time to eat and I side tracked him by showing him pictures of him. He eventually ate and slept/ate.
I tried checking for tongue tie and felt a bump under his tongue that from what I've read goes with posterior tongue tie. A lot of his symptoms goes with tongue tie, so it will be interesting to see if the oral surgeon says he has it.
Again, thanks everyone for the help.