Permanent Retainer Removal while Preggo. Should I???

I have a permanent retainer and in the interest of getting all the BPA/Composite OUT of my body and the baby's body, I want it removed. I am told my teeth will shift, but I never wanted the retainer in the first place (it was placed by my uncle and I was like 'oh well') and frankly I LOVE teeth that are slightly imperfect.

Do you think it would be safe to do this removal WHILE I am expecting???
: