I would also keep it - if it would sadden you as much as it sounds, it is not worth it to get rid of it. We have a few pieces of flea market finds from our time overseas - great memories, wonderful pieces...but were crowding us out of one of our former homes. However, now we are SO happy we kept them - we are welcoming our "bonus" baby, whose room will need these pieces...once we move in April (baby due in 6 weeks, lol)!
Do you have any room in your bdrm maybe to just put it in the corner? I can see how it would drive you crazy - I like open spaces for play in the LR...I hope you are able to find a way to make it work for you!