All four of mine were impacted, and I only had one side of my mouth done at a time. The first side took a week or so before I could stop taking pain meds and then another three or 4 weeks to be completely healed over. This was in the summer of '06, and the gaps that were created still aren't completely closed. I don't know if they ever will.
For my other side, the bottom tooth actually shattered while he was trying to extract it. I am convinced a tiny shard that he left behind (could happen to anyone considering the situation) is what caused me to have an abscess(sp?) afterwards. I had to go to an immediate care facility to get meds to heal it. That added at least three or four weeks to the healing process.
I would honestly say that if the problem is just some swelling and a little soreness, you should be alright. Any kind of infection will increase the length of time the area needs to heal. Keep an eye on it, though. I discovered my abscess when I began spitting out puss. If you start having any form of leakage from that area, I would see a doctor as soon as possible. Otherwise, I would just take whatever pain medication you normally would for the pain and wait. If it is still really bothering you over the next few days to a week, it might be a good idea to make a follow-up appointment with your regular dentist just to make sure you are progressing normally.