I'm sorry you aren't feeling well! I'm an RN and a fever is not necessarily a bad thing. First, I would drink as much water as you can. If water doesn't taste good, try some fruit juice or any other non-caffienated beverage. A little Tylenol is fine too, if you are really feeling bad. There is no reason to call L&D or go in, unless something else is happening that is worrying you.
I'd dress comfortably, and just drink a ton of liquids, you want your pee to be pretty much colorless. Are you having any other symptoms - like a headache, nausea, sore throat, body aches, etc? Many times a virus will cause a fever and letting it run its course is about the only thing you can do, along with treating the symptoms.
Again, if you feel there is something else going on besides maybe coming down with a virus or something, you could call L&D if you were really worried. But it's not something you automatically need to do. How are you otherwise?