Hi, I'm anaphylactic to all rubber, but latex is the worst for me. There is a test you can do if you think you are just sensative to it. You can cut a square out of a glove or condom or whatever is bothering you (there are 52 different rubber protiens to be allergic to, and sometimes you're only allergic to one or a few). Then you tape it to the inside of your arm for 24 hours and see what happens. Now this isn't alway a dependable test, and it can be dangerous if you have an anaphylactic reaction. So it's a way to find out if you really have to. This test would kill me in about 5 minutes flat, so seriously, be careful. Another reason it might not be so accurate yet is that you are more sensative inside your vagina than say on your arm or something, so you may be reacting, but wouldn't show on your arm.
My vote is to avoid. I was latex sensative (which is what you are if you are just irritated by it) since I was about five or six. I never thought to avoid anything but gloves and the obvious till one day I put on a bra with elastic, and my allergy became anaphylactic. So it's one of those allergys that can be really mild for a long time, then one day become severe.
Latex allergies get worse with each exposure, so the bet advice I think would be avoid avoid avoid. I didn't avoid, and now I am so allergic that I can't leave my house alone and can only go to a very few places. You really don't want to get to this point, so please avoid. There is a test an allergist can give you, but it's not very relaiable either. There are silicone cups and polyurethane condoms, and I'd reccomend switching to those as well.
Also, keep your eyes out for allergies to banana, kiwi, chestnut, avacado, and tomato. Allergies to these foods can come with a latex allergy. So if you suddenly get diarrhea whenever you eat a banana or something like that, avoid that food. That would be more confirmation of a latex allergy.