As far as over the counter meds, ibuprofen, naproxen, and acetominophen (Advil, Tylenol, and Aleve) are all fine for breastfeeding moms. If you're having chronic headaches though you will want to get them checked out rather than take over the counter painkillers every day, as the painkillers themselves can cause rebound headaches when you use them every day.
Relaxation and hot or cold compresses on the forehead or back of the neck (whichever feels better) are two things that help my headaches. Also staying really, really well hydrated, especially important when breastfeeding - a lot of headaches are caused by dehydration.
I don't know about what herbal and homeopathic remedies might be appropriate. From what I understand, homeopathic remedies are generally considered safe, but herbs you need to be careful with. One place to look for info on herbs is
Kelly's AP page on herbs and breastfeeding.
Hope this helps!
Come visit the NEW QuirkyBaby website -- earn QB Bucks rewards points for purchases, reviews, referrals, and more! Free US shipping on great brands of baby slings and carriers and FREE BabyLegs or babywearing mirror on orders of $100+. Take the QB Quiz for personalized advice!