Honey while nursing is fine. The witholding of honey from infants is because of botulism toxin found in honey in minute amounts. Immature guts may not be able to effectively handle it, mature (like over a year or so) can. There shouldn't be any issue with you passing it through breastmilk.
Actually, we just asked our pediatrician about he honey thing recently and he was pretty unconcerned. He said he wouldn't be putting a bowl of it out for the boys (who just turned one) but that small amounts are fine, as well as products that are honey sweetened. I think your milk would qualify.