Yes, it can. I'm still breastfeeding my 26 month old dd and feel the same as you. I have colostrum and my belly is big and it's just unpleasant. It also causes my bh ctx to come as close at 2 minutes apart for an hour or so afterwards if I nurse for more than 5-10 minutes.
I've seen breastfeeding an older baby work to induce labor. Like a breastpump, if you are trying to stimulate labor, nurse 20 minutes on 20 minutes off for an hour or two and see where it takes you. Be warned, it might just cause really uncomfortable ctx that don't actually lead to labor and you end up exhausted. But if you are trying to avoid a formal medical induction it might be worth it.
SAHM to DD 03/08 & DD 06/10 made with love with my DP