Yup. We get these questions all the time here. Some moms feel a bit uncomfortable at first, thinking that nursing without milk is weird or nursing again after 'weaning' is weird.
My milk dried up at 16 months but we kept on nursing. We are at 23 mos and ds still nurses at least once a day. He wishes I still had milk and likes to put the bottle and my nipple in his mouth at one time.
He couldn't deal if mama took the nummies away. It would be very sad.
I think you should go for it. It's a wonderful nurturing thing to do.
But wait! I see from your sig that you have an infant nursling, so you have milk! I would be dancing for joy to get more mama milk into my toddler, were I you.