My older DS did that until he was about 4. The baby does it now. If it doesn't bother you, who cares. You're his "lovey".