My 2yo worried me when she was a newborn for these same reasons. She wouldn't make eye contact except for a couple of seconds. She was also late to start social smiling (10 weeks instead of the usual 6 to 8 weeks). She would stare at the ceiling fan, and would only smile at inanimate objects.
Over the long term, lack of eye contact and lack of social smiling can sometimes be signs of autism spectrum disorders, apparently... so I was concerned. It worried me and also made me a little sad/mad, because I wanted feedback from her. I wanted us to have an emotional connection ASAP, to make all the sleepless nights worth it!
Of course, it all happened in good time. Now she wakes up and comes to find me, saying "Mama, I'm so glad you're here! Good morning, sweetheart!"
We have a very warm, loving connection now.
I think it is way too early for you to worry if you just gave birth on 8/22. More than likely your little one is just on his own schedule. I'm sure you will get that connection you are longing for soon... hang in there, mama.