It was tough for me w/my first, too. I wasn't working at all, so I spent a lot of time hanging out with a mothering group - just sitting around talking, eating, holding our babies. I feel like just holding an alert baby while talking to other adults to be really good quality time because there's lots for them to watch, lots of energy going around, and they get some direct attention in there, too.
Husband and I trade him back and forth and talk to him, he coos and gurgles back. We play all the little games suggested on BabyCenter like show him finger puppets, let him smell spices, whisper in his ear through a toilet paper tube, drag him around on his tummy on a blanket, etc.. I show him himself in the mirror. I took him outside a few times when it's warm. I read him books.
I often put on Pandora [I made a Raffi/Laurie Berkner/Woodie Guthrie station for him] and we sing and dance around.
I try to fold the laundry, etc. with him in the sling, but I'm 5'2"...it's hard to reach past him and do things.
Sometimes he likes to watch his mobile for a while.
I do spend a little time on the computer or watching tv, but honestly I mostly do that when he's asleep or nursing. I mean, I spend A LOT of time on computer or tv, but not when he's quiet alert. We do tend to spend some time watching Three's Company at 4am if I'm super tired. At 4 am he often wakes up for 1-2 hours consisting of diaper, nursing, quiet alert, and walking him back to sleep. I can walk in a circle in my house around the central stairway through kitchen dining and livingroom, so nice.
In our childbirth class way back when, she said, don't *do* the baby. Do your life, while holding the baby. Don't know if I'm very successful with that. I think part of it is a lot of my life is me sitting at the computer - maybe this concept works better with physical activity, like doing the shopping, [working in the fields] whatever.
Sometimes I feel like he would be content just sitting there staring into space, and I'm creating the stress and creating a child who can't just chill. Other times, he truly is fussy just sitting there.