Even as a toddler he hated reading time, I have spent hours cuddling on the couch with his sisters reading books and he has NEVER enjoyed it, always wants to be moving. He does like puzzles and blocks but for the most part is not crazy about sedately activities-he's not too interested in the TV either not that were a big TV family either. I have taken him to the library and chosen books I thought he would enjoy (star wars etc) to read to him and unless its bedtime he's not really interested.
He sounds a lot like my DD, who is 8. She also had a mild speech delay when she was little (but tested at age level by age 3).
My DD is also very active and does not like sedentary activities.
At age 7, I wouldn't worry about his reading. It sounds like he's just not interested because it requires sitting still and focusing on something that is horribly boring to him right now. I'd try to find as much time to read to him as possible. For DD, I read to her while she was swinging on the swing, in the bathtub, books on CD in the car, and before bed when she was tired enough to hold still. I had to be open to times when it would work for her.
DD responded well to acting out scripts, acting out a part of the book I was reading to her while she was on the trampoline... anything that could make it active for her. If you can modify some of his reading activities so that they are more active - such as having to jump from the letter that makes the "puh" sound to the letter that makes the "buh" sound on a chalked grid on the sidewalk - that would help. When we are doing sight words, DD likes a game where I hold up two sight word cards and she has to touch her toe to the right one while swinging forward on the swing, and I make it playful by pulling it ouf of her reach at the last minute or moving it to the side suddenly. She'll ask, "can we do sight words now?" I was ecstatic to find a reading activity that she actually wanted to do.
DD requires one-on-one attention to develop her reading skills. Its not really possible to get around that for her. I don't think its unusual that he would also need this.
DD is just past 8 and is now reading at low second grade level. She started making huge progess when she turned 8. She was barely reading at kindergarten level when she was 7.