I read Jerry Mander's "Four Arguments for the Elimination of Television" a few years ago. It's a good read.
Here is the wikipedia article about it:
Another book I've heard of, but haven't read, is called "Airwaves from Hell". Here it is on Amazon:
Have you read any good books about why it's not a good idea to watch television that you would like to share with us?