Wow old thread! Fun! I have been doing pretty awesome with this I think!! I took it just one bill at a time... first was internet since my employer reimburses me for it (and I provide all the substantiating papers to my company electronically) so it seemed least threatening. Then I switched the cell phones and slowly just about everything! I don't regret it at all, I wish I'd done it sooner.
I still get my quarterly water bill in paper since that's the only option, but I throw it out after it's paid.
I chose to keep my checking account in paper since they send me copies of my checks which I need for tax purposes. I also kept my credit card bill paper because I just feel the need to have it (that's how I pay most of my bills so I guess I like having a paper record that I've paid them??) I might be able to forego the credit card one, not sure. But it's awesome not to have the rest cluttering up our counters and desk drawers & filing cabinets. DO IT!!! Even if you're not ready or will never be ready to do it with all your bills, start with the ones you can!!