The easiest thing I did was removing electronics from my bedroom and replacing my clock with a wind-up model. I have read several articles about "electromagnetic stress" from anything that conducts energy. I don't know for certain how dangerous, if at all, it is, but I do know I sleep much better with no electronics nearby. My bedroom is a restful place now.
I switched to simple cleaners like vinegar and baking soda as I used up my old products. I actually find cleaning more fun now.
I ditched the stinky plastic shower curtain and got a cotton one like this:
http://store.greenfeet.com/itemMatri...ode=2002-01630 I should have realized sooner how toxic the plastic ones are just by the smell that comes off a new one.

:
I bought a lambswool duster from Target. It was about $7 and it picks up dust when you think there's none. It's that good. When it gets filthy it's easy to wash with just a bit of soapy water and it dries quickly. It's far superior to any feather duster I've ever used. My daughter calls our duster Fuzzy.

I second the suggestions for using cloth bags and buying used. Learning to reuse what you already have can be intimidating at first, but after a while it becomes fun. You're constantly wanting to top your last big idea.

We recently ditched the nasty Teflon cookware and bought enamel clad cast iron. It's similar to Le Creuset but the brand I bought (on ebay) was only $74 for the full set. With care it will last a lifetime.

(I bought new after scouring thrifts and sales for over a year trying for used. Ah well.)
Buying locally is a big deal for us. We're on a very tight budget so eating organic foods from the store isn't always possible for us. Lots of local farmers use organic growing methods but aren't certified, so the produce isn't marked up. We're able to get fresh locally grown organic fruits and veggies, a double whammy

, for an excellent price.
Toy swaps, book swaps, libraries... all are great resources. Use them if you have them.
Cloth menstrual pads or cups are a healthy, frugal alternative to disposable products.
If there are any Quaker groups near you, ask them for suggestions. They can point you to local resources, ad they have excellent mindful living tips. I've learned a lot from them.
And I agree with the pp's who said take it a step at a time. What seems radical now (cloth tp anyone?) may not seem so strange once you've taken the first steps into mindfulness.