That describes us too!
We have a math program (well, 2, since we are doing both Miquon and Singapore) but don't do it every day. Usually when they ask for it (which is more often than I would have thought) or when I feel guilty that we haven't been doing enough math.

Reading is something we do daily though ds is reading fluently on his own and that has thankfully cut back on some of the read-aloud that I have had to do. I like reading to the kids but it seems like they could have me go on for many, many hours and I just can't do it.
Writing is something that occurs relatively frequently. We have these days where we
blitz learn. If we haven't touched math in a month, we'll huddle together in the living room and burn through tons of exercises or chapters together. Both dks are pretty far ahead of their school peers so I probably worry less than I could.
Everything else just kind of happens. It feels like we do our own relaxed version of unit studies. We pick something and run with it - reading related books, doing experiments and activities, going to museums, etc...
We are very involved in activities outside the home. There are art lessons, piano, scouts, gym classes, play-dates, field trips and now a new educational co-op. I used to think that this is something that we would cut back on as the dks got older (4 and nearly 7) but it really isn't slowing down. Honestly, we are enjoying ourselves too much and I still think they are learning quite a bit. We would be bored and antsy if we felt bound to the house to do table work.
Sometimes I feel guilty and set up schedules and organize material. I even went so far as to set up those workboxes. Didn't last...no surprise.

I don't feel like an unschooler because there are times when I will say 'you are learning this...'. Child-directed learning is something that weighs heavily on our decisions of what to do with the children and how but I still have certain expectations and force the occasional spelling test or copy-work.
There is a cyclical pattern to our schooling. We don't do much in the way of book work from summer right through to Christmas. Too much going on. Then the long winter hits and we feel more inclined towards being home-bodies, hunkering down and getting to those worksheets and projects that require a lot of physical output. Spring is sort of the same way. We feel more energetic and accomplish quite a bit. So, it may only look like school at home for half the year, or less, but lots of learning happens all year - just in different forms.