I little dash won't be too exfoliating. If you're worried, dilute the baking soda in some hot water first and add honey. You can probably even keep a week's worth of this mixture in a bottle as a facial wash. I'm sure a pinch of salt would do the same thing, it just kind of breaks the gooeyness of the honey.
I have combination skin or normal skin that right now is tending on the dry side because of winter. Baking soda doesn't ever bug me if I use it everyday, but if I use a lot of baking soda, like 1/2 teasp to 1 teaspoon, I splash my face with ACV and moisturize afterward. I usually do this step in the shower in the morning. After work, if I'm washing my face in the sink, I don't do the ACV step, but the honey is acidic to a degree anyway. I use moisturizer after washing my face (either coconut oil, a dab of cocoa butter, or my Oil of Olay facial moisturizer). I'm sure olive oil is more moisturizing - I may have to switch, the coconut oil isn't that moisturizing for me sometimes.
Moisturization is key after washing your face anyway, nobody should skip that step, even if they have oily skin. Balancing the moisture on your face actually can keep your face from being too dry or too oily.