Different babes seem to react differently to caffeine...some mamas find they can drink coffee and other caffeinated drinks all day without impacting their nurslings, while other mamas find that even a little piece of chocolate can make their babe fussy or wakeful.
So if you're just adding back caffeine then maybe go slow to see how your nursling reacts?