TOTALLY. i feel that way much of the time, which irritates do-gooders, but since i am almost constantly topless for a few weeks, it's even harder.
and yes- you can hand off for most things. i always joke that i'm a two-trick pony. if the baby doesn't need one boob or the other, then Daddy is the solution!!! it was easier w/ the 3rd and 4th as daddy was around more and more available, and he was great at working w/ the baby in the bouncy chair and his foot going to knock them out. the first 2 months are crazy, then things shift, and then shift again. really, as long as both of your are communicating well and getting some rest, i think it's a fun challenge.