well, I feel really guilty about my answer, but my husband probably gets an average of 6 hours of sleep a night. I have not handled the transition from stay at home wife with nothing to do to mommy life very well and I know I have some post partum depression, plus my back hurts all the time from our heavy kid.. so my husband gets saddled with most of the baby watching while I try not to fall apart. We never get alone time because we have no friends or family available to watch the baby, and right now life is really just a game of survival for us, and my husbands sleep is what suffers the most. I don't think you have to listen to what anyone says about letting him sleep in, you guys have to do what works best for you as a couple, and if you happen to need him to wake up earlier for your own sanity, and HIS sanity can stay intact, so be it I say. I know my husbands a stronger person than I am so he also takes on a heavier load. I feel guilty about it.. but still, we gotta do what we gotta do.
eta: I think its okay to be upset that you feel you dont get to spend enough time with him. its true. sure he needs his sleep too, but you need him awake as well. Just try to be reasonable, compromise. I feel like I can totally relate to your feelings. Even if the "right" thing were to just let him get his sleep, it doesnt change the fact that you're feeling cheated or overworked or missing him or whatever.. your feelings arent just going to go away even if you were in the wrong. which is why its not really other people's opinions that matter, or whats right or wrong, its just a matter of finding a compromise that you can live with whether its totally fair or not.
my opinion is definitely dont let him sleep as long as he wants, unless of course you feel like you can handle it and feel like being nice. but, let him get a reasonable amount of sleep, at the same time. you know what I mean?