We didnt have an issue when i had my second. My older one was in the middle and the baby was on the outside (at the time we had a crib with the side off next to our bed). Then we addedthe twin so we've always had enough room!
We've done the new bedroom thing.. We moved when she was 5 but it never was enough of a pull. One of us lays with them in their bed at night until they are adleep, and there are nights where she makes it til 3am or so. But there are way more nights where they are back in our room before we are even asleep.
Oh well, guess it will happen at some point!