Sex 'in the other room'?

By rereading the other post about sex, it crossed my mind it is probably very difficult to have sex one day with A in my room, while B is sleeping in her own room, and the other day with B in my room, while A is sleeping in her own room. When sleeping in their own room, they will be hearing all the great sounds that are shaking the ground in the other room -- while not being able to join in. If not by anything else, this situation is bound to bring in jalousy. How does one cope with this?