And I do, but it can actually happen when stress takes over. As men age, it's natural for them to experience a somewhat decreased sex drive, according to a man's sex. As if, I guess, we're just slaves to our sex drives. The stereotype goes that all men are the kind of people that releases warmth and positivity. Sex plays a significant part in the lives of men who, for a variety of reasons, just aren't in the mood.