Just like IRL: only looking at women or only looking at men isn't creepy. But only looking at people with particular physical characteristics (aside from the small set that are acceptable to judge on) is creepy.
I think this is a pretty natural progression of applying machine learning to real life.
I find that people will say things like "I prefer people with blue eyes", but what they are really saying is that the people they find attractive often have blue eyes.
Humans don't seem to be able to actually determine the characteristics of a person's looks that makes them attractive, and rather resort to pattern recognition bias. So instead a computer is able to determine what you are actually attracted to as it doesn't have the same bias and is able to consciously distinguish more data from a person's face than the extremely basic set a human can.
