Of course! It is not natural for two men or women to live together. If a child is raised in this kind of unstable environment, it will quickly become evident they are not biologically related to either one or both of the parents. Kids who are raised like this could also be bullied. It is unnatural, and unfair to a child in this situation.