Why isn’t a child born of a married Jewish woman and her non-Jewish adulterer not a mamzer?

I read that a Jewish woman that has a child from an affair with a Jewish man that is not her husband has a mamzer status. Why is the child of a Jewish married woman and a nonjew not considered a mamzer? It’s still adultery.