You point to sex as a quantifiable, biological thing, but it's a lot messier than that and our understanding of sex is intertwined with our understanding of gender.

Is Caster Semenya's sex male or female? We have to defer to her gender identity to answer that question.