Research on sex-related brain asymmetries has not yielded consistent results. Despite its importance to further understanding of normal brain development and mental disorders, the field remains relatively unexplored. Here we employ a recently developed asymmetry measure, based on the Dice coefficient, to detect sex-related gray matter asymmetries in a sample of 457 healthy participants (266 men and 191 women) obtained from 5 independent databases. Results show that women’s brains are more globally symmetric than men’s (p < 0.001). Although the new measure accounts for asymmetries distributed all over the brain, several specific structures were identified as systematically more symmetric in women, such as the thalamus and the cerebellum, among other structures, some of which are typically involved in language production. These sex-related asymmetry differences may be defined at the neurodevelopmental stage and could be associated with functional and cognitive sex differences, as well as with proneness to develop a mental disorder.