Brainstem regions support critical bodily functions, yet their genetic architectures and involvement in brain disorders remain understudied. Here, we examined volumes of brainstem structures using magnetic resonance imaging in 43,353 individuals. In 27,034 genotyped healthy participants, we identified 16 genetic loci associated with whole brainstem volume and 10, 23, 3, and 9 loci associated with volumes of the midbrain, pons, superior cerebellar peduncle, and medulla oblongata, respectively. These loci were mapped to 305 genes, including genes linked to brainstem development and common brain disorders. We detected genetic overlap between the brainstem volumes and eight psychiatric and neurological disorders. Using imaging data from 16,319 additional individuals, we observed differential volume alterations in schizophrenia, bipolar disorder, multiple sclerosis, mild cognitive impairment, dementia, and Parkinson's disease. Together, our results provide new insights into the genetic underpinnings of brainstem structures and support their involvement in common brain disorders.