Mutations in the histone 3 gene (H3K27M) are the eponymous drivers in diffuse intrinsic pontine gliomas (DIPGs) and other diffuse midline gliomas (DMGs), aggressive pediatric brain cancers for which no curative therapy currently exists. The salient molecular consequence of these recurrent oncohistones is a global loss of repressive H3K27me3 residues and broad epigenetic dysregulation. In order to identify specific, therapeutically targetable epigenetic dependencies within this disease context, we performed an shRNA screen targeting 408 genes classified as epigenetic/chromatin-associated molecules in patient-derived DMG cultures. This approach identified AFF4, the scaffold protein of the super elongation complex (SEC), as a previously-undescribed dependency in DMG. Interrogation of SEC function demonstrated a key role for maintaining DMG cell viability and clonogenic potential while promoting self-renewal of DMG tumor stem cells. Small-molecule inhibition of the SEC with the highly-specific, clinically relevant CDK9 inhibitors atuveciclib and AZD4573 restores regulatory RNA polymerase II pausing, promotes cellular differentiation, and leads to potent anti-tumor effect both in vitro and in patient-derived xenograft models. These studies present a biologic rationale for translational exploration of CDK9 inhibition as a promising therapeutic approach in a disease which currently has no effective medical therapies.