Summary The universally conserved Sec61/SecY channel mediates transport of many newly synthesized polypeptides across membranes, an essential step in protein secretion and membrane protein integration 1-5 . The channel has two gating mechanisms—a lipid-facing lateral gate, through which hydrophobic signal sequences or transmembrane helices (TMs) are released into the membrane, and a vertical gate, called the plug, which regulates the water-filled pore required for translocation of hydrophilic polypeptide segments 6 . Currently, how these gates are controlled and how they regulate the translocation process remain poorly understood. Here, by analyzing cryo-electron microscopy (cryo-EM) structures of several variants of the eukaryotic post-translational translocation complex Sec61-Sec62-Sec63, we reveal discrete gating steps of Sec61 and the mechanism by which Sec62 and Sec63 induce these gating events. We show that Sec62 forms a V-shaped structure in front of the lateral gate to fully open both gates of Sec61. Without Sec62, the lateral gate opening narrows, and the vertical pore becomes closed by the plug, rendering the channel inactive. We further show that the lateral gate is opened first by interactions between Sec61 and Sec63 in both cytosolic and luminal domains, a simultaneous disruption of which fully closes the channel. Our study defines the function of Sec62 and illuminates how Sec63 and Sec62 work together in a hierarchical manner to activate the Sec61 channel for post-translational translocation.