Abstract Receptor activator of nuclear factor kappa-B ligand (RANKL) initiates a complex signaling cascade that is crucial for inducing osteoclast differentiation and activation. RANKL-induced signaling has been analyzed in detail, and the involvement of TNF receptor-associated factor 6 (TRAF6), calmodulin-dependent protein kinase (CaMK), NF-κB, mitogen-activated protein kinase (MAPK), activator protein-1 (AP-1), and molecules that contain an immunoreceptor tyrosine-based activation motif (ITAM) has been reported. However, the precise molecular steps that regulate RANKL signaling remain largely unknown. Here, we revealed the indispensable role of a class III histone deacetylase (SIRT5) in the processes of RANKL-induced osteoclast differentiation and activation. SIRT5 expression in osteoclasts was increased during osteoclastogenesis upon stimulation with RANKL. The RANKL-induced signaling activation was suppressed in SIRT5-deficient osteoclasts but enhanced by SIRT5 overexpression. Mice with global or conditional monocytic lineage knockout of SIRT5 had increased bone mass and reduced osteoclast numbers. In the cytoplasm, SIRT5 interacted with the scaffold protein JNK-interacting protein 4 (JIP4) to finely regulate MAPK signaling, which was critical for osteoclast differentiation and activation. Pharmacological inhibition of the catalytic activity of SIRT5 effectively reversed bone loss in ovariectomized mice. Taken together, the results of this study reveal that the SIRT5-JIP4 axis is a novel positive regulator that finely regulates RANKL-induced osteoclast differentiation and suggest that targeting this axis is a therapeutic strategy for preventing osteoporotic bone loss. Graphical Abstract