Abstract Aqueous Zn‐ion batteries own great potential on next generation wearable batteries due to the high safety and low cost. However, the uncontrollable dendrites growth and the negligible subzero temperature performance impede the batteries practical applications. Herein, it is demonstrated that dimethyl sulfoxide (DMSO) is an effective additive in ZnSO 4 electrolyte for side reactions and dendrites suppression by regulating the Zn‐ion solvation structure and inducing the Zn 2+ to form the more electrochemical stable (002) basal plane, via the higher absorption energy of DMSO with Zn 2+ and (002) plane. Moreover, the stable reconstructed hydrogen bonds between DMSO and H 2 O dramatically lower the freezing point of the electrolyte, which significantly increases the ionic conductivity and cycling performance of the aqueous batteries at subzero temperatures. As a consequence, the symmetrical Zn/Zn cell can be kept stable for more than 2100 h at 20 °C and 1200 h at −20 °C without dendrite and by‐products formation. The Zn/MnO 2 batteries can perform steadily for more than 3000 cycles at 20 °C and 300 cycles at −20 °C. This work provides a facile and feasible strategy on designing high performance and dendrite free aqueous Zn‐ion batteries for various temperatures.