Aiming at the structural asymmetry problem caused by the inconsistency of the two optical fibers connecting the Y waveguide and the resonant cavity in the RFOG optical system driven by a broad-spectrum light source, a study on the non-reciprocity of the optical structure of the RFOG driven by a broad-spectrum light source was carried out. A model of the optical system structure non-reciprocity is established, and the effect of the optical system structure non-reciprocity on the gyroscope system in a variable temperature environment is analyzed. The results show that the optical system structure non-reciprocity causes the gyro sweep mode curve to change, but does not affect the system accuracy when there is no temperature change, and the temperature characteristics of the optical system structure non-reciprocity lead to pseudo-rotational speed output of the gyro output in a variable temperature environment, which is strongly correlated with the length difference and the rate of change of temperature.