With the development of quantum control technology, atomic gyroscopes based on the Spin Exchange Relaxation Free (SERF) have been expected to be the development trend for the next generation of high-precision gyroscopes. As a crucial parameter of the SERF atomic spin gyroscope, the temperature stability of the alkali vapor cell determines the stability of the gyroscope scale factor. Therefore, high-precision temperature control of the alkali vapor cells is important to achieve an accurate measurement by an atomic gyroscope. Besides, since the atoms in the cell are very sensitive to the low-frequency magnetic field noise, it is necessary to ensure that the low-frequency magnetic field noise is not introduced during the heating process. In order to meet these requirements, a non-magnetic temperature control system of the alkali vapor cells based on the STM32 and Labview is designed in this paper. The proposed system is verified by experiments. The experimental results show that the equivalent interference magnetic field of the proposed system is less than 50 fT/ Hz 1/2 , temperature measurement accuracy is 2 mK; and near the operating temperature of 180°C, the temperature stability is ±3 mK.