To reveal the influences of soil particle size on the dynamic impact mechanical properties of frozen soil, four groups of frozen soil specimens composed of different particle sizes are tested using a split-Hopkinson pressure bar. Based on the Druger–Prager failure criterion and coupled damage-plasticity, a dynamic micro-constitutive model is established for describing the dynamic mechanical behavior of the frozen soil. Macroscopically, frozen soil is assumed to be homogeneous and continuous, although a large number of micro-cracks and micro-voids are distributed randomly throughout the volume. When a frozen soil specimen is subjected to a substantial shock, the propagation of micro-cracks and the collapse of micro-voids can induce damage. The evolution equations of the two damage mechanisms are proposed. Finally, through a comparison, it was shown that simulation results agreed well with the experimental results, thus validating the suitability of the developed model.