Surface-enhanced Raman scattering (SERS) spectroscopy has emerged as a powerful analytical technique for detecting and identifying trace chemical and biological molecules. In this review, we present an in-depth discussion of recent advances in the field of crystal phase manipulation to achieve exceptional SERS performance. Focusing on transition metal dichalcogenides, (hydr)oxides, and carbides as exemplary materials, we illustrate the pivotal role of crystal phase regulation in enhancing SERS signals. By exploring the correlation between crystal phases and SERS responses, we uncover the underlying principles behind these strategies, thereby shedding light on their potential for future SERS applications. By addressing the current challenges and limitations, we also propose the prospects of the crystal phase strategy to facilitate the development of cutting-edge SERS-based sensing technologies.