The recognition of handwritten numbers is a significant challenge in the field of computer vision, as it finds applications in various domains including banking, medical diagnostics, and handwriting recognition. In recent years, there has been a notable enhancement in our technological capabilities due to the progress made in internet accessibility and technology. Deep learning algorithms have emerged as valuable computational tools for addressing several challenges, including the task of digit recognition. The utilization of convolutional neural networks in the task of digit recognition is driven by their ability to acquire hierarchical representations from picture data. This scholarly article provides a comprehensive examination of the application of Convolutional Neural Networks (CNNs) in the field of machine learning for the purpose of digit recognition. This research examines the architectural components of Convolutional Neural Networks (CNNs), the training procedures employed, and the various methodologies employed for the purpose of digit recognition. The paper also provides an overview of the different datasets used for training and testing CNNs for digit recognition and a discussion of the results obtained from various studies.