Agriculture sector is an important pillar of the global economy. The cotton crop is considered one of the prominent agricultural resources. It is widely cultivated in India, China, Pakistan, USA, Brazil, and other countries of the world. The worldwide cotton crop production is severely affected by numerous diseases such as cotton leaf curl virus (CLCV/CLCuV), bacterial blight, and ball rot. Image processing techniques together with machine learning algorithms are successfully employed in numerous fields and have also used for crop disease detection. In this study, we present a deep learning-based method for classifying diseases of the cotton crop, including bacterial blight and cotton leaf curl virus (CLCV). The dataset of cotton leaves showing disease symptoms is collected from various locations in Sindh, Pakistan. We employ the Inception v4 architecture as a convolutional neural network to identify diseased plant leaves in particular bacterial blight and CLCV. The accuracy of the designed model is 98.26% which shows prominent improvement compared to the existing models and systems.