Plastic waste is a serious environmental issue that damages human health, wildlife, and habitats. Many researchers have come out with multiple solutions on the problem. One of the most efficient ways is to implement machine learning approaches to detect plastic waste in common areas. Deep learning is a powerful machine learning approach that automatically learns image features for object recognition tasks using an object detector. Therefore, this paper proposed a recent object detection model, YOLOv5m, to develop a plastic waste detection model. Two plastic waste datasets, which consist of red, green, and blue (RGB) and red, green, and near-infrared (RGNIR) images, are introduced to train the proposed model. The performance of the proposed model is evaluated using 10-fold cross-validation on the two datasets. The proposed model achieves the best result on RGNIR datasets for validation and testing with an average mAP@0.5:0.95 value of 69.39% and 69.45%, respectively. These results indicate that near-infrared information can be a valuable feature representation in machine learning. This opens more possible opportunities, such as the development of automated plastic detection for the robotic and waste management industry.