In the current era, there has been a rapid advancement in the field of information technology. When scholars compose their research papers, it can be challenging for them to conduct an exhaustive examination of the existing literature. Therefore, it is essential to create a system that can suggest suitable citations to researchers during the writing process. This study aims to recommend relevant citations to researchers by utilizing weighted bag of words and BERT models. The proposed mechanism provides the following benefits: (1) Clear and transparent representation of document vectors; (2) A range of diverse natural language processing techniques, and (3) Avoidance of redundant citation suggestions.