In order to reduce the problems of time-consuming, high cost as well as harsh sailing environment and unknown risks of the Unmanned Surface Vehicle(USV) in actual testing. This paper proposes a framework of USV visual simulation system based on virtual reality, focusing on simulation technologies such as experimental scene construction, simulation interactive communication, and USV motion simulation. Through the experimental, it is verified that the visual simulation system has good real-time and accuracy, and can simulate the real USV to realize the algorithm control to verify and improve the algorithm, which greatly improves the development efficiency of the USV.