With the country’s increasing attention to the development of science and technology, the active safety technology of automobiles has also become the focus of people’s research. The traditional automobile manufacturing industry can no longer meet the market demand, and cars with intelligent driving assistance systems are increasingly favored by the market. The large market demand for smart cars has become the catalyst of automotive active safety technology, and companies that have studied automotive active safety technology have sprung up all over the world to set up research centers dedicated to automotive intelligent driving. The emergence of a large number of enterprises focusing on automobile intelligent driving makes the industry more and more competitive. Whoever can develop safer products at the lowest cost will surely occupy a place in the intelligent driving market first. This paper studies the intelligent vehicle driving assistance system based on machine vision. Intelligent vehicle driving assistance system is an important part of vehicle active safety and a key step towards fully automatic driving. In this paper, CCD camera is used to acquire the moving target image sequence, and the moving target is detected by the motion change based on background reconstruction. The motion direction of the object is calculated by motion segmentation and motion gradient. Using the short-term similarity of the target, the tracking and identification of the target can be completed, and then the long-term stable tracking of the target can be realized, the motion law of the target can be determined, and the real-time detection and tracking of the moving image can be realized.