In this paper, an adaptive position control method combining proportional-derivative (PD) control, RBF neural network-based sliding mode (SM) control, and feedforward (FF) control, i.e., PD-FF-SM control, is proposed to deal with the dynamic uncertainties, disturbances, and slow response in lower limb exoskeleton robot system. The Lagrange method is utilized to establish dynamic models that ignore the uncertainties and disturbances in the swing phase and supporting phase. Then, the PD feedback controller is designed with a sliding surface function, to keep the system stable. The FF controller is adopted to improve the response by using dynamic models. And the RBF neural network-based SM controller is designed to compensate for the uncertainties and disturbances. The system’s stability is verified by Lyapunov’s theorem. The simulation results show that the proposed control method can effectively reduce the error of position tracking and response time with inaccurate dynamic modeling.