The image sequences captured by Unmanned Aerial Vehicles (UAVs) can be applied to many computer vision tasks. However, due to the instability of UAV flight, the captured image sequences will deviate from the preset trajectory and pose, which reduce the quality of subsequent applications such as panoramic image stitching. In this paper, a novel method is proposed to rectify UAV-captured image sequences by transforming the images to a regular trajectory with the uniform pose. First, to minimize the total transformation deviation, virtual regular camera trajectory is derived by minimizing the global error of coordinates between actual and virtual camera trajectories. Then, camera-pose-relevant local homography is proposed by inserting the camera pose into local homography to transform the images to the derived virtual trajectory with the uniform pose and correct translation parallax. The experimental results demonstrate the effectiveness of the proposed rectification algorithm from both theoretical and application levels.