Electroencephalogram (EEG) equipped with high time resolution that distracted by incoherent brain sources which including ocular artifacts (OAs) generating by blinks is of great significance. Therefore, these OAs got corrected before extracting information from EEG is indispensable. Improved Moment Matching (IMM) is a high-speed denoising algorithm suitable for removing OA in multi-channel EEG, which is an improvement of the moment matching method used to remove stripe noise in hyperspectral images. On foundation of this, this paper proposes an optimization algorithm for IMM based on Gaussian decay function (IMM_G). In the first place, the construction of the reference signal is optimized via utilizing a Gaussian decay function, thereby preventing the signal distortion caused by the filter. And then, a method for judging the to-be-processed interval is proposed to realizes the individualized processing of different channels. As a result, through quantitative comparison experiments with simulated data and real data from the UAIS laboratory, it was identified that IMM_G showed less time complexity, significantly enhanced arithmetic speed and denoising consequence while the detail retention ability of the original method for the non-blinking region of multi-channel EEG data is maintained. Hence, this method could be extensively used in High-density EEG (hdEEG) OAs removal scene.