Due to the increasing demand for speech recognition in terminal devices, in order to speed up the speech recognition process in embedded processors and improve the speech recognition accuracy, and considering the disadvantages of solidity, high cost and inflexibility of application specific integrated circuit implementation, this paper proposes a speech recognition module based on RISC-V embedded processor, which is integrated into Hummingbird E203 processor, controlled by four custom instructions, and streamlined execution, taking advantage of the FPGA's strengths in table look-up and IP cores to speed up the speech recognition execution process. The recognition module operates at 16MHz with a total power consumption of 0.4W and a recognition time of 18ms, which is 2-3 times faster than similar designs and has been tested to achieve a 90% recognition accuracy rate.