Arrhythmia is one of the most common cardiovascular diseases. At present, most arrhythmias are classified by heartbeat. However, there are many problems with the use of heartbeat. For example, information such as incomplete compensatory interval after premature atrial beat cannot be used. There will also be a large error in the segmentation and interception of the heartbeat. It also wastes a lot of time while the program is running. However, research based on time window can effectively alleviate these problems. For wearable real-time ECG monitoring system, rapid, accurate and network lightweight design is the consensus of research. We propose a novel convolutional squeeze-and-excitation residual bidirectional GRU network (CSR-BiGRU) for arrhythmia time window. According to the characteristics of the ECG signal, the attention residual module (SERBlock) is fused into the CNN model, and BiGRU is combined to process the time information, which has achieved good results. Based on MIT-BIH arrhythmia database, the 10-fold cross validation was used to achieve 98.60% accuracy and 97.59% F1 score, which can accurately identify five types of common arrhythmias and has high detection performance, which can effectively make up for the shortage of heartbeat research.