Dual Branch CNN and Transformer for Cardiac Atherosclerotic Plaque Classification
- Resource Type
- Conference
- Authors
- Lei, Haijun; Tong, Guanjie; Su, Huaqiang; Zhao, Jia; Zhang, Longjiang; Lei, Baiying
- Source
- 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) Bioinformatics and Biomedicine (BIBM), 2023 IEEE International Conference on. :2007-2010 Dec, 2023
- Subject
- Bioengineering
Computing and Processing
Engineering Profession
Robotics and Control Systems
Signal Processing and Analysis
Bridges
Training
Solid modeling
Three-dimensional displays
Convolution
Semantics
Transformers
Coronary artery classification
Feature fusion
Transformer
- Language
- ISSN
- 2156-1133
Accurate classification of coronary artery plaques can provide effective assistance for the diagnosis of coronary artery disease(CAD). The task of coronary artery plaque classification remains extremely challenging due to the complex anatomical structure and background of coronary arteries. 3D convolution still has limitations in feature modeling, so this study builds a dual branch bridge network based on convolution neural network (CNN) and Transformer framework, and fused the local feature extraction ability of convolution and the global modeling ability of Transformer through the bridge communication module. By using a shift attention (SA) module at the intersection of dual branch information to utilizes minimal computational complexity to fuse feature maps from both branches. The ghost plus (GP) module was aimed at balancing the enormous computational power issues of building rich semantic information and training difficulties in 3D Transformers. The proposed method have demonstrated the effectiveness through a large number of comparative and ablation experiment.