MA-CVP-MVSNet: Multi-View Stereo Model Based on Hybrid Attention Network
- Resource Type
- Conference
- Authors
- Lu, Lu; Huang, Hongbo; Yan, Xiaoxu; Liu, Yizhuo; Zhang, Zixia; Chen, Hanjun; Zhou, Shichao; Rui, Zixuan
- Source
- 2023 3rd International Conference on Electronic Information Engineering and Computer Science (EIECS) Electronic Information Engineering and Computer Science (EIECS), 2023 3rd International Conference on. :762-766 Sep, 2023
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Point cloud compression
Solid modeling
Costs
Computational modeling
Semantics
Feature extraction
Data mining
Multi-view stereo
Depth estimation
Attention mechanism
Cost volume
- Language
In current deep-learning-based multi-view stereo methods, feature extraction and cost volume regularization are two key steps that affect the reconstruction quality. Most current methods have difficulties both in accurately extract the required features and fully utilize the multi-scale contextual semantic information in the cost volumes. In this work, we propose a MA-CVP-MVSNet based on hybrid attention mechanism for multi-view stereo. The proposed method consists of two core attention mechanisms. One is the Criss-Cross Attention module to capture the global dependencies of the pixels in the feature map. The other is the SK Attention module, which is used for cost volume regularization to aggregate multi-scale contextual semantic information in the cost volumes. Experiments show that our method has a remarkable improvement in accuracy and achieves competitive results.