Transfer Learning Based Approach for Semantic Person Retrieval
- Resource Type
- Conference
- Authors
- Yaguchi, Takuya; Nixon, Mark S.
- Source
- 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) Advanced Video and Signal Based Surveillance (AVSS), 2018 15th IEEE International Conference on. :1-6 Nov, 2018
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Task analysis
Semantics
Training
Avatars
Torso
Legged locomotion
Image color analysis
- Language
Many algorithms for semantic person retrieval suffer from a lack of training data often due to the difficulties in constructing a large dataset. We therefore propose a transfer learning based approach for semantic person identification and semantic person search. We apply the fine-tuned Mask R-CNN and DenseNet-161 for detection and attribute classification. The networks were pre-trained on the MS COCO and ILSVRC 2012 datasets. Our proposed approach achieves the highest recognition rate at each rank of CMC curve for semantic person identification and the highest average localization precision for semantic person search on our validation dataset.