Because of the port’s intricate structure and underwater concealment, structure health monitoring is a crucial tool for ensuring the safe and steady functioning of the facility. This work proposes the visualization improvement approach of multi-source data fusion and builds a digital twin model of the port structure and auxiliary monitoring system based on the virtual-real mapping port digital twin modeling theory. This paper also implements the innovation of the digital twin display carrier, proposes the floating stereoscopic display technology for the naked eye and the multi-source interaction technology based on gesture recognition, develops the floating stereoscopic display equipment, and realizes the visual display and natural interaction of the digital twin for the safety monitoring of port structure, which is a new exploration for the safety maintenance of port structure.