Robust and Guided Super-resolution for Single-Photon Depth Imaging via a Deep Network
- Resource Type
- Conference
- Authors
- Ruget, Alice; McLaughlin, Stephen; Henderson, Robert K.; Gyongy, Istvan; Halimi, Abderrahim; Leach, Jonathan
- Source
- 2021 29th European Signal Processing Conference (EUSIPCO) Signal Processing Conference (EUSIPCO), 2021 29th European. :716-720 Aug, 2021
- Subject
- Bioengineering
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Engineering Profession
Signal Processing and Analysis
Histograms
Laser radar
Superresolution
Signal processing algorithms
Detectors
Feature extraction
Cameras
LiDAR waveform
Guided Super-resolution
Deep network
Unet
robust reconstruction
- Language
- ISSN
- 2076-1465
The number of applications that use depth imaging is rapidly increasing, e.g. self-driving autonomous vehicles and auto-focus assist on smartphone cameras. Light detection and ranging (LiDAR) via single-photon sensitive detector (SPAD) arrays is an emerging technology that enables the acquisition of depth images at high frame rates. However, the spatial resolution of this technology is typically low in comparison to the intensity images recorded by conventional cameras. To increase the native resolution of depth images from a SPAD camera, we develop a deep network built to take advantage of the multiple features that can be extracted from a camera's histogram data. The network then uses the intensity images and multiple features extracted from down-sampled histograms to guide the up-sampling of the depth. Our network provides significant image resolution enhancement and image denoising across a wide range of signal-to-noise ratios and photon levels.