Unsupervised Learning of 3D Object Reconstruction with Small Dataset
- Resource Type
- Conference
- Authors
- Chen, Shan-Ling; Shih, Kuang-Tsu; Chen, Homer H.
- Source
- 2021 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) AIVR Artificial Intelligence and Virtual Reality (AIVR), 2021 IEEE International Conference on. :54-59 Nov, 2021
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Training
Three-dimensional displays
Shape
Lighting
Virtual reality
Learning (artificial intelligence)
Generative adversarial networks
3D object reconstruction
GAN inversion
data augmentation
unsupervised learning
- Language
We propose an unsupervised learning framework trained with a small dataset for 3D object reconstruction from a single image. Our method utilizes autoencoders to extract 3D knowledge from an image, a differentiable renderer to generate an image from a reconstructed 3D object, and GAN inversion to produce pseudo images with random viewpoints and lighting to enlarge the training dataset. Quantitative and qualitative experimental results prove that our approach can recover 3D shapes with small dataset as accurately as state-of-the-art networks with large dataset.