Controlling Virtual Try-on Pipeline Through Rendering Policies
- Resource Type
- Conference
- Authors
- Li, Kedan; Zhang, Jeffrey; Chang, Shao-Yu; Forsyth, David
- Source
- 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) WACV Applications of Computer Vision (WACV), 2024 IEEE/CVF Winter Conference on. :5854-5836 Jan, 2024
- Subject
- Computing and Processing
Computer vision
Clothing
Pipelines
Rendering (computer graphics)
Applications
Visualization
Arts / games / social media
Commercial / retail
- Language
- ISSN
- 2642-9381
This paper shows how to impose rendering policies on a virtual try-on (VTON) pipeline. Our rendering policies are lightweight procedural descriptions of how the pipeline should render outfits or render particular types of garments. Our policies are procedural expressions describing offsets to the control points for each set of garment types. The policies are easily authored and are generalizable to any outfit composed of garments of similar types. We describe a VTON pipeline that accepts our policies to modify garment drapes and produce high-quality try-on images with garment attributes preserved.Layered outfits are a particular challenge to VTON systems because learning to coordinate warps between multiple garments so that nothing sticks out is difficult. Our rendering policies offer a lightweight and effective procedure to achieve this coordination, while also allowing precise manipulation of drape. Drape describes the way in which a garment is worn (for example, a shirt could be tucked or untucked).Quantitative and qualitative evaluations demonstrate that our method allows effective manipulation of drape and produces significant measurable improvements in rendering quality for complicated layering interactions.