Realistically transfer a garment from a product photo onto a person image, warping the cloth to body geometry and inpainting it in with a diffusion try-on model.
Properties
family
generate-to-edit
modality
person image + garment image -> image
whyMultiModel
Try-on couples geometric garment warping with a diffusion inpaint conditioned on the warped garment; neither a pure generator nor a plain inpainter handles the two together.
steps
[object Object], [object Object], [object Object]
controls
Person and garment inputs; garment category; agnostic masks (pose, parse); try-on guidance scale.
exampleStack
IDM-VTON (or CatVTON/OOTDiffusion) -> 2x upscale.
useCases
[E-commerce product previews][Lookbook generation][Catalog at scale]
pitfalls
Extreme poses and occlusions warp the garment incorrectly; hair and hands crossing the garment region cause artifacts.