CLOTH3D: Clothed 3D Humans

@inproceedings{Bertiche2020CLOTH3DC3,
  title={CLOTH3D: Clothed 3D Humans},
  author={Hugo Bertiche and Meysam Madadi and Sergio Escalera},
  booktitle={ECCV},
  year={2020}
}
This work presents CLOTH3D, the first big scale synthetic dataset of 3D clothed human sequences. CLOTH3D contains a large variability on garment type, topology, shape, size, tightness and fabric. Clothes are simulated on top of thousands of different pose sequences and body shapes, generating realistic cloth dynamics. We provide the dataset with a generative model for cloth generation. We propose a Conditional Variational Auto-Encoder (CVAE) based on graph convolutions (GCVAE) to learn garment… 
SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing
TLDR
SizerNet to predict 3D clothing conditioned on human body shape and garment size parameters, and ParserNet to infer garment meshes and shape under clothing with personal details in a single pass from an input mesh are introduced.
DeepCloth: Neural Garment Representation for Shape and Style Editing
TLDR
DeepCloth is introduced, a unified framework for garment representation, reconstruction, animation and editing, and proposes a garment animation method by unifying the neural garment representation with body shape and pose, achieving plausible garment animation results leveraging the dynamic information encoded by the shape and style representation.
A Study on Different Architectures on a 3D Garment Reconstruction Network
TLDR
The pooling network is best suited for modelling the complex dynamics present in the dress and skirt garment types, while there is little difference between the networks for the top, tshirt, trousers, and jumpsuit garment types.
GarmentNets: Category-Level Pose Estimation for Garments via Canonical Space Shape Completion
  • Cheng Chi, S. Song
  • Computer Science
    2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  • 2021
TLDR
This paper proposes GarmentNets, where the key idea is to formulate the deformable object pose estimation problem as a shape completion task in the canonical space, and proposes a novel 3D shape representation using the generalized winding number field.
Point-Based Modeling of Human Clothing
TLDR
This work proposes a new approach to human clothing modeling based on point clouds that can infer the geometry of new outfits from as little as a single image, and perform outfit retargeting to new bodies in new poses.
NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garments
TLDR
This work proposes to use a garment sewing pattern, a realistic and compact garment descriptor, to facilitate the intrinsic garment shape estimation and introduces NeuralTailor, a novel architecture based on point-level attention for set regression with variable cardinality, to apply to the task of reconstructing 2D garment sewing patterns from the 3D point could garment models.
Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks
and local information extracted from low-frequency meshes. In addition, our method can estimate garment deformations caused by variations of the simulation parameters (e.g., fabric’s bending
Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On
We propose a new generative model for 3D garment deformations that enables us to learn, for the first time, a data-driven method for virtual try-on that effectively addresses garment-body collisions.
Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry
TLDR
A structured task-based multi-label classification of fashion research articles provides researchers with explicit research directions and facilitates their access to the related studies, improving the visibility of studies simultaneously.
DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation
TLDR
This work proposes a simple model that can animate any outfit, independently of its topology, vertex order or connectivity, and proposes a methodology to complement supervised learning with an unsupervised physically based learning that implicitly solves collisions and enhances cloth quality.
...
1
2
3
4
...

References

SHOWING 1-10 OF 45 REFERENCES
ClothCap
TLDR
The ClothCap approach uses a new multi-part 3D model of clothed bodies, automatically segments each piece of clothing, estimates the minimally clothed body shape and pose under the clothing, and tracks the 3D deformations of the clothing over time.
Multi-Garment Net: Learning to Dress 3D People From Images
TLDR
Multi-Garment Network is presented, a method to predict body shape and clothing, layered on top of the SMPL model from a few frames of a video, allowing to predict garment geometry, relate it to the body shape, and transfer it to new body shapes and poses.
Variational Autoencoders for Deforming 3D Mesh Models
TLDR
This paper proposes a novel framework which is able to learn a reasonable representation for a collection of deformable shapes, and produce competitive results for a variety of applications, including shape generation, shape interpolation, shape space embedding and shape exploration, outperforming state-of-the-art methods.
Detailed, Accurate, Human Shape Estimation from Clothed 3D Scan Sequences
TLDR
This work contributes a new approach to recover a personalized shape of the person by estimating body shape under clothing from a sequence of 3D scans, which outperforms the state of the art in both pose estimation and shape estimation, qualitatively and quantitatively.
GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping
TLDR
This work builds upon the recent progress in 3D point cloud processing with deep networks to extract garment features at varying levels of detail, including point-wise, patch-wise and global features and fuse these features with those extracted in parallel from the 3D body, so as to model the cloth-body interactions.
DRAPE: DRessing Any PErson
TLDR
An algorithm that dresses the body with a garment that is customized to fit and possesses realistic wrinkles is described that is significantly more efficient than physical simulation.
SimulCap : Single-View Human Performance Capture With Cloth Simulation
  • Tao Yu, Zerong Zheng, Yebin Liu
  • Computer Science
    2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2019
TLDR
By incorporating cloth simulation into the performance capture pipeline, this system can simulate plausible cloth dynamics and cloth-body interactions even in the occluded regions, which was not possible in previous capture methods.
SMPL: a skinned multi-person linear model
TLDR
The Skinned Multi-Person Linear model (SMPL) is a skinned vertex-based model that accurately represents a wide variety of body shapes in natural human poses that is compatible with existing graphics pipelines and iscompatible with existing rendering engines.
Analyzing Clothing Layer Deformation Statistics of 3D Human Motions
TLDR
It is shown that this model not only allows to reproduce previous retargeting works, but generalizes the data generation capabilities to other semantic parameters such as clothing variation and size, or physical material parameters with synthetically generated training sequence, paving the way for many kinds of capture data-driven creation and augmentation applications.
Detailed Human Avatars from Monocular Video
TLDR
This paper contributes facial landmark and shading-based human body shape refinement, a semantic texture prior, and a novel texture stitching strategy, resulting in the most sophisticated-looking human avatars obtained from a single video to date.
...
1
2
3
4
5
...