Deep Reconstruction of 3D Smoke Densities from Artist Sketches - INRIA - Institut National de Recherche en Informatique et en Automatique Accéder directement au contenu
Article Dans Une Revue Computer Graphics Forum Année : 2022

Deep Reconstruction of 3D Smoke Densities from Artist Sketches

Résumé

Creative processes of artists often start with hand-drawn sketches illustrating an object. Pre-visualizing these keyframes is especially challenging when applied to volumetric materials such as smoke. The authored 3D density volumes must capture realistic flow details and turbulent structures, which is highly non-trivial and remains a manual and time-consuming process. We therefore present a method to compute a 3D smoke density field directly from 2D artist sketches, bridging the gap between early-stage prototyping of smoke keyframes and pre-visualization. From the sketch inputs, we compute an initial volume estimate and optimize the density iteratively with an updater CNN. Our differentiable sketcher is embedded into the end-to-end training, which results in robust reconstructions. Our training data set and sketch augmentation strategy are designed such that it enables general applicability. We evaluate the method on synthetic inputs and sketches from artists depicting both realistic smoke volumes and highly non-physical smoke shapes. The high computational performance and robustness of our method at test time allows interactive authoring sessions of volumetric density fields for rapid prototyping of ideas by novice users.
Fichier principal
Vignette du fichier
paper1012_CRC.pdf (25.54 Mo) Télécharger le fichier
Vignette du fichier
teaser.jpg (21.11 Ko) Télécharger le fichier
paper1012_CRC_supp.mp4 (135.35 Mo) Télécharger le fichier
paper1012_CRC_supp.pdf (23.84 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Format : Vidéo

Dates et versions

hal-03711264 , version 1 (01-07-2022)

Identifiants

Citer

Byungsoo Kim, Xingchang Huang, Laura Wuelfroth, Jingwei Tang, Guillaume Cordonnier, et al.. Deep Reconstruction of 3D Smoke Densities from Artist Sketches. Computer Graphics Forum, 2022, 41 (2), pp.97-110. ⟨10.1111/cgf.14461⟩. ⟨hal-03711264⟩
87 Consultations
51 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More