DIFFUSION-BASED 3D FACIAL RECONSTRUCTION FROM A SINGLE IMAGE

Summary from the TLDR AI newsletter

This paper introduces a method that uses diffusion models, which have been successful in creating images, to reconstruct 3D facial features from just one image. The process involves using a dataset of facial textures, simulating various lighting conditions, and then using the diffusion model to fill in missing parts of the texture and unknown reflective properties, resulting in a more accurate and consistent 3D face.