TLDR AI · RESEARCH & INNOVATION

AUDIO-DRIVEN ANIMATION

arxiv.org7 min read

Summary from the TLDR AI newsletter

AniPortrait is a framework designed to create lifelike animated portraits from a single reference image and audio input. By translating audio into 3D representations and then mapping these onto 2D facial landmarks, this method produces animations that excel in natural facial expressions, varied poses, and high visual quality.