Speech-Driven Animation

BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer

Kunkun Pang, Dafei Qin, Yingruo Fan, Julian Habekost, Takaaki Shiratori, Junichi Yamagishi, Taku Komura

Journal SIGGRAPH 2023 Animation & Simulation
Gesture Synthesis Motion Generation Transformer Variational Inference Speech-Driven Animation

S3: Speech, Script and Scene driven Head and Eye Animation

Yifang Pan, Rishabh Agrawal, Karan Singh

Journal SIGGRAPH 2024 Animation & Simulation
Facial Animation Gaze Speech-Driven Animation Head Motion Scene Saliency

A Platform for Interactive AI Character Experiences

Rafael Wampfler, Chen Yang, Dillon Elste, Nikola Kovačević, Philine Witzig, Markus Gross

Conference SIGGRAPH 2025 HCI & XR
Conversational AI Embodied Agents Digital Characters LLM Interactive Storytelling Speech-Driven Animation

Model See Model Do: Speech-Driven Facial Animation with Style Control

Yifang Pan, Karan Singh, Luiz Gustavo Hafemann

Conference SIGGRAPH 2025 Animation & Simulation
Facial Animation Speech Driven Animation Latent Diffusion Model Style Transfer Example Based Generation

Tiny is not small enough: High quality, low-resource facial animation models through hybrid knowledge distillation

Zhen Han, Mattias Teye, Derek Yadgaroff, Judith Bütepage

Journal SIGGRAPH 2025 Animation & Simulation
Facial Animation Speech-Driven Animation Knowledge Distillation Pseudo Labeling Real-Time Animation On-Device Inference Lip Sync

Emotional Speech-Driven Animation with Content-Emotion Disentanglement

Radek Danecek, Kiran Chhatre, Shashank Tripathi, Yandong Wen, Michael J. Black, Timo Bolkart

Conference SIGGRAPH Asia 2023 Animation & Simulation
Facial Animation Speech-Driven Animation Emotion Disentanglement 3D Avatar Variational Autoencoder FLAME

ARTalk: Speech-Driven 3D Head Animation via Autoregressive Model

Xuangeng Chu, Nabarun Goswami, Ziteng Cui, Hanqin Wang, Tatsuya Harada

Conference SIGGRAPH Asia 2025 Animation & Simulation
Speech-Driven Animation 3D Head Animation Autoregressive Model Motion Generation Facial Animation