Multimodal Control

Motion-example-controlled Co-speech Gesture Generation Leveraging Large Language Models

Bohong Chen, Yumeng Li, Youyi Zheng, Yao-Xiang Ding, Kun Zhou

Conference SIGGRAPH 2025 Animation & Simulation

Co-Speech Gesture Motion Generation Large Language Model Motion Tokenization Multimodal Control

Canvas-to-Image: Compositional Image Generation with Multimodal Controls

Yusuf Dalva, Guocheng Gordon Qian, Maya Goldenberg, Tsai-Shien Chen, Kfir Aberman, Sergey Tulyakov, Pinar Yanardag, Kuan-Chieh Jackson Wang

Conference SIGGRAPH 2026 Neural & Generative

Diffusion Model Compositional Generation Text-to-Image Multimodal Control Personalization Pose Control

MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpainting

Chen Tessler, Yunrong Guo, Ofir Nabati, Gal Chechik, Xue Bin Peng

Journal SIGGRAPH Asia 2024 Animation & Simulation

Physics-Based Character Control Reinforcement Learning Motion Completion Behavior Cloning Conditional VAE Multimodal Control

HOMA: Towards Generic Human-Object Interaction in Multimodal Driven Human Animation with Weak Conditions

Ziyao Huang, Zixiang Zhou, Juan Cao, Yifeng Ma, Yi Chen, Zejing Rao, Zhiyong Xu, Hongmei Wang, Qin Lin, Yuan Zhou, Qinglin Lu, Fan Tang

Conference SIGGRAPH Asia 2025 Image & Video

Human Object Interaction Human Animation Video Generation Diffusion Transformer Weak Conditions Multimodal Control Audio Driven Animation