Diffusion Model

47 papers 37 Conference 10 Journal

Autonomous Character-Scene Interaction Synthesis from Text Instruction

Nan Jiang, Zimo He, Zi Wang, Hongjie Li, Yixin Chen, Siyuan Huang, Yixin Zhu

Conference SIGGRAPH Asia 2024 Human Scene Interaction Motion Synthesis Diffusion Model MoCap Dataset

BlobGEN-3D: Compositional 3D-Consistent Freeview Image Generation with 3D Blobs

Chao Liu, Weili Nie, Sifei Liu, Abhishek Badki, Hang Su, Morteza Mardani, Benjamin Eckart, Arash Vahdat

Conference SIGGRAPH Asia 2024 Diffusion Model Compositional Generation 3D Consistent Generation Novel View Synthesis

BSDF importance sampling using a diffusion model

Ziyang Fu, Yash Belhe, Haolin Lu, Liwen Wu, Bing Xu, Tzu-Mao Li

Conference SIGGRAPH Asia 2024 BSDF Importance Sampling Diffusion Model Monte Carlo Rendering

Consolidating Attention Features for Multi-view Image Editing

Or Patashnik, Rinon Gal, Daniel Cohen-Or, Jun-Yan Zhu, Fernando De la Torre

Conference SIGGRAPH Asia 2024 Multi View Editing Diffusion Model Self Attention Neural Radiance Fields Geometric Editing

Content-aware Tile Generation using Exterior Boundary Inpainting

Sam Sartor, Pieter Peers

Journal SIGGRAPH Asia 2024 Wang Tiles Diffusion Model Inpainting Texture Synthesis Tileable Textures

Customizing Text-to-Image Diffusion with Object Viewpoint Control

Nupur Kumari, Grace Su, Richard Zhang, Taesung Park, Eli Shechtman, Jun-Yan Zhu

Conference SIGGRAPH Asia 2024 Diffusion Model Model Customization Viewpoint Control NeRF Text-to-Image

Customizing Text-to-Image Models with a Single Image Pair

Maxwell Jones, Sheng-Yu Wang, Nupur Kumari, David Bau, Jun-Yan Zhu

Conference SIGGRAPH Asia 2024 Text-to-Image Diffusion Model Style Customization LoRA Style-Content Disentanglement

Dance-to-Music Generation with Encoder-based Textual Inversion

Sifei Li, Weiming Dong, Yuxin Zhang, Fan Tang, Chongyang Ma, Oliver Deussen, Tong-Yee Lee, Changsheng Xu

Conference SIGGRAPH Asia 2024 Dance-to-Music Textual Inversion Diffusion Model Text-to-Music Rhythm

DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions

Sammy Christen, Shreyas Hampali, Fadime Sener, Edoardo Remelli, Tomas Hodan, Eric Sauser, Shugao Ma, Bugra Tekin

Conference SIGGRAPH Asia 2024 Hand Object Interaction Diffusion Model Motion Generation Text Driven Dexterous Manipulation

DiffUHaul: A Training-Free Method for Object Dragging in Images

Omri Avrahami, Rinon Gal, Gal Chechik, Ohad Fried, Dani Lischinski, Arash Vahdat, Weili Nie

Conference SIGGRAPH Asia 2024 Object Dragging Image Editing Diffusion Model Training-Free

FürElise: Capturing and Physically Synthesizing Hand Motion of Piano Performance

Ruocheng Wang, Pei Xu, Haochen Shi, Elizabeth Schumann, C. Karen Liu

Conference SIGGRAPH Asia 2024 Hand Animation Physical Simulation Reinforcement Learning Diffusion Model Motion Capture Dataset Dexterous Manipulation

FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Images

Cheng Zhang, Yuanhao Wang, Francisco Vicente Carrasco, Chenglei Wu, Jinlong Yang, Thabo Beeler, Fernando De la Torre

Conference SIGGRAPH Asia 2024 Texture Transfer Diffusion Model 3D Garments PBR Material Synthetic Data

Fashion-VDM: Video Diffusion Model for Virtual Try-On

Johanna Suvi Karras, Yingwei Li, Nan Liu, Luyang Zhu, Innfarn Yoo, Andreas Lugmayr, Chris Lee, Ira Kemelmacher-Shlizerman

Conference SIGGRAPH Asia 2024 Virtual Try on Video Synthesis Diffusion Model Video Diffusion

Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation

Yue Ma, Hongyu Liu, Hongfa Wang, Heng Pan, Yingqing He, Junkun Yuan, Ailing Zeng, Chengfei Cai, Heung-Yeung Shum, Wei Liu, Qifeng Chen

Conference SIGGRAPH Asia 2024 Portrait Animation Diffusion Model Facial Expression Landmark Video Generation

FragmentDiff: A Diffusion Model for Fractured Object Assembly

Qun-Ce Xu, Hao-Xiang Chen, Jiacheng Hua, Xiaohua Zhan, Yong-Liang Yang, Tai-Jiang Mu

Conference SIGGRAPH Asia 2024 Fractured Object Assembly Diffusion Model Transformer 6-DoF Pose 3D Shape Reassembly

Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane

Han Yan, Yang Li, Zhennan Wu, Shenzhou Chen, Weixuan Sun, Taizhang Shang, Weizhe Liu, Tian Chen, Xiaqiang Dai, Chao Ma, Hongdong Li, Pan Ji

Conference SIGGRAPH Asia 2024 3D Scene Generation Semantic Composition Diffusion Model Tri Plane SDF

Generative Portrait Shadow Removal

Jae Shin Yoon, Zhixin Shu, Mengwei Ren, Cecilia Zhang, Yannick Hold-Geoffroy, Krishna Kumar Singh, He Zhang

Journal SIGGRAPH Asia 2024 Portrait Shadow Removal Diffusion Model Illumination Harmonization Generative Enhancement Compositional Training

HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution

Hua Li, Zhouhui Lian

Journal SIGGRAPH Asia 2024 Font Generation Few Shot Learning Diffusion Model Style Transfer Image Synthesis

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

Wenqi Ouyang, Yi Dong, Lei Yang, Jianlou Si, Xingang Pan

Conference SIGGRAPH Asia 2024 Video Editing Image-to-Video Diffusion Model Attention Matching LoRA

InstantDrag: Improving Interactivity in Drag-based Image Editing

Joonghyuk Shin, Daehyeon Choi, Jaesik Park

Conference SIGGRAPH Asia 2024 Drag-based Editing Image Editing Diffusion Model Optical Flow GAN

Inverse Painting: Reconstructing The Painting Process

Bowei Chen, Yifan Wang, Brian Curless, Ira Kemelmacher-Shlizerman, Steven M. Seitz

Conference SIGGRAPH Asia 2024 Diffusion Model Painting Process Autoregressive Generation Time Lapse Video

Lumiere: A Space-Time Diffusion Model for Video Generation

Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Guanghui Liu, Amit Raj, Yuanzhen Li, Michael Rubinstein, Tomer Michaeli, Oliver Wang, Deqing Sun, Tali Dekel, Inbar Mosseri

Conference SIGGRAPH Asia 2024 Text-to-Video Diffusion Model Video Generation Space Time Unet Image-to-Video

MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generation

Kuan-Chieh Wang, Daniil Ostashev, Yuwei Fang, Sergey Tulyakov, Kfir Aberman

Conference SIGGRAPH Asia 2024 Personalization Text-to-Image Generation Diffusion Model Mixture of Experts Attention

MotionFix: Text-Driven 3D Human Motion Editing

Nikos Athanasiou, Alpár Cseke, Markos Diomataris, Michael J. Black, Gül Varol

Conference SIGGRAPH Asia 2024 Motion Editing Text-Driven Generation Diffusion Model Human Motion Dataset

MV2MV: Multi-View Image Translation via View-Consistent Diffusion Models

Youcheng Cai, Runshi Li, Ligang Liu

Journal SIGGRAPH Asia 2024 Diffusion Model Multi View Image Translation View Consistency 3D Gaussian Splatting

PALP: Prompt Aligned Personalization of Text-to-Image Models

Moab Arar, Andrey Voynov, Amir Hertz, Omri Avrahami, Shlomi Fruchter, Yael Pritch, Daniel Cohen-Or, Ariel Shamir

Conference SIGGRAPH Asia 2024 Text-to-Image Personalization Diffusion Model Score Distillation Prompt Alignment

PDP: Physics-Based Character Animation via Diffusion Policy

Takara Everest Truong, Michael Piseno, Zhaoming Xie, C. Karen Liu

Conference SIGGRAPH Asia 2024 Character Animation Reinforcement Learning Diffusion Model Behavior Cloning Motion Tracking

ProcessPainter: Learning to draw from sequence data

Yiren Song, Shijie Huang, Chen Yao, Hai Ci, Xiaojun Ye, Jiaming Liu, Yuxuan Zhang, Mike Zheng Shou

Conference SIGGRAPH Asia 2024 Diffusion Model Painting Process Video Generation LoRA

ReVersion: Diffusion-Based Relation Inversion from Images

Ziqi Huang, Tianxing Wu, Yuming Jiang, Kelvin C. K. Chan, Ziwei Liu

Conference SIGGRAPH Asia 2024 Diffusion Model Text-to-Image Generation Inversion Relation Modeling Contrastive Learning

Robot Motion Diffusion Model: Motion Generation for Robotic Characters

Agon Serifi, Ruben Grandia, Espen Knoop, Markus Gross, Moritz Bächer

Conference SIGGRAPH Asia 2024 Motion Generation Diffusion Model Physics-Based Control Reinforcement Learning Humanoid Robot

SD-πXL: Generating Low-Resolution Quantized Imagery via Score Distillation

Alexandre Binninger, Olga Sorkine-Hornung

Conference SIGGRAPH Asia 2024 Pixel Art Score Distillation Diffusion Model Image Quantization Fabrication

SGEdit: Bridging LLM with Text2Image Generative Model for Scene Graph-based Image Editing

Zhiyuan Zhang, Dongdong Chen, Jing Liao

Journal SIGGRAPH Asia 2024 Image Editing Scene Graph Diffusion Model Large Language Model Attention Modulation

SIGGesture: Generalized Co-Speech Gesture Synthesis via Semantic Injection with Large-Scale Pre-Training Diffusion Models

Qingrong Cheng, Xu Li, Xinghui Fu, Fei Xia, Zhongqian Sun

Conference SIGGRAPH Asia 2024 co-speech-gesture diffusion-model large-language-model motion-synthesis semantic-injection pre-training