Neural & Generative

50 papers 34 Conference 16 Journal

360-degree Human Video Generation with 4D Diffusion Transformer

Ruizhi Shao, Youxin Pang, Zerong Zheng, Jingxiang Sun, Yebin Liu

Journal SIGGRAPH Asia 2024 Human Video Generation Diffusion Transformer 4D Generation Multi View Consistency SMPL

BlobGEN-3D: Compositional 3D-Consistent Freeview Image Generation with 3D Blobs

Chao Liu, Weili Nie, Sifei Liu, Abhishek Badki, Hang Su, Morteza Mardani, Benjamin Eckart, Arash Vahdat

Conference SIGGRAPH Asia 2024 Diffusion Model Compositional Generation 3D Consistent Generation Novel View Synthesis

Boosting 3D Object Generation through PBR Materials

Yitong Wang, Xudong Xu, Li Ma, Haoran Wang, Bo Dai

Conference SIGGRAPH Asia 2024 PBR Materials Image-to-3D Stable Diffusion Albedo Estimation Normal Refinement Relighting

Camera Settings as Tokens: Modeling Photography on Latent Diffusion Models

I-Sheng Fang, Yue-Hua Han, Jun-Cheng Chen

Conference SIGGRAPH Asia 2024 Latent Diffusion Models Controllable Generation Camera Settings LoRA Computational Photography

Compositional Neural Textures

Peihan Tu, Li-Yi Wei, Matthias Zwicker

Conference SIGGRAPH Asia 2024 Texture Editing Compositional Representation Unsupervised Learning 3D Gaussian Splatting Autoencoder

Consolidating Attention Features for Multi-view Image Editing

Or Patashnik, Rinon Gal, Daniel Cohen-Or, Jun-Yan Zhu, Fernando De la Torre

Conference SIGGRAPH Asia 2024 Multi View Editing Diffusion Model Self Attention Neural Radiance Fields Geometric Editing

Content-aware Tile Generation using Exterior Boundary Inpainting

Sam Sartor, Pieter Peers

Journal SIGGRAPH Asia 2024 Wang Tiles Diffusion Model Inpainting Texture Synthesis Tileable Textures

Customizing Text-to-Image Diffusion with Object Viewpoint Control

Nupur Kumari, Grace Su, Richard Zhang, Taesung Park, Eli Shechtman, Jun-Yan Zhu

Conference SIGGRAPH Asia 2024 Diffusion Model Model Customization Viewpoint Control NeRF Text-to-Image

Customizing Text-to-Image Models with a Single Image Pair

Maxwell Jones, Sheng-Yu Wang, Nupur Kumari, David Bau, Jun-Yan Zhu

Conference SIGGRAPH Asia 2024 Text-to-Image Diffusion Model Style Customization LoRA Style-Content Disentanglement

Dance-to-Music Generation with Encoder-based Textual Inversion

Sifei Li, Weiming Dong, Yuxin Zhang, Fan Tang, Chongyang Ma, Oliver Deussen, Tong-Yee Lee, Changsheng Xu

Conference SIGGRAPH Asia 2024 Dance-to-Music Textual Inversion Diffusion Model Text-to-Music Rhythm

DIScene: Object Decoupling and Interaction Modeling for Complex Scene Generation

Xiao-Lei Li, Haodong Li, Hao-Xiang Chen, Tai-Jiang Mu, Shi-Min Hu

Conference SIGGRAPH Asia 2024 3D Scene Generation Scene Graph Text-to-3D 3D Gaussian Splatting Object Interaction

DreamUDF: Generating Unsigned Distance Fields from A Single Image

Yu-Tao Liu, Xuan Gao, Weikai Chen, Jie Yang, Xiaoxu Meng, Bo Yang, Lin Gao

Journal SIGGRAPH Asia 2024 Unsigned Distance Field Single Image 3D Diffusion Prior 3D Generation Open Surface

FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Images

Cheng Zhang, Yuanhao Wang, Francisco Vicente Carrasco, Chenglei Wu, Jinlong Yang, Thabo Beeler, Fernando De la Torre

Conference SIGGRAPH Asia 2024 Texture Transfer Diffusion Model 3D Garments PBR Material Synthetic Data

Fashion-VDM: Video Diffusion Model for Virtual Try-On

Johanna Suvi Karras, Yingwei Li, Nan Liu, Luyang Zhu, Innfarn Yoo, Andreas Lugmayr, Chris Lee, Ira Kemelmacher-Shlizerman

Conference SIGGRAPH Asia 2024 Virtual Try on Video Synthesis Diffusion Model Video Diffusion

Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation

Axel Sauer, Frederic Boesel, Tim Dockhorn, Andreas Blattmann, Patrick Esser, Robin Rombach

Conference SIGGRAPH Asia 2024 Diffusion Distillation Adversarial Training Text-to-Image Few Step Sampling Latent Space

Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane

Han Yan, Yang Li, Zhennan Wu, Shenzhou Chen, Weixuan Sun, Taizhang Shang, Weizhe Liu, Tian Chen, Xiaqiang Dai, Chao Ma, Hongdong Li, Pan Ji

Conference SIGGRAPH Asia 2024 3D Scene Generation Semantic Composition Diffusion Model Tri Plane SDF

Generative Portrait Shadow Removal

Jae Shin Yoon, Zhixin Shu, Mengwei Ren, Cecilia Zhang, Yannick Hold-Geoffroy, Krishna Kumar Singh, He Zhang

Journal SIGGRAPH Asia 2024 Portrait Shadow Removal Diffusion Model Illumination Harmonization Generative Enhancement Compositional Training

GGHead: Fast and Generalizable 3D Gaussian Heads

Tobias Kirschstein, Simon Giebenhain, Jiapeng Tang, Markos Georgopoulos, Matthias Nießner

Conference SIGGRAPH Asia 2024 3D GAN 3D Gaussian Splatting 3D Head Prior Generative Model UV Parameterization

HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution

Hua Li, Zhouhui Lian

Journal SIGGRAPH Asia 2024 Font Generation Few Shot Learning Diffusion Model Style Transfer Image Synthesis

HyperGAN-CLIP: A Unified Framework for Domain Adaptation, Image Synthesis and Manipulation

Abdul Basit Anees, Ahmet Canberk Baykal, Muhammed Burak Kizil, Duygu Ceylan, Erkut Erdem, Aykut Erdem

Conference SIGGRAPH Asia 2024 GAN StyleGAN CLIP Hypernetwork Domain Adaptation Image Synthesis Image Manipulation

InstanceTex: Instance-level Controllable Texture Synthesis for 3D Scenes via Diffusion Priors

Mingxin Yang, Jianwei Guo, Yuzhi Chen, Lan Chen, Pu Li, Zhanglin Cheng, Xiaopeng Zhang, Hui Huang

Conference SIGGRAPH Asia 2024 Texture Synthesis 3D Scene Diffusion Prior Instance Level Control Score Distillation

InstantDrag: Improving Interactivity in Drag-based Image Editing

Joonghyuk Shin, Daehyeon Choi, Jaesik Park

Conference SIGGRAPH Asia 2024 Drag-based Editing Image Editing Diffusion Model Optical Flow GAN

Inverse Painting: Reconstructing The Painting Process

Bowei Chen, Yifan Wang, Brian Curless, Ira Kemelmacher-Shlizerman, Steven M. Seitz

Conference SIGGRAPH Asia 2024 Diffusion Model Painting Process Autoregressive Generation Time Lapse Video

L3DG: Latent 3D Gaussian Diffusion

Barbara Roessle, Norman Müller, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, Angela Dai, Matthias Nießner

Conference SIGGRAPH Asia 2024 3D Gaussian Splatting Latent Diffusion VQ-VAE Generative 3D

LLM-enhanced Scene Graph Learning for Household Rearrangement

Wenhao Li, Zhiyuan Yu, Qijin She, Zhinan Yu, Yuqing Lan, Chenyang Zhu, Ruizhen Hu, Kai Xu

Conference SIGGRAPH Asia 2024 Scene Graph Large Language Model Affordance Household Rearrangement Embodied AI

Lumiere: A Space-Time Diffusion Model for Video Generation

Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Guanghui Liu, Amit Raj, Yuanzhen Li, Michael Rubinstein, Tomer Michaeli, Oliver Wang, Deqing Sun, Tali Dekel, Inbar Mosseri

Conference SIGGRAPH Asia 2024 Text-to-Video Diffusion Model Video Generation Space Time Unet Image-to-Video

LVCD: Reference-based Lineart Video Colorization with Diffusion Models

Zhitong Huang, Mohan Zhang, Jing Liao

Journal SIGGRAPH Asia 2024 Line Art Colorization Video Diffusion Animation Reference Guided Temporal Consistency

MagicClay: Sculpting Meshes With Generative Neural Fields

Amir Barda, Vladimir G. Kim, Noam Aigerman, Amit Haim Bermano, Thibault Groueix

Conference SIGGRAPH Asia 2024 Text-to-3D Generative Modeling Mesh Sculpting SDF Score Distillation Sampling Hybrid Representation

MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generation

Kuan-Chieh Wang, Daniil Ostashev, Yuwei Fang, Sergey Tulyakov, Kfir Aberman

Conference SIGGRAPH Asia 2024 Personalization Text-to-Image Generation Diffusion Model Mixture of Experts Attention

MV2MV: Multi-View Image Translation via View-Consistent Diffusion Models

Youcheng Cai, Runshi Li, Ligang Liu

Journal SIGGRAPH Asia 2024 Diffusion Model Multi View Image Translation View Consistency 3D Gaussian Splatting

Neural Differential Appearance Equations

Chen Liu, Tobias Ritschel

Journal SIGGRAPH Asia 2024 Dynamic Texture Material Appearance Neural ODE SVBRDF Differentiable Rendering Generative Model

PALP: Prompt Aligned Personalization of Text-to-Image Models

Moab Arar, Andrey Voynov, Amir Hertz, Omri Avrahami, Shlomi Fruchter, Yael Pritch, Daniel Cohen-Or, Ariel Shamir

Conference SIGGRAPH Asia 2024 Text-to-Image Personalization Diffusion Model Score Distillation Prompt Alignment

Portrait Video Editing Empowered by Multimodal Generative Priors

Xuan Gao, Haiyao Xiao, Chenglai Zhong, Shimin Hu, Yudong Guo, Juyong Zhang

Conference SIGGRAPH Asia 2024 4D Portrait Reconstruction 3D Gaussian Splatting Video Editing Generative Priors Multimodal

Procedural Material Generation with Reinforcement Learning

Beichen Li, Yiwei Hu, Paul Guerrero, Milos Hasan, Liang Shi, Valentin Deschaintre, Wojciech Matusik

Journal SIGGRAPH Asia 2024 Procedural Material Reinforcement Learning Transformer Material Graph Generative Model

ProcessPainter: Learning to draw from sequence data

Yiren Song, Shijie Huang, Chen Yao, Hai Ci, Xiaojun Ye, Jiaming Liu, Yuxuan Zhang, Mike Zheng Shou

Conference SIGGRAPH Asia 2024 Diffusion Model Painting Process Video Generation LoRA

ReVersion: Diffusion-Based Relation Inversion from Images

Ziqi Huang, Tianxing Wu, Yuming Jiang, Kelvin C. K. Chan, Ziwei Liu

Conference SIGGRAPH Asia 2024 Diffusion Model Text-to-Image Generation Inversion Relation Modeling Contrastive Learning

SD-πXL: Generating Low-Resolution Quantized Imagery via Score Distillation

Alexandre Binninger, Olga Sorkine-Hornung

Conference SIGGRAPH Asia 2024 Pixel Art Score Distillation Diffusion Model Image Quantization Fabrication

SGEdit: Bridging LLM with Text2Image Generative Model for Scene Graph-based Image Editing

Zhiyuan Zhang, Dongdong Chen, Jing Liao

Journal SIGGRAPH Asia 2024 Image Editing Scene Graph Diffusion Model Large Language Model Attention Modulation

Still-Moving: Customized Video Generation without Customized Video Data

Hila Chefer, Shiran Zada, Roni Paiss, Ariel Ephrat, Omer Tov, Michael Rubinstein, Lior Wolf, Tali Dekel, Tomer Michaeli, Inbar Mosseri

Journal SIGGRAPH Asia 2024 Video Generation Customized Generation Diffusion Model Text-to-Video LoRA Personalization

Style-NeRF2NeRF: 3D Style Transfer from Style-Aligned Multi-View Images

Haruo Fujiwara, Yusuke Mukuta, Tatsuya Harada

Conference SIGGRAPH Asia 2024 Neural Radiance Fields Style Transfer Diffusion Model Neural Rendering

StyleCrafter: Taming Artistic Video Diffusion with Reference-Augmented Adapter Learning

Gongye Liu, Menghan Xia, Yong Zhang, Haoxin Chen, Jinbo Xing, Yibo Wang, Xintao Wang, Ying Shan, Yujiu Yang

Journal SIGGRAPH Asia 2024 Diffusion Model Stylized Generation Text-to-Video Style Adapter Content-Style Disentanglement

StyleTex: Style Image-Guided Texture Generation for 3D Models

Zhiyu Xie, Yuqing Zhang, Xiangjun Tang, Yiqian Wu, Dehan Chen, Gongsheng Li, Xiaogang Jin

Journal SIGGRAPH Asia 2024 Texture Generation Style Transfer Diffusion Model Score Distillation 3D Stylization CLIP

TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model

Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Hang Zhou, Shengyi He, Zhiliang Xu, Haocheng Feng, Errui Ding, Jingdong Wang, Hongtao Xie, Youjian Zhao, Ziwei Liu

Conference SIGGRAPH Asia 2024 2D Avatar Reenactment Diffusion Model Video Synthesis Talking Avatar Motion Guidance

TEXGen: a Generative Diffusion Model for Mesh Textures

Xin Yu, Ze Yuan, Yuan-Chen Guo, Ying-Tian Liu, Jianhui Liu, Yangguang Li, Yan-Pei Cao, Ding Liang, Xiaojuan Qi

Journal SIGGRAPH Asia 2024 Texture Generation Diffusion Model UV Mapping 3D Generation Feed-Forward Model

Text-Guided Texturing by Synchronized Multi-View Diffusion

Yuxin Liu, Minshan Xie, Hanyuan Liu, Tien-Tsin Wong

Conference SIGGRAPH Asia 2024 Texture Generation Diffusion Model Multi View Consistency Text-to-Texture Zero-Shot

TextToon: Real-Time Text Toonify Head Avatar from Single Video

Luchuan Song, Lele Chen, Celong Liu, Pinxin Liu, Chenliang Xu

Conference SIGGRAPH Asia 2024 Head Avatar 3D Gaussian Splatting Text-to-Image Stylization Real-Time Rendering

ToonCrafter: Generative Cartoon Interpolation

Jinbo Xing, Hanyuan Liu, Menghan Xia, Yong Zhang, Xintao Wang, Ying Shan, Tien-Tsin Wong

Journal SIGGRAPH Asia 2024 Cartoon Interpolation Video Diffusion Image-to-Video Domain Adaptation Sketch Control

TrailBlazer: Trajectory Control for Diffusion-Based Video Generation

Wan-Duo Kurt Ma, John P. Lewis, W. Bastiaan Kleijn

Conference SIGGRAPH Asia 2024 Text-to-Video Trajectory Control Diffusion Model Attention Editing Training-Free

VidPanos: Generative Panoramic Videos from Casual Panning Videos

Jingwei Ma, Erika Lu, Roni Paiss, Shiran Zada, Aleksander Holynski, Tali Dekel, Brian Curless, Michael Rubinstein, Forrester Cole

Conference SIGGRAPH Asia 2024 Video Panorama Video Completion Spatio-Temporal Extrapolation Generative Video Model Diffusion Model

VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence

Phong Tran, Egor Zakharov, Long-Nhat Ho, Adilbek Karmanov, Ariana Bermudez Venegas, McLean Goldwhite, Aviral Agarwal, Liwen Hu, Anh Tran, Hao Li

Journal SIGGRAPH Asia 2024 Head Reenactment Neural Radiance Fields VR Telepresence Facial Animation One-Shot