Lumiere: A Space-Time Diffusion Model for Video Generation

Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Guanghui Liu, A. Stephan Antony Raj

Type: Article

Publication Date: 2024-12-03

Citations: 4

DOI: https://doi.org/10.1145/3680528.3687614

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Lumiere: A Space-Time Diffusion Model for Video Generation	2024	Omer Bar-Tal Hila Chefer Omer Tov Charles Herrmann Roni Paiss Shiran Zada Ariel Ephrat Junhwa Hur Yuanzhen Li Tomer Michaeli
+	Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution	2023	Shangchen Zhou Peiqing Yang Jianyi Wang Yihang Luo Chen Change Loy
+	ART$\boldsymbol{\cdot}$V: Auto-Regressive Text-to-Video Generation with Diffusion Models	2023	Wenming Weng Ruoyu Feng Yanhui Wang Qi Dai Chunyu Wang Dacheng Yin Zhiyuan Zhao Kai Qiu Jianmin Bao Yuhui Yuan
+	LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models	2023	Yaohui Wang Xinyuan Chen Xin Ma Shangchen Zhou Ziqi Huang Yi Wang Ceyuan Yang Yinan He Jiashuo Yu Peiqing Yang
+	Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models	2023	Weifeng Chen Jie Wu Pan Xie Hefeng Wu Jiashi Li Xin Xia Xuefeng Xiao Liang Lin
+ PDF Chat	VEnhancer: Generative Space-Time Enhancement for Video Generation	2024	Jingwen He Tianfan Xue Dongyang Liu Xinqi Lin Peng Gao Dahua Lin Yu Qiao Wanli Ouyang Ziwei Liu
+ PDF Chat	VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models	2024	Yabo Zhang Yuxiang Wei Xianhui Lin Zheng Hui Peiran Ren Xuansong Xie Xiangyang Ji Wangmeng Zuo
+ PDF Chat	I4VGen: Image as Stepping Stone for Text-to-Video Generation	2024	Xiefan Guo Jinlin Liu Miaomiao Cui Di Huang
+	Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising	2023	Fuyun Wang Wenshuo Chen Guanglu Song Han-Jia Ye Yu Liu Hongsheng Li
+	LAMP: Learn A Motion Pattern for Few-Shot-Based Video Generation	2023	Ruiqi Wu Liangyu Chen Tong Yang Chunle Guo Chongyi Li Xiangyu Zhang
+	ControlVideo: Training-free Controllable Text-to-Video Generation	2023	Yabo Zhang Yuxiang Wei Dongsheng Jiang Xiaopeng Zhang Wangmeng Zuo Qi Tian
+ PDF Chat	Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach	2024	Yaofang Liu Yi Ren Xiaodong Cun Aitor Artola Yang Liu Tieyong Zeng Raymond H. Chan Jean‐Michel Morel
+	Imagen Video: High Definition Video Generation with Diffusion Models	2022	Jonathan Ho William Chan Chitwan Saharia Jay Whang Ruiqi Gao Alexey A. Gritsenko Diederik P. Kingma Ben Poole Mohammad Norouzi David J. Fleet
+	Photorealistic Video Generation with Diffusion Models	2023	Agrim Gupta Lijun Yu Kihyuk Sohn Xiuye Gu Meera Hahn Li Fei-Fei Irfan Essa Lu Jiang José Lezama
+	Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models	2023	Songwei Ge Seungjun Nah Guilin Liu Tyler Poon Andrew Tao Bryan Catanzaro David R. Jacobs Jia‐Bin Huang Ming-Yu Liu Yogesh Balaji
+	Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation	2023	Jie An Songyang Zhang Harry Yang Sonal Gupta Jia‐Bin Huang Jiebo Luo Xi Yin
+	BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models	2023	Fengyuan Shi Jiaxi Gu Hang Xu Songcen Xu Wei Zhang Limin Wang
+	MagicVideo: Efficient Video Generation With Latent Diffusion Models	2022	Daquan Zhou Weimin Wang Hanshu Yan Weiwei Lv Yizhe Zhu Jiashi Feng
+	Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance	2023	Jinbo Xing Menghan Xia Yuxin Liu Yuechen Zhang Yong Zhang Yingqing He Hanyuan Liu Haoxin Chen Xiaodong Cun Xintao Wang
+	Structure and Content-Guided Video Synthesis with Diffusion Models	2023	Patrick Esser Johnathan Chiu Parmida Atighehchian Jonathan Granskog Anastasis Germanidis

Works That Cite This (1)

Action	Title	Year	Authors
+ PDF Chat	Prompt Evolutionary Design Optimization with Generative Shape and Vision-Language models	2024	Melvin Wong Thiago Rios Stefan Menzel Yew-Soon Ong

Works Cited by This (14)

Action	Title	Year	Authors
+ PDF Chat	3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation	2016	Özgün Çiçek Ahmed Abdulkadir Soeren S. Lienkamp Thomas Brox Olaf Ronneberger
+ PDF Chat	The Unreasonable Effectiveness of Deep Features as a Perceptual Metric	2018	Richard Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang
+ PDF Chat	A Closer Look at Spatiotemporal Convolutions for Action Recognition	2018	Du Tran Heng Wang Lorenzo Torresani Jamie Ray Yann LeCun Manohar Paluri
+ PDF Chat	Style Transfer by Relaxed Optimal Transport and Self-Similarity	2019	Nicholas Kolkin Jason Salavon Gregory Shakhnarovich
+ PDF Chat	Effectively Unbiased FID and Inception Score and Where to Find Them	2020	Min Jin Chong David Forsyth
+	Palette: Image-to-Image Diffusion Models	2022	Chitwan Saharia William Chan Huiwen Chang Chris Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi
+ PDF Chat	NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion	2022	Chenfei Wu Jian Liang Lei Ji Fan Yang Yuejian Fang Daxin Jiang Nan Duan
+ PDF Chat	On Aliased Resizing and Surprising Subtleties in GAN Evaluation	2022	Gaurav Parmar Richard Zhang Jun-Yan Zhu
+ PDF Chat	High-Resolution Image Synthesis with Latent Diffusion Models	2022	Robin Rombach Andreas Blattmann Dominik Lorenz Patrick Esser Björn Ommer
+ PDF Chat	Diffusion Models in Vision: A Survey	2023	Florinel-Alin Croitoru Vlad Hondru Radu Tudor Ionescu Mubarak Shah