Guiding Instruction-based Image Editing via Multimodal Large Language Models

Tsu-Jui Fu, Wenze Hu, Xianzhi Du, William Yang Wang, Yinfei Yang, Zhe Gan

Type: Preprint

Publication Date: 2023-01-01

Citations: 2

DOI: https://doi.org/10.48550/arxiv.2309.17102

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models	2023	Yuzhou Huang Liangbin Xie Xintao Wang Ziyang Yuan Xiaodong Cun Yixiao Ge Jiantao Zhou Chao Dong Rui Huang Ruimao Zhang
+ PDF Chat	SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editing	2024	Yuying Ge Sijie Zhao Chen Li Yixiao Ge Ying Shan
+ PDF Chat	InsightEdit: Towards Better Instruction Following for Image Editing	2024	Yuanrong Xu Jie Kong Jiazhi Wang Xiao Pan Bo Lin Qiang Liu
+ PDF Chat	Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era	2024	Thành Tâm Nguyên Zhao Ren Trinh Pham Phi Le Nguyen Hongzhi Yin Quoc Viet Hung Nguyen
+ PDF Chat	Generative Visual Instruction Tuning	2024	Jefferson Hernandez Ruben Villegas Vicente Ordóñez
+ PDF Chat	LoRA of Change: Learning to Generate LoRA for the Editing Instruction from A Single Before-After Image Pair	2024	Song Xue Jiequan Cui Hanwang Zhang Jiaxin Shi Jingjing Chen Chi Zhang Yu‐Gang Jiang
+ PDF Chat	LASER: Tuning-Free LLM-Driven Attention Control for Efficient Text-conditioned Image-to-Animation	2024	Haoyu Zheng Wenqiao Zhang Yaoke Wang Hao Zhou Jiang Liu Juncheng Li Zheqi Lv Siliang Tang Yueting Zhuang
+ PDF Chat	AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea	2024	Qifan Yu Wei Chow Zhongqi Yue Kaihang Pan Yang Wu Xiaoxia Wan Juncheng Li Siliang Tang Hanwang Zhang Yueting Zhuang
+ PDF Chat	MagicQuill: An Intelligent Interactive Image Editing System	2024	Zichen Liu Yue Yu Hao Ouyang Qiuyu Wang Ka Leong Cheng Wen Wang Zhiheng Liu Qifeng Chen Yujun Shen
+ PDF Chat	EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing	2024	Umar Khalid Iqbal Hasan Azib Farooq Nazanin Rahnavard Jing Hua Chen Chen
+ PDF Chat	InstructBrush: Learning Attention-based Instruction Optimization for Image Editing	2024	Ruoyu Zhao Qingnan Fan Fei Kou Shuai Qin Hong Gu Wei Wu Pengcheng Xu Mingrui Zhu Nannan Wang Xinbo Gao
+	ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation	2023	Yasheng Sun Y. F. Yang Houwen Peng Yifei Shen Yuqing Yang Hu Han Lili Qiu Hideki Koike
+	CoIE: Chain-of-Instruct Editing for Multi-Attribute Face Manipulation	2023	Zhenduo Zhang Bowen Zhang Guang Liu
+	MIMIC-IT: Multi-Modal In-Context Instruction Tuning	2023	Bo Li Yuanhan Zhang Liangyu Chen Jinghao Wang Fanyi Pu Jingkang Yang Chunyuan Li Ziwei Liu
+ PDF Chat	DreamOmni: Unified Image Generation and Editing	2024	Bin Xia Yuechen Zhang Jingyao Li Chengyao Wang Yitong Wang Xing‐Long Wu Yu Bei Jiaya Jia
+	InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction Following	2023	Shufan Li Harkanwar Singh Aditya Grover
+ PDF Chat	ClickDiffusion: Harnessing LLMs for Interactive Precise Image Editing	2024	Alec Helbling Seongmin Lee Polo Chau
+ PDF Chat	Lateralization LoRA: Interleaved Instruction Tuning with Modality-Specialized Adaptations	2024	Zhiyang Xu Minqian Liu Ying Shen Joy Rimchala Jiaxin Zhang Qifan Wang Yu Cheng Lifu Huang
+ PDF Chat	TIE: Revolutionizing Text-based Image Editing for Complex-Prompt Following and High-Fidelity Editing	2024	Xinyu Zhang Mengxue Kang Fei Wei Shuang Xu Yuhe Liu Lin Ma
+	LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding	2023	Yanzhe Zhang Ruiyi Zhang Jiuxiang Gu Yufan Zhou Nedim Lipka Diyi Yang Tong Sun

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors