MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning

Fuxiao Liu, Xiaoyang Wang, Wenlin Yao, Jianshu Chen, Kaiqiang Song, Sangwoo Cho, Yaser Yacoob, Dong Yu

Type: Preprint

Publication Date: 2023-01-01

Citations: 2

DOI: https://doi.org/10.48550/arxiv.2311.10774

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning	2024	Fanqing Meng Wenqi Shao Quanfeng Lu Peng Gao Kaipeng Zhang Yu Qiao Ping Luo
+ PDF Chat	On Pre-training of Multimodal Language Models Customized for Chart Understanding	2024	Wan-Cyuan Fan Yen-Chun Chen Mengchen Liu Lu Yuan Leonid Sigal
+	ChartBench: A Benchmark for Complex Visual Reasoning in Charts	2023	Zhengzhuo Xu Sinan Du Yiyan Qi Chengjin Xu Chun Yuan Jian Guo
+	ChartLlama: A Multimodal LLM for Chart Understanding and Generation	2023	Yucheng Han Chengqi Zhang Xin Chen Xu Yang Zhibin Wang Gang Yu Bin Fu Hanwang Zhang
+ PDF Chat	MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems	2024	Zifeng Zhu Mengzhao Jia Zhihan Zhang Lang Li Meng Jiang
+ PDF Chat	TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning	2024	Liang Zhang Anwen Hu Haiyang Xu Ming Yan Yichen Xu Qin Jin Ji Zhang Fei Huang
+ PDF Chat	Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs	2024	Victor Cărbune Hassan Mansoor Fangyu Liu Rahul Aralikatte Gilles Baechler Jindong Chen Abhanshu Sharma
+ PDF Chat	ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning	2024	Ahmed Masry Mehrad Shahmohammadi Md Rizwan Parvez Enamul Hoque Shafiq Joty
+ PDF Chat	Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning	2024	Xingchen Zeng Haichuan Lin Yilin Ye Wei Zeng
+ PDF Chat	ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning	2024	Renqiu Xia Bo Zhang Hancheng Ye Xiangchao Yan Qi Liu Hongbin Zhou Zijun Chen Min Dou Botian Shi Junchi Yan
+ PDF Chat	Transformers Utilization in Chart Understanding: A Review of Recent Advances & Future Trends	2024	Mirna Al-Shetairy Hanan Hindy Dina Khattab Mostafa Aref
+ PDF Chat	SynChart: Synthesizing Charts from Language Models	2024	Mengchen Liu Qixiu Li Dongdong Chen Dong Chen Jianmin Bao Yunsheng Li
+	SVIT: Scaling up Visual Instruction Tuning	2023	Bo Zhao Boya Wu Tiejun Huang
+ PDF Chat	Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMs	2024	Mohammed Saidul Islam Raian Rahman Ahmed Masry Md Tahmid Rahman Laskar Mir Tafseer Nayeem Enamul Hoque
+	Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairs	2023	Mingyang Zhou Yi Fung Long Chen Christopher E. Thomas Heng Ji Shih‐Fu Chang
+ PDF Chat	ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding	2025	Xingyu Fu Min‐Qian Liu Zhengyuan Yang John Corring Yijuan Lu Jianwei Yang Dan Roth Dinei Florêncio Cha Zhang
+ PDF Chat	EvoChart: A Benchmark and a Self-Training Approach Towards Real-World Chart Understanding	2024	Muye Huang Han Lai Xinyu Zhang Wenjun Wu Jie Ma Lingling Zhang Jun Liu
+	ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules	2023	Zhi-Qi Cheng Qi Dai Siyao Li Jingdong Sun Teruko Mitamura Alexander G. Hauptmann
+ PDF Chat	MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation	2025	Siddharth Joshi Besmira Nushi Vidhisha Balachandran Varun Chandrasekaran Vibhav Vineet Neel Joshi Baharan Mirzasoleiman
+ PDF Chat	mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning	2024	Jingxuan Wei Nan Xu Guiyong Chang Yin Luo Bihui Yu Ruifeng Guo

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors