Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization

Yunlong Liang, Fandong Meng, Jinan Xu, Jiaan Wang, Yufeng Chen, Jie Zhou

Type: Article

Publication Date: 2023-01-01

Citations: 13

DOI: https://doi.org/10.18653/v1/2023.acl-long.165

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization	2022	Yunlong Liang Fandong Meng Jinan Xu Jiaan Wang Yufeng Chen Jie Zhou
+	Learning Summary-Worthy Visual Representation for Abstractive Summarization in Video	2023	Zenan Xu Xiaojun Meng Yasheng Wang Qinliang Su Zexuan Qiu Xin Jiang Qun Liu
+	Learning Summary-Worthy Visual Representation for Abstractive Summarization in Video	2023	Zenan Xu Xiaojun Meng Yasheng Wang Qinliang Su Zexuan Qiu Xin Jiang Qun Liu
+ PDF Chat	UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation	2022	Zhengkun Zhang Xiaojun Meng Yasheng Wang Xin Jiang Qun Liu Zhenglu Yang
+	UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation	2021	Zhengkun Zhang Xiaojun Meng Yasheng Wang Xin Jiang Qun Liu Zhenglu Yang
+	ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization	2021	Zijian Zhang Chang Shu Youxin Chen Jing Xiao Qian Zhang Lu Zheng
+	D$^2$TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization	2023	Yunlong Liang Fandong Meng Jiaan Wang Jinan Xu Yufeng Chen Jie Zhou
+ PDF Chat	ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization	2022	Zijian Zhang Chang Shu Youxin Chen Jing Xiao Qian Zhang Lu Zheng
+	CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarization	2023	Min Xiao Junnan Zhu Haitao Lin Yu Zhou Chengqing Zong
+	CFSum Coarse-to-Fine Contribution Network for Multimodal Summarization	2023	Min Xiao Junnan Zhu Haitao Lin Yu Zhou Chengqing Zong
+	See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization	2021	Yash Kumar Atri Shraman Pramanick Vikram Goyal Tanmoy Chakraborty
+	See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization	2021	Yash Kumar Atri Shraman Pramanick Vikram Goyal Tanmoy Chakraborty
+	D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization	2023	Yunlong Liang Fandong Meng Jiaan Wang Jinan Xu Yufeng Chen Jie Zhou
+	Modeling Paragraph-Level Vision-Language Semantic Alignment for Multi-Modal Summarization	2022	Xinnian Liang Chenhao Cui Shuangzhi Wu Jiali Zeng Yufan Jiang Zhoujun Li
+	Abstractive Sentence Summarization with Guidance of Selective Multimodal Reference.	2021	Zijian Zhang Chenxi Zhang Qinpei Zhao Jiangfeng Li
+ PDF Chat	Leveraging Entity Information for Cross-Modality Correlation Learning: The Entity-Guided Multimodal Summarization	2024	Yanghai Zhang Ye Liu Shiwei Wu Kai Zhang Xukai Liu Qi Liu Enhong Chen
+ PDF Chat	Evaluating and Improving Factuality in Multimodal Abstractive Summarization	2022	David Wan Mohit Bansal
+ PDF Chat	Fine-grained and Explainable Factuality Evaluation for Multimodal Summarization	2024	Liqiang Jing Jingxuan Zuo Yue Zhang
+	MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos	2023	Jielin Qiu Jiacheng Zhu William Han Aditesh Kumar Karthik Mittal Claire Jin Zhengyuan Yang Linjie Li Jianfeng Wang Bo Li
+	Evaluating and Improving Factuality in Multimodal Abstractive Summarization	2022	David Wan Mohit Bansal

Works That Cite This (5)

Action	Title	Year	Authors
+	Understanding Translationese in Cross-Lingual Summarization	2023	Jiaan Wang Fandong Meng Yunlong Liang Tingyi Zhang Jiarong Xu Zhixu Li Jie Zhou
+	Towards Unifying Multi-Lingual and Cross-Lingual Summarization	2023	Jiaan Wang Fandong Meng Duo Zheng Yunlong Liang Zhixu Li Jianfeng Qu Jie Zhou
+	Zero-Shot Cross-Lingual Summarization via Large Language Models	2023	Jiaan Wang Yunlong Liang Fandong Meng Beiqi Zou Zhixu Li Jianfeng Qu Jie Zhou
+	D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization	2023	Yunlong Liang Fandong Meng Jiaan Wang Jinan Xu Yufeng Chen Jie Zhou
+ PDF Chat	Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering	2023	Yifan Dong Suhang Wu Fandong Meng Jie Zhou Xiaoli Wang Jianxin Lin Jinsong Su

Works Cited by This (36)

Action	Title	Year	Authors
+ PDF Chat	Effective Approaches to Attention-based Neural Machine Translation	2015	Thang Luong Hieu Pham Christopher D. Manning
+	The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability	1973	Joseph L. Fleiss Jacob Cohen
+ PDF Chat	Get To The Point: Summarization with Pointer-Generator Networks	2017	Abigail See Peter J. Liu Christopher D. Manning
+	A Deep Reinforced Model for Abstractive Summarization	2017	Romain Paulus Caiming Xiong Richard Socher
+	How2: A Large-scale Dataset for Multimodal Language Understanding	2018	Ramon Sanabria Ozan Çağlayan Shruti Palaskar Desmond Elliott Loïc Barrault Lucia Specia Florian Metze
+	Cross-lingual Language Model Pretraining	2019	Guillaume Lample Alexis Conneau
+	Teaching Machines to Read and Comprehend	2015	Karl Moritz Hermann Tomáš Kočiský Edward Grefenstette Lasse Espeholt Will Kay Mustafa Suleyman Phil Blunsom
+	Multimodal Abstractive Summarization for How2 Videos	2019	Shruti Palaskar Jindřich Libovický Spandana Gella Florian Metze
+	Text Summarization with Pretrained Encoders	2019	Yang Liu Mirella Lapata
+	Global Voices: Crossing Borders in Automatic News Summarization	2019	Khanh Nguyen Hal Daumé