Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Information

Weijie Su, Xizhou Zhu, Chenxin Tao, Lewei Lu, Bin Li, Gao Huang, Yu Qiao, Xiaogang Wang, Jie Zhou, Jifeng Dai

Type: Preprint

Publication Date: 2022-01-01

Citations: 2

DOI: https://doi.org/10.48550/arxiv.2211.09807

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Towards All-in-One Pre-Training via Maximizing Multi-Modal Mutual Information	2023	Weijie Su Xizhou Zhu Chenxin Tao Lewei Lu Bin Li Gao Huang Yu Qiao Xiaogang Wang Jie Zhou Jifeng Dai
+ PDF Chat	Channel Exchanging Networks for Multimodal and Multitask Dense Image Prediction	2022	Yikai Wang Fuchun Sun Wenbing Huang Fengxiang He Dacheng Tao
+	Channel Exchanging Networks for Multimodal and Multitask Dense Image Prediction	2021	Yikai Wang Fuchun Sun Wenbing Huang Fengxiang He Dacheng Tao
+ PDF Chat	Composite Learning for Robust and Effective Dense Predictions	2023	Menelaos Kanakis Thomas E. Huang David Brüggemann Fisher Yu Luc Van Gool
+	Multi-dataset Pretraining: A Unified Model for Semantic Segmentation	2021	Bowen Shi Xiaopeng Zhang Haohang Xu Wenrui Dai Junni Zou Hongkai Xiong Qi Tian
+ PDF Chat	Multi-dataset Pretraining: A Unified Model for Semantic Segmentation	2021	Bowen Shi Xiaopeng Zhang Haohang Xu Wenrui Dai Junni Zou Hongkai Xiong Qi Tian
+	Vision Transformer Adapter for Dense Predictions	2022	Zhe Chen Yuchen Duan Wenhai Wang Junjun He Tong Lu Jifeng Dai Yu Qiao
+	Data exploitation: multi-task learning of object detection and semantic segmentation on partially annotated data	2023	Hoàng-Ân Lê Minh‐Tan Pham
+ PDF Chat	Dense Contrastive Learning for Self-Supervised Visual Pre-Training	2020	Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li
+	Dense Contrastive Learning for Self-Supervised Visual Pre-Training	2020	Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li
+ PDF Chat	Dense Contrastive Learning for Self-Supervised Visual Pre-Training	2021	Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li
+	Residual Mixture of Experts	2022	Lemeng Wu Mengchen Liu Yinpeng Chen Dongdong Chen Xiyang Dai Lu Yuan
+	UniVIP: A Unified Framework for Self-Supervised Visual Pre-training	2022	Zhaowen Li Yousong Zhu Fan Yang Wei Li Chaoyang Zhao Yingying Chen Ziyang Chen Jiahao Xie Liwei Wu Rui Zhao
+	Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detection	2023	Aixuan Li Yuxin Mao Jing Zhang Yuchao Dai
+ PDF Chat	MMDRFuse: Distilled Mini-Model with Dynamic Refresh for Multi-Modality Image Fusion	2024	Yanglin Deng Tianyang Xu Chunyang Cheng Xiao‐Jun Wu Josef Kittler
+ PDF Chat	UniVIP: A Unified Framework for Self-Supervised Visual Pre-training	2022	Zhaowen Li Yousong Zhu Fan Yang Wei Li Chaoyang Zhao Yingying Chen Ziyang Chen Jiahao Xie Liwei Wu Rui Zhao
+	When CNN Meet with ViT: Towards Semi-Supervised Learning for Multi-Class Medical Image Semantic Segmentation	2022	Ziyang Wang Tianze Li Jian-Qing Zheng Baoru Huang
+ PDF Chat	Dealing with All-stage Missing Modality: Towards A Universal Model with Robust Reconstruction and Personalization	2024	Yunpeng Zhao Cheng Chen Q. Pang Quanzheng Li Carol Tang Beng-Ti Ang Yueming Jin
+	Improving Fine-tuning of Self-supervised Models with Contrastive Initialization	2022	Haolin Pan Yong Guo Qinyi Deng Haomin Yang Yiqun Chen Jian Chen
+ PDF Chat	TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Network	2024	Yuchan Jie Yushen Xu Xiaosong Li Haishu Tan

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors