Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases.

Christopher Clark, Mark Yatskar, Luke Zettlemoyer

Type: Preprint

Publication Date: 2019-09-09

Citations: 32

Locations

arXiv (Cornell University) - View

Similar Works

Action	Title	Year	Authors
+	Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases	2019	Christopher M. Clark Mark Yatskar Luke Zettlemoyer
+	Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles	2020	Christopher M. Clark Mark Yatskar Luke Zettlemoyer
+	Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles	2020	Christopher Clark Mark Yatskar Luke Zettlemoyer
+	Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles	2020	Christopher Clark Mark Yatskar Luke Zettlemoyer
+ PDF Chat	Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects	2019	Gabriel Grand Yonatan Belinkov
+	Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects	2019	Gabriel Grand Yonatan Belinkov
+	Generalized but not Robust? Comparing the Effects of Data Modification Methods on Out-of-Domain Generalization and Adversarial Robustness	2022	Tejas Gokhale Swaroop Mishra Man Luo Bhavdeep Sachdeva Chitta Baral
+ PDF Chat	Generalized but not Robust? Comparing the Effects of Data Modification Methods on Out-of-Domain Generalization and Adversarial Robustness	2022	Tejas Gokhale Swaroop Mishra Man Luo Bhavdeep Sachdeva Chitta Baral
+ PDF Chat	Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models	2021	Linjie Li Jie Lei Zhe Gan Jingjing Liu
+	Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models	2021	Linjie Li Jie Lei Zhe Gan Jingjing Liu
+ PDF Chat	Generative Bias for Robust Visual Question Answering	2023	Jae Won Cho Dong-Jin Kim Hyeonggon Ryu In So Kweon
+	Generative Bias for Robust Visual Question Answering	2022	Jae Won Cho Dong-Jin Kim Hyeonggon Ryu In So Kweon
+	Overcoming Language Priors in Visual Question Answering with Adversarial Regularization	2018	Sainandan Ramakrishnan Aishwarya Agrawal Stefan Lee
+	Overcoming Language Priors in Visual Question Answering with Adversarial Regularization	2018	Sainandan Ramakrishnan Aishwarya Agrawal Stefan Lee
+	Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond	2023	Zhecan Wang Long Chen Haoxuan You Keyang Xu Yicheng He Wenhao Li Noal Codella Kai-Wei Chang Shih-Fu Chang
+	Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond	2023	Zhecan Wang Long Chen Haoxuan You Keyang Xu Yicheng He Wenhao Li Noel Codella Kai-Wei Chang Shih-Fu Chang
+	Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning	2022	Qingyi Si Yuanxin Liu Fandong Meng Zheng Lin Peng Fu Yanan Cao Weiping Wang Jie Zhou
+	Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning	2022	Qingyi Si Yuanxin Liu Fandong Meng Zheng Lin Peng Fu Yanan Cao Weiping Wang Jie Zhou
+	Improving Visual Question Answering Models through Robustness Analysis and In-Context Learning with a Chain of Basic Questions	2023	Jia-Hong Huang Modar Alfadly Bernard Ghanem Marcel Worring
+ PDF Chat	Counterfactual Samples Synthesizing for Robust Visual Question Answering	2020	Long Chen Xin Yan Jun Xiao Hanwang Zhang Shiliang Pu Yueting Zhuang

Works That Cite This (31)

Action	Title	Year	Authors
+ PDF Chat	Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization	2022	Damien Teney Ehsan Abbasnejad Simon Lucey Anton van den Hengel
+ PDF Chat	Ensemble learning-based approach for improving generalization capability of machine reading comprehension systems	2021	Razieh Baradaran Hossein Amirkhani
+	Learning from others' mistakes: Avoiding dataset biases without modeling them	2020	Victor Sanh Thomas Wolf Yonatan Belinkov Alexander M. Rush
+	Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation	2019	Emily Dinan Angela Fan Adina Williams Jack Urbanek Douwe Kiela Jason Weston
+	DQI: A Guide to Benchmark Evaluation	2020	Swaroop Mishra Anjana Arunkumar Bhavdeep Sachdeva Chris Bryan Chitta Baral
+	Our Evaluation Metric Needs an Update to Encourage Generalization.	2020	Swaroop Mishra Anjana Arunkumar Chris Bryan Chitta Baral
+	Learning content and context with language bias for Visual Question Answering	2020	Chao Yang Feng Su Dongsheng Li Huawei Shen Guoqing Wang Bin Jiang
+ PDF Chat	CrossAug	2021	Min-Woo Lee Seungpil Won Juae Kim Hwanhee Lee Cheoneum Park Kyomin Jung
+	Jigsaw-VAE: Towards Balancing Features in Variational Autoencoders	2020	Saeid Asgari Taghanaki Mohammad Havaei Alex Lamb Aditya Sanghi Ara Danielyan Tonya Custis
+	Toward Learning Human-aligned Cross-domain Robust Models by Countering Misaligned Features	2021	Haohan Wang Zeyi Huang Hanlin Zhang Eric P. Xing

Works Cited by This (47)

Action	Title	Year	Authors
+	A large annotated corpus for learning natural language inference	2015	Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning
+ PDF Chat	VQA: Visual Question Answering	2015	Stanislaw Antol Aishwarya Agrawal Jiasen Lu Margaret Mitchell Dhruv Batra C. Lawrence Zitnick Devi Parikh
+ PDF Chat	Revisiting Visual Question Answering Baselines	2016	Allan Jabri Armand Joulin Laurens van der Maaten
+	Bidirectional Attention Flow for Machine Comprehension	2016	Min Joon Seo Aniruddha Kembhavi Ali Farhadi Hannaneh Hajishirzi
+ PDF Chat	Enhanced LSTM for Natural Language Inference	2017	Qian Chen Xiaodan Zhu Zhen-Hua Ling Si Wei Hui Jiang Diana Inkpen
+ PDF Chat	Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering	2018	Peter Anderson Xiaodong He Chris Buehler Damien Teney Mark Johnson Stephen Jay Gould Lei Zhang
+	Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge	2018	Peter E. Clark Isaac Cowhey Oren Etzioni Tushar Khot Ashish Sabharwal Carissa Schoenick Oyvind Tafjord
+	Women also Snowboard: Overcoming Bias in Captioning Models	2018	Kaylee Burns Lisa Anne Hendricks Kate Saenko Trevor Darrell Anna Rohrbach
+	Breaking NLI Systems with Sentences that Require Simple Lexical Inferences	2018	Max Glockner Vered Shwartz Yoav Goldberg
+ PDF Chat	QuAC: Question Answering in Context	2018	Eunsol Choi He He Mohit Iyyer Mark Yatskar Wen-tau Yih Yejin Choi Percy Liang Luke Zettlemoyer