Improving Question Answering by Commonsense-Based Pre-training

Wanjun Zhong, Duyu Tang, Nan Duan, Ming Zhou, Jiahai Wang, Jian Yin

Type: Book-Chapter

Publication Date: 2019-01-01

Citations: 58

DOI: https://doi.org/10.1007/978-3-030-32233-5_2

View Chat PDF

Locations

Lecture notes in computer science - View
arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Exploring ways to incorporate additional knowledge to improve Natural Language Commonsense Question Answering	2019	Arindam Mitra Pratyay Banerjee Kuntal Kumar Pal Swaroop Mishra Chitta Baral
+ PDF Chat	elBERto: Self-supervised commonsense learning for question answering	2022	Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin
+ PDF Chat	Enhancing Question Answering on Charts Through Effective Pre-training Tasks	2024	Ashim Gupta Vivek Gupta Shuo Zhang Yujie He Ning Zhang Shalin Shah
+ PDF Chat	Towards Better Generalization in Open-Domain Question Answering by Mitigating Context Memorization	2024	Zixuan Zhang Revanth Gangi Reddy Kevin Small Tong Zhang Heng Ji
+	Knowledge-driven Self-supervision for Zero-shot Commonsense Question Answering.	2020	Kaixin Ma Filip Ilievski Jonathan Francis Yonatan Bisk Eric Nyberg Alessandro Oltramari
+	Improving Question Answering by Commonsense-Based Pre-Training	2018	Wanjun Zhong Duyu Tang Nan Duan Ming Zhou Jiahai Wang Jian Yin
+ PDF Chat	Improving question answering performance using knowledge distillation and active learning	2023	Yasaman Boreshban Seyed Morteza Mirbostani Gholamreza Ghassem-Sani Seyed Abolghasem Mirroshandel Shahin Amiriparian
+ PDF Chat	Enhancing Question Generation with Commonsense Knowledge	2021	Xin Jia Hao Wang Dawei Yin Yunfang Wu
+	Frustratingly Easy Natural Question Answering	2019	Lin Pan Rishav Chakravarti Anthony Ferritto Michael Glaß Alfio Gliozzo Salim Roukos Radu Florian Avirup Sil
+	QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension	2021	Anna Rogers Matt Gardner Isabelle Augenstein
+	Elaboration-Generating Commonsense Question Answering at Scale	2023	Wenya Wang Vivek Srikumar Hannaneh Hajishirzi Noah A. Smith
+	Incorporating External Knowledge into Machine Reading for Generative Question Answering	2019	Bin Bi Chen Wu Ming Yan Wei Wang Jiangnan Xia Chenliang Li
+	Fine-Tuning and Aligning Question Answering Models for Complex Information Extraction Tasks	2023	Matthias Engelbach Dennis Klau Felix Scheerer Jens Drawehn Maximilien Kintz
+	Elaboration-Generating Commonsense Question Answering at Scale	2022	Wenya Wang Vivek Srikumar Hanna Hajishirzi Noah A. Smith
+ PDF Chat	Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation	2021	Ning Bian Xianpei Han Bo Chen Le Sun
+	A Lightweight Method to Generate Unanswerable Questions in English	2023	Vagrant Gautam Miaoran Zhang Dietrich Klakow
+	Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation	2021	Ning Bian Xianpei Han Bo Chen Le Sun
+	A Lightweight Method to Generate Unanswerable Questions in English	2023	Vagrant Gautam Miaoran Zhang Dietrich Klakow
+	Teaching Smaller Language Models To Generalise To Unseen Compositional Questions	2023	Tim Hartill Neşet Tan Michael Witbrock Patricia Riddle
+ PDF Chat	Question Translation Training for Better Multilingual Reasoning	2024	Wenhao Zhu Shujian Huang Fei Yuan Shuaijie She Jiajun Chen Alexandra Birch

Cited by (26)

Action	Title	Year	Authors
+	KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning	2019	Bill Yuchen Lin Xinyue Chen Jamin Chen Xiang Ren
+	Pre-training LLMs using human-like development data corpus	2023	Khushi Bhardwaj Raj Sanjay Shah Sashank Varma
+	Incorporating External Knowledge into Machine Reading for Generative Question Answering	2019	Bin Bi Chen Wu Ming Yan Wei Wang Jiangnan Xia Chenliang Li
+	Improving Question Answering with External Knowledge	2019	Xiaoman Pan Kai Sun Dian Yu Jianshu Chen Heng Ji Claire Cardie Dong Yu
+	Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering	2019	Kaixin Ma Jonathan Francis Quanyang Lu Eric Nyberg Alessandro Oltramari
+	ECNU-SenseMaker at SemEval-2020 Task 4: Leveraging Heterogeneous Knowledge Resources for Commonsense Validation and Explanation	2020	Qian Zhao Siyu Tao Jie Zhou Linlin Wang Xin Lin Liang He
+	ECNU-SenseMaker at SemEval-2020 Task 4: Leveraging Heterogeneous Knowledge Resources for Commonsense Validation and Explanation	2020	Qian Zhao Siyu Tao Jie Zhou Linlin Wang Xin Lin Liang He
+ PDF Chat	REM-Net: Recursive Erasure Memory Network for Commonsense Evidence Refinement	2021	Yinya Huang Meng Fang Xunlin Zhan Qingxing Cao Xiaodan Liang
+	Beyond Language: Learning Commonsense from Images for Reasoning	2020	Wanqing Cui Yanyan Lan Liang Pang Jiafeng Guo Xueqi Cheng
+	ERNIE: Enhanced Language Representation with Informative Entities	2019	Zhengyan Zhang Xu Han Zhiyuan Liu Xin Jiang Maosong Sun Qun Liu
+	Explain Yourself! Leveraging Language Models for Commonsense Reasoning	2019	Nazneen Fatema Rajani Bryan McCann Caiming Xiong Richard Socher
+ PDF Chat	Generated Knowledge Prompting for Commonsense Reasoning	2022	Jiacheng Liu Alisa Liu Ximing Lu Sean Welleck Peter West Ronan Le Bras Yejin Choi Hannaneh Hajishirzi
+ PDF Chat	Question answering with deep neural networks for semi-structured heterogeneous genealogical knowledge graphs	2022	Omri Suissa Maayan Zhitomirsky‐Geffet Avshalom Elmalech
+	Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering	2019	Kaixin Ma Jonathan Francis Quanyang Lu Eric Nyberg Alessandro Oltramari
+	How Commonsense Knowledge Helps with Natural Language Tasks: A Survey of Recent Resources and Methodologies	2021	Yubo Xie Pearl Pu
+ PDF Chat	Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering	2021	Kaixin Ma Filip Ilievski Jonathan Francis Yonatan Bisk Eric Nyberg Alessandro Oltramari
+ PDF Chat	VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge	2023	Sahithya Ravi Aditya Chinchure Leonid Sigal Renjie Liao Vered Shwartz
+	ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoning	2020	Michael Boratko Xiang Li Tim O’Gorman Rajarshi Das Dan Le Andrew McCallum
+	ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoning	2020	Michael Boratko Xiang Lorraine Li Rajarshi Das Tim O’Gorman Dan Le Andrew McCallum
+	KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning	2019	Bill Yuchen Lin Xinyue Chen Jamin Chen Xiang Ren
+	Understanding in Artificial Intelligence.	2021	Stefan Maetschke David Martínez Pieter Barnard Elaheh ShafieiBavani Peter Zhong Ying Xu Antonio Jimeno Yepes
+	Conversational Question Answering: A Survey	2021	Munazza Zaib Wei Emma Zhang Quan Z. Sheng Adnan Mahmood Yang Zhang
+	Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims.	2021	Ipek Baris Schlicht Erhan Sezerer Selma Tekır Oul Han Zeyd Boukhers
+	KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation	2019	Xiaozhi Wang Tianyu Gao Zhaocheng Zhu Zhengyan Zhang Zhiyuan Liu Juanzi Li Jian Tang
+ PDF Chat	Chapter 13. Generalizable Neuro-Symbolic Systems for Commonsense Question Answering	2021	Alessandro Oltramari Jonathan Francis Filip Ilievski Kaixin Ma Roshanak Mirzaee
+	Encoding Explanatory Knowledge for Zero-shot Science Question Answering	2021	Zili Zhou Marco Valentino Dónal Landers André Freitas

Citing (12)

Action	Title	Year	Authors
+ PDF Chat	Learning executable semantic parsers for natural language understanding	2016	Percy Liang
+	Key-Value Memory Networks for Directly Reading Documents	2016	Alexander Miller Adam Fisch Jesse Dodge Amir-Hossein Karimi Antoine Bordes Jason Weston
+ PDF Chat	RACE: Large-scale ReAding Comprehension Dataset From Examinations	2017	Guokun Lai Qizhe Xie Hanxiao Liu Yiming Yang Eduard Hovy
+ PDF Chat	Leveraging Knowledge Bases in LSTMs for Improving Machine Reading	2017	Bishan Yang Tom M. Mitchell
+	Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge	2018	Peter E. Clark Isaac Cowhey Oren Etzioni Tushar Khot Ashish Sabharwal Carissa Schoenick Oyvind Tafjord
+	Exploring the Limits of Weakly Supervised Pretraining	2018	Dhruv Mahajan Ross Girshick Vignesh Ramanathan Kaiming He Manohar Paluri Yixuan Li Ashwin Bharambe Laurens van der Maaten
+ PDF Chat	Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering	2018	Todor Mihaylov Peter E. Clark Tushar Khot Ashish Sabharwal
+	A Systematic Classification of Knowledge, Reasoning, and Context within the ARC Dataset	2018	Michael Boratko Harshit Padigela Divyendra Mikkilineni Pritish Yuvraj Rajarshi Das Andrew McCallum Maria Chang Achille Fokoue-Nkoutche Pavan Kapanipathi Nicholas Mattei
+ PDF Chat	Key-Value Memory Networks for Directly Reading Documents	2016	Alexander Miller Adam Fisch Jesse Dodge Amir-Hossein Karimi Antoine Bordes Jason Weston
+ PDF Chat	SQuAD: 100,000+ Questions for Machine Comprehension of Text	2016	Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang
+ PDF Chat	Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge	2018	Todor Mihaylov Anette Frank
+ PDF Chat	Adversarial Examples for Evaluating Reading Comprehension Systems	2017	Robin Jia Percy Liang