Learning a Cost-Effective Annotation Policy for Question Answering

Bernhard Kratzwald, Stefan Feuerriegel, Huan Sun

Type: Article

Publication Date: 2020-01-01

Citations: 9

DOI: https://doi.org/10.18653/v1/2020.emnlp-main.246

Locations

arXiv (Cornell University) - View - PDF
Repository for Publications and Research Data (ETH Zurich) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Learning a Cost-Effective Annotation Policy for Question Answering	2020	Bernhard Kratzwald Stefan Feuerriegel Huan Sun
+	Practical Annotation Strategies for Question Answering Datasets	2020	Bernhard Kratzwald Xiang Yue Huan Sun Stefan Feuerriegel
+	Practical Annotation Strategies for Question Answering Datasets.	2020	Bernhard Kratzwald Xiang Yue Huan Sun Stefan Feuerriegel
+	BERTVision -- A Parameter-Efficient Approach for Question Answering	2022	Siduo Jiang Cristopher Benge William C. King
+	Optimal and Efficient Binary Questioning for Human-in-the-Loop Annotation	2023	Franco Marchesoni-Acland Jean‐Michel Morel Josselin Kherroubi Gabriele Facciolo
+ PDF Chat	Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraints	2023	Kunpeng Guo Dennis Diefenbach Antoine Gourru Christophe Gravier
+	Improving Low-Resource Question Answering using Active Learning in Multiple Stages	2022	Maximilian Schmidt Andrea Bartezzaghi Jasmina Bogojeska A. Cristiano I. Malossi Thang X. Vu
+	SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering	2021	Xiaopeng Lu Kyusong Lee Tiancheng Zhao
+ PDF Chat	SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering	2021	Xiaopeng Lu Kyusong Lee Tiancheng Zhao
+	SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering	2021	Xiaopeng Lu Kyusong Lee Tiancheng Zhao
+	Improving Question Answering Performance through Manual Annotation: Costs, Benefits and Strategies	2022	Piotr Rybak Piotr Przybyła Maciej Ogrodniczuk
+ PDF Chat	Unsupervised LLM Adaptation for Question Answering	2024	Kuniaki Saito Kihyuk Sohn Chen‐Yu Lee Yoshitaka Ushiku
+	A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering	2022	Matt Maufe James Ravenscroft Rob Procter Maria Liakata
+ PDF Chat	Enhancing Question Answering on Charts Through Effective Pre-training Tasks	2024	Ashim Gupta Vivek Gupta Shuo Zhang Yujie He Ning Zhang Shalin Shah
+	A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering	2022	Matthew Maufe James Ravenscroft Rob Procter Maria Liakata
+	Simple and Effective Semi-Supervised Question Answering	2018	Bhuwan Dhingra Danish Pruthi Dheeraj Rajagopal
+	Simple and Effective Semi-Supervised Question Answering	2018	Bhuwan Dhingra Danish Pruthi Dheeraj Rajagopal
+	Few-shot Unified Question Answering: Tuning Models or Prompts?	2023	Srijan Bansal Semih Yavuz Bo Pang Meghana Bhat Yingbo Zhou
+	Few-shot Unified Question Answering: Tuning Models or Prompts?	2023	Srijan Bansal Semih Yavuz Bo Pang Meghana Bhat Yingbo Zhou
+ PDF Chat	Context Filtering with Reward Modeling in Question Answering	2024	Sangryul Kim James H. Thorne

Works That Cite This (5)

Action	Title	Year	Authors
+	Capturing Label Distribution: A Case Study in NLI	2021	Shujian Zhang Chengyue Gong Eunsol Choi
+	Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering	2023	Hai Ye Qizhe Xie Hwee Tou Ng
+ PDF Chat	QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation	2022	Zhenrui Yue Huimin Zeng Bernhard Kratzwald Stefan Feuerriegel Dong Wang
+ PDF Chat	Simulating Bandit Learning from User Feedback for Extractive Question Answering	2022	Ge Gao Eunsol Choi Yoav Artzi
+ PDF Chat	Learning with Different Amounts of Annotation: From Zero to Many Labels	2021	Shujian Zhang Chengyue Gong Eunsol Choi

Works Cited by This (29)

Action	Title	Year	Authors
+	The foundations of cost-sensitive learning	2001	Charles Elkan
+ PDF Chat	Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision	2017	Liang Chen Jonathan Berant Quoc V. Le Kenneth D. Forbus Ni Lao
+	NewsQA: A Machine Comprehension Dataset	2017	Adam Trischler Tong Wang Xingdi Yuan Justin Harris Alessandro Sordoni Philip Bachman Kaheer Suleman
+	R$^3$: Reinforced Reader-Ranker for Open-Domain Question Answering	2017	Shuohang Wang Mo Yu Xiaoxiao Guo Zhiguo Wang Tim Klinger Wei Zhang Shiyu Chang Gerald Tesauro Bowen Zhou Jing Jiang
+ PDF Chat	Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answering	2018	Jinhyuk Lee Seongjun Yun Hyunjae Kim Miyoung Ko Jaewoo Kang
+ PDF Chat	HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering	2018	Zhilin Yang Peng Qi Saizheng Zhang Yoshua Bengio William W. Cohen Ruslan Salakhutdinov Christopher D. Manning
+ PDF Chat	Semi-Supervised Sequence Modeling with Cross-View Training	2018	Kevin Clark Minh-Thang Luong Christopher D. Manning Quoc V. Le
+	RankQA: Neural Question Answering with Answer Re-Ranking	2019	Bernhard Kratzwald Anna Eigenmann Stefan Feuerriegel
+	Latent Retrieval for Weakly Supervised Open Domain Question Answering	2019	Kenton Lee Ming‐Wei Chang Kristina Toutanova
+	MS MARCO: A Human Generated MAchine Reading COmprehension Dataset	2016	Payal Bajaj Daniel Campos Nick Craswell Li Deng Jianfeng Gao Xiaodong Liu Rangan Majumder Andrew McNamara Bhaskar Mitra Tri Gia Nguyen