How Many Data Samples is an Additional Instruction Worth?

Ravsehaj Singh Puri, Swaroop Mishra, Mihir Parmar, Chitta Baral

Type: Article

Publication Date: 2023-01-01

Citations: 8

DOI: https://doi.org/10.18653/v1/2023.findings-eacl.77

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	How Many Data Samples is an Additional Instruction Worth?	2022	Ravsehaj Singh Puri Swaroop Mishra Mihir Parmar Chitta Baral
+	Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning	2023	Fan Yin Jesse Vig Philippe Laban Shafiq Joty Caiming Xiong Chien-Sheng Wu
+	Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning	2023	Fan Yin Jesse Vig Philippe Laban Shafiq Joty Caiming Xiong Chien-Sheng Wu
+	ConTinTin: Continual Learning from Task Instructions	2022	Wenpeng Yin Jia Li Caiming Xiong
+ PDF Chat	ConTinTin: Continual Learning from Task Instructions	2022	Wenpeng Yin Jia Li Caiming Xiong
+	MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following	2023	Renze Lou Kai Zhang Jian Xie Yuxuan Sun Janice Ahn Hanzi Xu Yu Su Wenpeng Yin
+ PDF Chat	Fine-Tuning, Prompting, In-Context Learning and Instruction-Tuning: How Many Labelled Samples Do We Need?	2024	Branislav Pecher Ivan Srba Mária Bieliková
+	OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization	2022	Srinivasan Iyer Xi Victoria Lin Ramakanth Pasunuru Todor Mihaylov Daniel Simig Ping Yu Kurt Shuster Tianlu Wang Qing Liu Punit Singh Koura
+	Natural Instructions: Benchmarking Generalization to New Tasks from Natural Language Instructions	2021	Swaroop Mishra Daniel Khashabi Chitta Baral Hannaneh Hajishirzi
+ PDF Chat	Layer by Layer: Uncovering Where Multi-Task Learning Happens in Instruction-Tuned Large Language Models	2024	Zheng Zhao Yftah Ziser Shay B. Cohen
+	Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation	2023	Da Yin Xiao Liu Fan Yin Ming Zhong Hritik Bansal Jiawei Han Kai-Wei Chang
+ PDF Chat	Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation	2023	Yin Da Xiao Liu Fan Yin Ming Zhong Hritik Bansal Jiawei Han Kai-Wei Chang
+	Evaluating the Zero-shot Robustness of Instruction-tuned Language Models	2023	Jiuding Sun Chantal Shaib Byron Wallace
+	Instruction Mining: When Data Mining Meets Large Language Model Finetuning	2023	Yihan Cao Yanbin Kang Lichao Sun
+	Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models	2023	Zhihan Zhang Shuohang Wang Wenhao Yu Xu Yi‐chong Dan Iter Qingkai Zeng Yang Liu Chenguang Zhu Meng Jiang
+	Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models	2023	Zhihan Zhang Shuohang Wang Wenhao Yu Xu Yi‐chong Dan Iter Qingkai Zeng Yang Liu Chenguang Zhu Meng Jiang
+	Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks	2022	Yizhong Wang Swaroop Mishra Pegah Alipoormolabashi Yeganeh Kordi Amirreza Mirzaei Anjana Arunkumar Arjun Ashok Arut Selvan Dhanasekaran Atharva Naik David Stap
+	AlpaGasus: Training A Better Alpaca with Fewer Data	2023	Lichang Chen Shiyang Li Jun Yan Hai Wang Kalpa Gunaratna Vikas Yadav Zheng Tang Vijay Srinivasan Tianyi Zhou Heng Huang
+ PDF Chat	Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization	2022	Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang
+	Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization	2022	Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang

Works That Cite This (5)

Action	Title	Year	Authors
+ PDF Chat	LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity	2023	Anjana Arunkumar S. Sharma Rashmi Agrawal Sriram Chandrasekaran Chris Bryan
+ PDF Chat	Is a Question Decomposition Unit All We Need?	2022	Pruthvi Patel Swaroop Mishra Mihir Parmar Chitta Baral
+ PDF Chat	Less is More: Summary of Long Instructions is Better for Program Synthesis	2022	Kirby Kuznia Swaroop Mishra Mihir Parmar Chitta Baral
+ PDF Chat	In-BoXBART: Get Instructions into Biomedical Multi-Task Learning	2022	Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo Murad Mohammad Chitta Baral
+	InstructExcel: A Benchmark for Natural Language Instruction in Excel	2023	Justin Payan Swaroop Mishra Mukul Singh Carina Negreanu Christian Poelitz Chitta Baral Subhro Roy Rasika Chakravarthy Benjamin Van Durme Elnaz Nouri

Works Cited by This (42)

Action	Title	Year	Authors
+	Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks	2015	Jason Weston Antoine Bordes Sumit Chopra Alexander M. Rush Bart van Merriënboer Armand Joulin Tomáš Mikolov
+ PDF Chat	ImageNet Large Scale Visual Recognition Challenge	2015	Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael S. Bernstein
+	Annotation Artifacts in Natural Language Inference Data	2018	Suchin Gururangan Swabha Swayamdipta Omer Levy Roy Schwartz Samuel R. Bowman Noah A. Smith
+	Know What You Don’t Know: Unanswerable Questions for SQuAD	2018	Pranav Rajpurkar Robin Jia Percy Liang
+	Certified Robustness to Adversarial Word Substitutions	2019	Robin Jia Aditi Raghunathan Kerem Göksel Percy Liang
+	Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach	2019	Wenpeng Yin Jamaal Hay Dan Roth
+	HuggingFace's Transformers: State-of-the-art Natural Language Processing	2019	Thomas Wolf Lysandre Debut Victor Sanh Julien Chaumond Clément Delangue Anthony Moi Pierric Cistac Tim Rault Rémi Louf Morgan Funtowicz
+	BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	2020	Mike Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdelrahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer
+ PDF Chat	How Can We Know What Language Models Know?	2020	Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig
+	Learning from Task Descriptions	2020	Orion Weller Nicholas Lourie Matt Gardner Matthew E. Peters