Syntactic Data Augmentation Increases Robustness to Inference Heuristics

Junghyun Min, R. Thomas McCoy, Dipanjan Das, Emily Pitler, Tal Linzen

Type: Article

Publication Date: 2020-01-01

Citations: 144

DOI: https://doi.org/10.18653/v1/2020.acl-main.212

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Syntactic Data Augmentation Increases Robustness to Inference Heuristics	2020	Junghyun Min R. Thomas McCoy Dipanjan Das Emily Pitler Tal Linzen
+	Syntactic Structure Distillation Pretraining For Bidirectional Encoders	2020	Adhiguna Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom
+	Syntactic Structure Distillation Pretraining For Bidirectional Encoders	2020	Adhiguna Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom
+ PDF Chat	Syntactic Structure Distillation Pretraining for Bidirectional Encoders	2020	Adhiguna Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom
+	Improving Natural Language Inference with a Pretrained Parser	2019	Deric Pang Lucy H. Lin Noah A. Smith
+	Can neural networks acquire a structural bias from raw linguistic data	2020	Alex Warstadt Samuel R. Bowman
+	Can neural networks acquire a structural bias from raw linguistic data?	2020	Alex Warstadt Samuel R. Bowman
+ PDF Chat	Infusing Finetuning with Semantic Dependencies	2021	Zhaofeng Wu Hao Peng Noah A. Smith
+ PDF Chat	Multi-head attention debiasing and contrastive learning for mitigating Dataset Artifacts in Natural Language Inference	2024	Karthik Sivakoti
+	Probing Natural Language Inference Models through Semantic Fragments	2019	Kyle Richardson Hai Hu Lawrence S. Moss Ashish Sabharwal
+	Probing Linguistic Systematicity	2020	Emily Goodwin Koustuv Sinha Timothy O’Donnell
+ PDF Chat	Probing Natural Language Inference Models through Semantic Fragments	2020	Kyle Richardson Hai Hu Lawrence S. Moss Ashish Sabharwal
+	Improving Robustness by Augmenting Training Sentences with Predicate-Argument Structures	2020	Nafise Sadat Moosavi Marcel de Boer Prasetya Ajie Utama Iryna Gurevych
+ PDF Chat	Mitigating Reversal Curse via Semantic-aware Permutation Training	2024	Qingyan Guo Rui Wang Junliang Guo Xu Tan Jiang Bian Yujiu Yang
+	Compositional pre-training for neural semantic parsing	2019	Amir Ziai
+	Compositional pre-training for neural semantic parsing	2019	Amir Ziai
+	UnNatural Language Inference	2020	Koustuv Sinha Prasanna Parthasarathi Joëlle Pineau Adina Williams
+	How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases	2023	Aaron Mueller Tal Linzen
+	How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases	2023	Aaron Mueller Tal Linzen
+	Improving Robustness by Augmenting Training Sentences with Predicate-Argument Structures.	2020	Nafise Sadat Moosavi Marcel de Boer Prasetya Ajie Utama Iryna Gurevych

Works That Cite This (80)

Action	Title	Year	Authors
+	PECO: Examining Single Sentence Label Leakage in Natural Language Inference Datasets through Progressive Evaluation of Cluster Outliers	2023	Michael Saxon Xinyi Wang Wenda Xu William Yang Wang
+	Exploring Transitivity in Neural NLI Models through Veridicality	2021	Hitomi Yanaka Koji Mineshima Kentaro Inui
+ PDF Chat	A Model-agnostic Data Manipulation Method for Persona-based Dialogue Generation	2022	Yu Cao Wei Bi Meng Fang Shuming Shi Dacheng Tao
+	Substructure Substitution: Structured Data Augmentation for NLP	2021	Haoyue Shi Karen Livescu Kevin Gimpel
+	An Analysis of Simple Data Augmentation for Named Entity Recognition	2020	Xiang Dai Heike Adel
+	What Happens To BERT Embeddings During Fine-tuning?	2020	Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney
+	Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)	2020	Alex Warstadt Yian Zhang Xiaocheng Li Haokun Liu Samuel R. Bowman
+	Learning from others' mistakes: Avoiding dataset biases without modeling them	2020	Victor Sanh Thomas Wolf Yonatan Belinkov Alexander M. Rush
+ PDF Chat	Understanding by Understanding Not: Modeling Negation in Language Models	2021	Arian Hosseini Siva Reddy Dzmitry Bahdanau R Devon Hjelm Alessandro Sordoni Aaron Courville
+ PDF Chat	Feature-Level Debiased Natural Language Understanding	2023	Yougang Lyu Piji Li Yechang Yang Maarten de Rijke Pengjie Ren Yukun Zhao Dawei Yin Zhaochun Ren

Works Cited by This (32)

Action	Title	Year	Authors
+	Synthetic and Natural Noise Both Break Neural Machine Translation	2017	Yonatan Belinkov Yonatan Bisk
+	The Effectiveness of Data Augmentation in Image Classification using Deep Learning	2017	Luis Perez Jason Wang
+	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	2018	Jacob Devlin Ming‐Wei Chang Kenton Lee Kristina Toutanova
+	Assessing BERT's Syntactic Abilities.	2019	Yoav Goldberg
+	Learning and Evaluating General Linguistic Intelligence	2019	Dani Yogatama Cyprien de Masson d’Autume Jerome T. Connor Tomáš Kočiský Mike Chrzanowski Lingpeng Kong Angeliki Lazaridou Ling Wang Lei Yu Chris Dyer
+	Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference	2019	Tom McCoy Ellie Pavlick Tal Linzen
+	Adversarially Regularising Neural NLI Models to Integrate Logical Background Knowledge	2018	Pasquale Minervini Sebastian Riedel
+	MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension	2019	Alon Talmor Jonathan Berant
+	HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity Reasoning	2019	Hitomi Yanaka Koji Mineshima Daisuke Bekki Kentaro Inui Satoshi Sekine Lasha Abzianidze Johan Bos
+	Deep Contextualized Word Representations	2018	Matthew E. Peters Mark E Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer