Neural language models as psycholinguistic subjects: Representations of syntactic state

Richard Futrell, Ethan Wilcox, Takashi Morita, Peng Qian, Miguel Ballesteros, Roger Lévy

Type: Article

Publication Date: 2019-01-01

Citations: 168

DOI: https://doi.org/10.18653/v1/n19-1004

Abstract

Richard Futrell, Ethan Wilcox, Takashi Morita, Peng Qian, Miguel Ballesteros, Roger Levy. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019.

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State	2019	Peng Qian Roger Lévy
+	Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State	2019	Richard Futrell Ethan Wilcox Takashi Morita Peng Qian Miguel Ballesteros Roger Lévy
+	RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency	2018	Richard Futrell Ethan Wilcox Takashi Morita Roger Lévy
+	RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency.	2018	Richard Futrell Ethan Wilcox Takashi Morita Roger Lévy
+	Linking artificial and human neural representations of language	2019	Jon Gauthier Roger Lévy
+ PDF Chat	A Multi-Task Approach for Disentangling Syntax and Semantics in Sentence Representations	2019	Mingda Chen Qingming Tang Sam Wiseman Kevin Gimpel
+	Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models	2021	Matthew Finlayson Aaron Mueller Sebastian Gehrmann Stuart M. Shieber Tal Linzen Yonatan Belinkov
+ PDF Chat	When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes	2022	Mycal Tucker Tiwalayo Eisape Peng Qian Roger Lévy Julie Shah
+ PDF Chat	Representation of Constituents in Neural Language Models: Coordination Phrase as a Case Study	2019	Aixiu An Peng Qian Ethan Wilcox Roger Lévy
+	Quantity doesn’t buy quality syntax with neural language models	2019	Marten van Schijndel Aaron Mueller Tal Linzen
+ PDF Chat	Benchmarking Approximate Inference Methods for Neural Structured Prediction	2019	Lifu Tu Kevin Gimpel
+ PDF Chat	Understanding Learning Dynamics Of Language Models with	2019	Naomi Saphra Adam Lopez
+	Explaining Large Language Model-Based Neural Semantic Parsers (Student Abstract)	2023	Daking Rai Yilun Zhou Bailin Wang Ziyu Yao
+ PDF Chat	Explaining Large Language Model-Based Neural Semantic Parsers (Student Abstract)	2023	Daking Rai Yilun Zhou Bailin Wang Ziyu Yao
+	Exploring Processing of Nested Dependencies in Neural-Network Language Models and Humans.	2020	Yair Lakretz Dieuwke Hupkes Alessandra Vergallito Marco Marelli Marco Baroni Stanislas Dehaene
+ PDF Chat	What are large language models supposed to model?	2023	Idan Blank
+ PDF Chat	Refining Targeted Syntactic Evaluation of Language Models	2021	Benjamin Newman Kai-Siang Ang Julia Gong John Hewitt
+ PDF Chat	Finding Structure in Language Models	2024	Jaap Jumelet
+ PDF Chat	Mechanisms for handling nested dependencies in neural-network language models and humans	2021	Yair Lakretz Dieuwke Hupkes Alessandra Vergallito Marco Marelli Marco Baroni Stanislas Dehaene
+	The Neural Basis of Syntactic Processing: a Critical Look: David Caplan	2013

Works That Cite This (101)

Action	Title	Year	Authors
+ PDF Chat	When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it	2022	Sebastian Schuster Tal Linzen
+	Single-stage prediction models do not explain the magnitude of syntactic disambiguation difficulty	2020	Marten van Schijndel Tal Linzen
+	Exploring BERT’s Sensitivity to Lexical Cues using Tests from Semantic Priming	2020	Kanishka Misra Allyson Ettinger Julia Taylor Rayz
+ PDF Chat	Single‐Stage Prediction Models Do Not Explain the Magnitude of Syntactic Disambiguation Difficulty	2021	Marten van Schijndel Tal Linzen
+	Exploring the Sensitivity of LLMs’ Decision-Making Capabilities: Insights from Prompt Variations and Hyperparameters	2023	Manikanta Loya Divya Sinha Richard Futrell
+	Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics	2023	Yuhan Zhang Edward Gibson Forrest Davis
+ PDF Chat	Word Acquisition in Neural Language Models	2022	Tyler A. Chang Benjamin Bergen
+	On the Opportunities and Risks of Foundation Models	2021	Rishi Bommasani Drew A. Hudson Ehsan Adeli Russ B. Altman Simran Arora Sydney von Arx Michael S. Bernstein Jeannette Bohg Antoine Bosselut Emma Brunskill
+ PDF Chat	Predicting Fine-Tuning Performance with Probing	2022	Zining Zhu Soroosh Shahtalebi Frank Rudzicz
+ PDF Chat	Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation	2022	Zoey Liu Emily Prud’hommeaux

Works Cited by This (22)

Action	Title	Year	Authors
+ PDF Chat	Probabilistic Parsing Using Left Corner Language Models	2000	Christopher D. Manning Bob Carpenter
+	An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities	1994	Andreas Stolcke
+	Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution	1994	John C. Trueswell Michael K. Tanenhaus Susan M. Garnsey
+	Sequence to Sequence Learning with Neural Networks	2014	Ilya Sutskever Oriol Vinyals Quoc V. Le
+ PDF Chat	Random effects structure for confirmatory hypothesis testing: Keep it maximal	2013	Dale J. Barr Roger Lévy Christoph Scheepers Harry Tily
+	Exploring the Limits of Language Modeling	2016	Rafał Józefowicz Oriol Vinyals Mike Schuster Noam Shazeer Yonghui Wu
+ PDF Chat	Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies	2016	Tal Linzen Emmanuel Dupoux Yoav Goldberg
+ PDF Chat	One billion word benchmark for measuring progress in statistical language modeling	2014	Ciprian Chelba Tomáš Mikolov Mike Schuster Qi Ge Thorsten Brants Phillipp Koehn Tony Robinson
+	Exploring the Syntactic Abilities of RNNs with Multi-task Learning	2017	Émile Enguehard Yoav Goldberg Tal Linzen
+ PDF Chat	Targeted Syntactic Evaluation of Language Models	2018	Rebecca Marvin Tal Linzen