When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks

Ankur Sikarwar, Arkil Patel, Navin Goyal

Type: Preprint

Publication Date: 2022-01-01

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2210.12786

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks	2022	Ankur Sikarwar Arkil Patel Navin Goyal
+	ReaSCAN: Compositional Reasoning in Language Grounding	2021	Zhengxuan Wu Elisa Kreiss Desmond C. Ong Christopher Potts
+	A Benchmark for Systematic Generalization in Grounded Language Understanding	2020	Laura Ruis Jacob Andreas Marco Baroni Diane Bouchacourt Brenden M. Lake
+ PDF Chat	Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?	2021	Linlu Qiu Hexiang Hu Bowen Zhang Peter Shaw Fei Sha
+	Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?	2021	Linlu Qiu Hexiang Hu Bowen Zhang Peter Shaw Fei Sha
+ PDF Chat	Attention as a Hypernetwork	2024	Simon Schug Seijin Kobayashi Yassir Akram João Sacramento Razvan Pascanu
+	Compositional Networks Enable Systematic Generalization for Grounded Language Understanding	2021	Yen‐Ling Kuo Boris Katz Andrei Barbu
+	Compositional Networks Enable Systematic Generalization for Grounded Language Understanding	2020	Yen‐Ling Kuo Boris Katz Andrei Barbu
+	Towards Equipping Transformer with the Ability of Systematic Compositionality	2023	Huang Chen Peixin Qin Wenqiang Lei Jiancheng Lv
+ PDF Chat	Towards Equipping Transformer with the Ability of Systematic Compositionality	2024	Huang Chen Peixin Qin Wenqiang Lei Jiancheng Lv
+	Compositional Generalization with Tree Stack Memory Units	2019	Forough Arabshahi Zhichu Lu Pranay Mundra Sameer Singh Animashree Anandkumar
+ PDF Chat	Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers	2025	Zhongwang Zhang Pengxiao Lin Zhiwei Wang Yaoyu Zhang Zhi‐Qin John Xu
+ PDF Chat	SPARO: Selective Attention for Robust and Compositional Transformer Encodings for Vision	2024	Ankit Vani Bac T. Nguyen Samuel Lavoie Ranjay Krishna Aaron Courville
+ PDF Chat	Systematic Generalization with Edge Transformers	2021	Leon Bergen Timothy O’Donnell Dzmitry Bahdanau
+	Systematic Generalization with Edge Transformers	2021	Leon Bergen Timothy O’Donnell Dzmitry Bahdanau
+	Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments	2023	Danial Kamali Parisa Kordjamshidi
+	Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments	2023	Danial Kamali Parisa Kordjamshidi
+ PDF Chat	A Survey on Compositional Learning of AI Models: Theoretical and Experimetnal Practices	2024	Sania Sinha Tanawan Premsri Parisa Kordjamshidi
+	Compositional Generalization in Grounded Language Learning via Induced Model Sparsity	2022	Sam Spilsbury Alexander Ilin
+	Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers	2023	Awni Altabaa Taylor W. Webb Jonathan Cohen John Lafferty

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors