Inductive biases for deep learning of higher-level cognition

Anirudh Goyal, Yoshua Bengio

Type: Article

Publication Date: 2022-10-01

Citations: 156

DOI: https://doi.org/10.1098/rspa.2021.0068

View Publication

Locations

Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences - View
arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Inductive Biases for Deep Learning of Higher-Level Cognition	2020	Anirudh Goyal Yoshua Bengio
+	The Foundations of Deep Learning with a Path Towards General Intelligence	2018	Eray Özkural
+	The Foundations of Deep Learning with a Path Towards General Intelligence	2018	Eray Özkural
+	Bridging the Gap between Artificial Intelligence and Artificial General Intelligence: A Ten Commandment Framework for Human-Like Intelligence	2022	Ananta Nair Farnoush Banaei‐Kashani
+	A Review of Findings from Neuroscience and Cognitive Psychology as Possible Inspiration for the Path to Artificial General Intelligence	2024	Florin Leon
+ PDF Chat	Deep Learning for Cognitive Neuroscience	2020	Katherine R. Storrs Nikolaus Kriegeskorte
+	Deep Learning for Cognitive Neuroscience	2019	Katherine R. Storrs Nikolaus Kriegeskorte
+ PDF Chat	Philosophy of Cognitive Science in the Age of Deep Learning	2024	Raphaël Millière
+ PDF Chat	Statistical signatures of abstraction in deep neural networks	2024	Carlo Orientale Caputo Matteo Marsili
+	Statistical Signatures of Abstraction in Deep Neural Networks	2024	Carlo Orientale Caputo Matteo Marsili
+ PDF Chat	What deep learning can tell us about higher cognitive functions like mindreading?	2018	Jaan Aru Raúl Vicente
+	What deep learning can tell us about higher cognitive functions like mindreading?	2018	Jaan Aru Raúl Vicente
+	Philosophy of cognitive science in the age of deep learning	2024	Raphaël Millière
+ PDF Chat	An Exploration of Error-Driven Learning in Simple Two-Layer Networks From a Discriminative Learning Perspective	2020	Dorothée B. Hoppe Petra Hendriks Michael Ramscar Jacolien van Rij
+	On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligence	2022	Yi Ma Doris Y. Tsao Heung‐Yeung Shum
+	If deep learning is the answer, then what is the question?	2020	Andrew Saxe Stephanie Nelli Christopher Summerfield
+ PDF Chat	Human learning follows the dynamics of gradient descent	2021	Daniel N. Barry Bradley C. Love
+	Human learning follows the dynamics of gradient descent	2021	Daniel N. Barry Bradley C. Love
+	Dual Cognitive Architecture: Incorporating Biases and Multi-Memory Systems for Lifelong Learning	2023	Shruthi Gowda Bahram Zonooz Elahe Arani
+	The Relativity of Induction	2020	Larry Muhlstein

Works That Cite This (64)

Action	Title	Year	Authors
+ PDF Chat	Advances of machine learning in materials science: Ideas and techniques	2023	Sue Sin Chong Yi Sheng Ng Hui‐Qiong Wang Jin‐Cheng Zheng
+ PDF Chat	Affordance detection with Dynamic-Tree Capsule Networks	2022	Antonio Rodrı́guez-Sánchez Simon Haller-Seeber David Peer Chris Engelhardt Jakob Mittelberger Matteo Saveriano
+ PDF Chat	Understanding the Computational Demands Underlying Visual Reasoning	2022	Mohit Vaishnav Rémi Cadène Andrea Alamia Drew Linsley Rufin VanRullen T. Serre
+	The shape and simplicity biases of adversarially robust ImageNet-trained CNNs	2020	Peijie Chen Chirag Agarwal Anh‐Tu Nguyen
+ PDF Chat	A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learning	2021	Mingde Zhao Zhen Liu Sitao Luan Shuyuan Zhang Doina Precup Yoshua Bengio
+ PDF Chat	The Worst of Both Worlds: A Comparative Analysis of Errors in Learning from Data in Psychology and Machine Learning	2022	Jessica Hullman Sayash Kapoor Priyanka Nanayakkara Andrew Gelman Arvind Narayanan
+	Fast and Slow Learning of Recurrent Independent Mechanisms	2021	Kanika Madan Nan Rosemary Ke Anirudh Goyal Bernhard Schölkopf Yoshua Bengio
+	Deep Learning in Medical Image Registration: Introduction and Survey	2023	Ahmad Hammoudeh Stéphane Dupont
+	Towards a theory of out-of-distribution learning	2021	Ali Geisa Ronak Mehta Hayden S. Helm Jayanta Dey Eric Eaton Carey E. Priebe Joshua T Vogelstein
+	Deep Learning in Medical Image Registration: Introduction and Survey	2023	Ahmad Hammoudeh Stéphane Dupont

Works Cited by This (76)

Action	Title	Year	Authors
+	On the Number of Experiments Sufficient and in the Worst Case Necessary to Identify All Causal Relations Among N Variables	2012	Frederick Eberhardt Clark Glymour Richard Scheines
+ PDF Chat	Fully convolutional networks for semantic segmentation	2015	Jonathan Long Evan Shelhamer Trevor Darrell
+	On the number of response regions of deep feed forward networks with piece-wise linear activations	2013	Razvan Pascanu Guido Montúfar Yoshua Bengio
+	An invariant form for the prior probability in estimation problems	1946	Harold Jeffreys
+ PDF Chat	Efficient Behavior of Small-World Networks	2001	Vito Latora Massimo Marchiori
+	Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review	1996	Mary Kathryn Cowles Bradley P. Carlin
+	Training with Noise is Equivalent to Tikhonov Regularization	1995	Chris Bishop
+ PDF Chat	Do New Caledonian crows solve physical problems through causal reasoning?	2008	Alex H. Taylor Gavin R. Hunt Felipe S. Medina Russell D. Gray
+	Markov Chain Monte Carlo in Practice	1995	Walter R. Gilks Sylvia Richardson David J. Spiegelhalter
+	On the Number of Linear Regions of Deep Neural Networks	2014	Guido Montúfar Razvan Pascanu Kyunghyun Cho Yoshua Bengio