Josh Merel

Generating author description...

All published works

Action	Title	Year	Authors
+ PDF Chat	emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation	2024	Sasha Salter Richard Warren Collin Schlager Adrian Spurr Shangchen Han R. Rick Bhasin Yujun Cai Peter Walkington Anuoluwapo Bolarinwa Robert Wang
+ PDF Chat	Deep Dive into Model-free Reinforcement Learning for Biological and Robotic Systems: Theory and Practice	2024	Yusheng Jiao Feng Ling Sina Heydari Nicolas Heess Josh Merel Eva Kanso
+	Universal Humanoid Motion Representations for Physics-Based Control	2023	Zhengyi Luo Jinkun Cao Josh Merel Alexander Winkler Lin Hu Kris Kitani Weipeng Xu
+ PDF Chat	From motor control to team play in simulated humanoid football	2022	Siqi Liu Guy Lever Zhe Wang Josh Merel S. M. Ali Eslami Daniel Hennes Wojciech Marian Czarnecki Yuval Tassa Shayegan Omidshafiei Abbas Abdolmaleki
+	Imitate and Repurpose: Learning Reusable Robot Movement Skills From Human and Animal Behaviors	2022	Steven Bohez Saran Tunyasuvunakool Philémon Brakel Fereshteh Sadeghi Leonard Hasenclever Yuval Tassa Emilio Parisotto Jan Humplik Tuomas Haarnoja Roland Hafner
+	NeuPL: Neural Population Learning	2022	Siqi Liu Luke Marris Daniel Hennes Josh Merel Nicolas Heess Thore Graepel
+	Data augmentation for efficient learning from parametric experts	2022	Alexandre Galashov Josh Merel Nicolas Heess
+ PDF Chat	Learning Transferable Motor Skills with Hierarchical Latent Mixture Policies	2021	Dushyant Rao Fereshteh Sadeghi Leonard Hasenclever Markus Wulfmeier Martina Zambelli Giulia Vezzani Dhruva Tirumala Yusuf Aytar Josh Merel Nicolas Heess
+ PDF Chat	Learning to swim in potential flow	2021	Yusheng Jiao Feng Ling Sina Heydari Nicolas Heess Josh Merel Eva Kanso
+	Learning Dynamics Models for Model Predictive Agents	2021	Michael Lutter Leonard Hasenclever Arunkumar Byravan Gabriel Dulac-Arnold Piotr Trochim Nicolas Heess Josh Merel Yuval Tassa
+	Evaluating model-based planning and planner amortization for continuous control	2021	Arunkumar Byravan Leonard Hasenclever Piotr Trochim Mehdi Mirza Alessandro Davide Ialongo Yuval Tassa Jost Tobias Springenberg Abbas Abdolmaleki Nicolas Heess Josh Merel
+	Divergent representations of ethological visual inputs emerge from supervised, unsupervised, and reinforcement learning	2021	Grace W. Lindsay Josh Merel Tom Mrsic-Flogel Maneesh Sahani
+	Learning Transferable Motor Skills with Hierarchical Latent Mixture Policies	2021	Dushyant Rao Fereshteh Sadeghi Leonard Hasenclever Markus Wulfmeier Martina Zambelli Giulia Vezzani Dhruva Tirumala Yusuf Aytar Josh Merel Nicolas Heess
+	From Motor Control to Team Play in Simulated Humanoid Football	2021	Siqi Liu Guy Lever Zhe Wang Josh Merel S. M. Ali Eslami Daniel Hennes Wojciech Marian Czarnecki Yuval Tassa Shayegan Omidshafiei Abbas Abdolmaleki
+	Local Search for Policy Iteration in Continuous Control.	2020	Jost Tobias Springenberg Nicolas Heess Daniel J. Mankowitz Josh Merel Arunkumar Byravan Abbas Abdolmaleki Jackie Kay Jonas Degrave Julian Schrittwieser Yuval Tassa
+ PDF Chat	dm_control: Software and tasks for continuous control	2020	Saran Tunyasuvunakool Alistair Muldal Yotam Doron Siqi Liu Steven Bohez Josh Merel Tom Erez Timothy Lillicrap Nicolas Heess Yuval Tassa
+	Critic Regularized Regression	2020	Ziyu Wang Alexander Novikov Konrad Żołna Josh Merel Jost Tobias Springenberg Scott Reed Bobak Shahriari Noah Siegel Çaǧlar Gülçehre Nicolas Heess
+	RL Unplugged: Benchmarks for Offline Reinforcement Learning.	2020	Çaǧlar Gülçehre Ziyu Wang Alexander Novikov Tom Le Paine Sergio Gómez Colmenarejo Konrad Żołna Rishabh Agarwal Josh Merel Daniel J. Mankowitz Cosmin Păduraru
+	Deep neuroethology of a virtual rodent	2020	Josh Merel Diego Aldarondo Jesse D. Marshall Yuval Tassa Greg Wayne Bence P. Ölveczky
+	Divide-and-Conquer Monte Carlo Tree Search For Goal-Directed Planning	2020	Giambattista Parascandolo Lars Buesing Josh Merel Leonard Hasenclever John Aslanides Jessica B. Hamrick Nicolas Heess Alexander Neitz Théophane Weber
+	Critic Regularized Regression	2020	Ziyu Wang Alexander Novikov Konrad Żołna Jost Tobias Springenberg Scott Reed Bobak Shahriari Noah Siegel Josh Merel Çaǧlar Gülçehre Nicolas Heess
+	RL Unplugged: A Suite of Benchmarks for Offline Reinforcement Learning	2020	Çaǧlar Gülçehre Ziyu Wang Alexander Novikov Tom Le Paine Sergio Gómez Colmenarejo Konrad Żołna Rishabh Agarwal Josh Merel Daniel J. Mankowitz Cosmin Păduraru
+	Local Search for Policy Iteration in Continuous Control	2020	Jost Tobias Springenberg Nicolas Heess Daniel J. Mankowitz Josh Merel Arunkumar Byravan Abbas Abdolmaleki Jackie Kay Jonas Degrave Julian Schrittwieser Yuval Tassa
+	Divide-and-Conquer Monte Carlo Tree Search For Goal-Directed Planning	2020	Giambattista Parascandolo Lars Buesing Josh Merel Leonard Hasenclever John Aslanides Jessica B. Hamrick Nicolas Heess Alexander Neitz Théophane Weber
+	Deep neuroethology of a virtual rodent	2019	Josh Merel Diego Aldarondo Jesse D. Marshall Yuval Tassa Greg Wayne Bence P. Ölveczky
+	Reusable neural skill embeddings for vision-guided whole body movement and object manipulation	2019	Josh Merel Saran Tunyasuvunakool Arun Ahuja Yuval Tassa Leonard Hasenclever Vu Pham Tom Erez Greg Wayne Nicolas Heess
+	Catch & Carry: Reusable Neural Controllers for Vision-Guided Whole-Body Tasks	2019	Josh Merel Saran Tunyasuvunakool Arun Ahuja Yuval Tassa Leonard Hasenclever Vu Pham Tom Erez Greg Wayne Nicolas Heess
+	Emergent Coordination Through Competition	2019	Siqi Liu Guy Lever Josh Merel Saran Tunyasuvunakool Nicolas Heess Thore Graepel
+	Emergent Coordination Through Competition	2019	Siqi Liu Guy Lever Josh Merel Saran Tunyasuvunakool Nicolas Heess Thore Graepel
+	Deep neuroethology of a virtual rodent	2019	Josh Merel Diego Aldarondo Jesse D. Marshall Yuval Tassa Greg Wayne Bence P. Ölveczky
+	Catch & Carry: Reusable Neural Controllers for Vision-Guided Whole-Body Tasks	2019	Josh Merel Saran Tunyasuvunakool Arun Ahuja Yuval Tassa Leonard Hasenclever Vu Pham Tom Erez Greg Wayne Nicolas Heess
+	Neural probabilistic motor primitives for humanoid control	2018	Josh Merel Leonard Hasenclever Alexandre Galashov Arun Ahuja Vu Pham Greg Wayne Yee Whye Teh Nicolas Heess
+	Hierarchical Visuomotor Control of Humanoids.	2018	Josh Merel Arun Ahuja Vu Pham Saran Tunyasuvunakool Siqi Liu Dhruva Tirumala Nicolas Heess Greg Wayne
+	Reinforcement and Imitation Learning for Diverse Visuomotor Skills	2018	Yuke Zhu Ziyu Wang Josh Merel Andrei A. Rusu Tom Erez Serkan Cabi Saran Tunyasuvunakool János Kramár Raia Hadsell Nando de Freitas
+	Graph networks as learnable physics engines for inference and control	2018	Álvaro Sánchez‐González Nicolas Heess Jost Tobias Springenberg Josh Merel Martin Riedmiller Raia Hadsell Peter Battaglia
+ PDF Chat	Graph networks as learnable physics engines for inference and control	2018	Álvaro Sánchez‐González Nicolas Heess Jost Tobias Springenberg Josh Merel Martin Riedmiller Raia Hadsell Peter Battaglia
+	DeepMind Control Suite	2018	Yuval Tassa Yotam Doron Alistair Muldal Tom Erez Yazhe Li Diego de Las Casas David Budden Abbas Abdolmaleki Josh Merel Andrew Lefrancq
+	Reinforcement and Imitation Learning for Diverse Visuomotor Skills	2018	Yuke Zhu Ziyu Wang Josh Merel Andrei A. Rusu Tom Erez Serkan Cabi Saran Tunyasuvunakool János Kramár Raia Hadsell Nando de Freitas
+	Hierarchical visuomotor control of humanoids	2018	Josh Merel Arun Ahuja Vu Pham Saran Tunyasuvunakool Siqi Liu Dhruva Tirumala Nicolas Heess Greg Wayne
+	Neural probabilistic motor primitives for humanoid control	2018	Josh Merel Leonard Hasenclever Alexandre Galashov Arun Ahuja Vu Pham Greg Wayne Yee Whye Teh Nicolas Heess
+	Graph networks as learnable physics engines for inference and control	2018	Álvaro Sánchez‐González Nicolas Heess Jost Tobias Springenberg Josh Merel Martin Riedmiller Raia Hadsell Peter Battaglia
+	Emergence of Locomotion Behaviours in Rich Environments	2017	Nicolas Heess Dhruva Tb Sriram Srinivasan Jay Lemmon Josh Merel Greg Wayne Yuval Tassa Tom Erez Ziyu Wang S. M. Ali Eslami
+	Learning human behaviors from motion capture by adversarial imitation	2017	Josh Merel Yuval Tassa Dhruva Tb Sriram Srinivasan Jay Lemmon Ziyu Wang Greg Wayne Nicolas Heess
+	Robust Imitation of Diverse Behaviors	2017	Ziyu Wang Josh Merel Scott Reed Greg Wayne Nando de Freitas Nicolas Heess
+ PDF Chat	Neuroprosthetic Decoder Training as Imitation Learning	2016	Josh Merel David Carlson Liam Paninski John P. Cunningham
+ PDF Chat	Bayesian methods for event analysis of intracellular currents	2016	Josh Merel Ben Shababo Alex Naka Hillel Adesnik Liam Paninski
+	Bayesian spike inference from calcium imaging data	2013	Eftychios A. Pnevmatikakis Josh Merel Ari Pakman Liam Paninski
+ PDF Chat	Bayesian spike inference from calcium imaging data	2013	Eftychios A. Pnevmatikakis Josh Merel Ari Pakman Liam Paninski
+	Bayesian spike inference from calcium imaging data	2013	Eftychios A. Pnevmatikakis Josh Merel Ari Pakman Liam Paninski

Common Coauthors

Coauthor	Papers Together
Nicolas Heess	37
Yuval Tassa	17
Leonard Hasenclever	14
Greg Wayne	13
Saran Tunyasuvunakool	13
Ziyu Wang	8
Jost Tobias Springenberg	8
Tom Erez	8
Raia Hadsell	8
Martin Riedmiller	8
Vu Pham	7
Arun Ahuja	7
Nando de Freitas	7
Abbas Abdolmaleki	6
Liam Paninski	5
Noah Siegel	5
Thore Graepel	5
Markus Wulfmeier	5
Eftychios A. Pnevmatikakis	4
Siqi Liu	4
Alexander Novikov	4
Arunkumar Byravan	4
Konrad Żołna	4
Daniel J. Mankowitz	4
Çaǧlar Gülçehre	4
Guy Lever	4
Dhruva Tirumala	4
Jesse D. Marshall	4
S. M. Ali Eslami	3
Álvaro Sánchez‐González	3
Ari Pakman	3
Bence P. Ölveczky	3
Alexandre Galashov	3
Daniel Hennes	3
Luke Marris	3
Peter Battaglia	3
Gabriel Dulac-Arnold	3
Tuomas Haarnoja	3
Scott Reed	3
Diego Aldarondo	3
Fereshteh Sadeghi	3
Karl Tuyls	2
János Kramár	2
Théophane Weber	2
Steven Bohez	2
Brendan Tracey	2
Giulia Vezzani	2
Shayegan Omidshafiei	2
Jay Lemmon	2
Piotr Trochim	2

Commonly Cited References

Action	Title	Year	Authors	# of times referenced
+	Emergence of Locomotion Behaviours in Rich Environments	2017	Nicolas Heess Dhruva Tb Sriram Srinivasan Jay Lemmon Josh Merel Greg Wayne Yuval Tassa Tom Erez Ziyu Wang S. M. Ali Eslami	13
+	Learning continuous control policies by stochastic value gradients	2015	Nicolas Heess Greg Wayne David Silver Timothy Lillicrap Yuval Tassa Tom Erez	10
+	DeepMind Control Suite	2018	Yuval Tassa Yotam Doron Alistair Muldal Tom Erez Yazhe Li Diego de Las Casas David Budden Abbas Abdolmaleki Josh Merel Andrew Lefrancq	10
+	Hierarchical Visuomotor Control of Humanoids.	2018	Josh Merel Arun Ahuja Vu Pham Saran Tunyasuvunakool Siqi Liu Dhruva Tirumala Nicolas Heess Greg Wayne	9
+	Learning human behaviors from motion capture by adversarial imitation	2017	Josh Merel Yuval Tassa Dhruva Tb Sriram Srinivasan Jay Lemmon Ziyu Wang Greg Wayne Nicolas Heess	9
+	Continuous control with deep reinforcement learning	2015	Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver Daan Wierstra	7
+	Neural probabilistic motor primitives for humanoid control	2018	Josh Merel Leonard Hasenclever Alexandre Galashov Arun Ahuja Vu Pham Greg Wayne Yee Whye Teh Nicolas Heess	7
+	Maximum a Posteriori Policy Optimisation	2018	Abbas Abdolmaleki Jost Tobias Springenberg Yuval Tassa Rémi Munos Nicolas Heess Martin Riedmiller	7
+	Proximal Policy Optimization Algorithms	2017	John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov	7
+	A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning	2010	Stéphane Ross Geoffrey J. Gordon J. Andrew Bagnell	6
+	Learning and Transfer of Modulated Locomotor Controllers	2016	Nicolas Heess Gregory Wayne Yuval Tassa Timothy Lillicrap Martin Riedmiller David Silver	6
+	Adam: A Method for Stochastic Optimization	2014	Diederik P. Kingma Jimmy Ba	5
+ PDF Chat	DeepMimic	2018	Xue Bin Peng Pieter Abbeel Sergey Levine Michiel van de Panne	5
+	Safe and Efficient Off-Policy Reinforcement Learning	2016	Rémi Munos Tom Stepleton Anna Harutyunyan Marc G. Bellemare	5
+	Continuous control with deep reinforcement learning	2016	Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver Daan Wierstra	4
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun	4
+	Trust Region Policy Optimization	2015	John Schulman Sergey Levine Philipp Moritz Michael I. Jordan Pieter Abbeel	4
+	Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards	2017	Matej Vecerík Todd Hester Jonathan Scholz Fumin Wang Olivier Pietquin Bilal Piot Nicolas Heess Thomas Rothörl Thomas Lampe Martin Riedmiller	4
+	End-to-End Training of Deep Visuomotor Policies	2015	Sergey Levine Chelsea Finn Trevor Darrell Pieter Abbeel	3
+	Hierarchical visuomotor control of humanoids	2018	Josh Merel Arun Ahuja Vu Pham Saran Tunyasuvunakool Siqi Liu Dhruva Tirumala Nicolas Heess Greg Wayne	3
+	Reinforcement and Imitation Learning for Diverse Visuomotor Skills	2018	Yuke Zhu Ziyu Wang Josh Merel Andrei A. Rusu Tom Erez Serkan Cabi Saran Tunyasuvunakool János Kramár Raia Hadsell Nando de Freitas	3
+	IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures	2018	Lasse Espeholt Hubert Soyer Rémi Munos Karen Simonyan Volodymir Mnih Tom Ward Yotam Doron Vlad Firoiu Tim Harley Iain Dunning	3
+ PDF Chat	Statistical Inference and Simulation for Spatial Point Processes	2003	Jesper Møller Rasmus Waagepetersen	3
+ PDF Chat	dm_control: Software and tasks for continuous control	2020	Saran Tunyasuvunakool Alistair Muldal Yotam Doron Siqi Liu Steven Bohez Josh Merel Tom Erez Timothy Lillicrap Nicolas Heess Yuval Tassa	3
+ PDF Chat	Sim-to-Real Transfer of Robotic Control with Dynamics Randomization	2018	Xue Bin Peng Marcin Andrychowicz Wojciech Zaremba Pieter Abbeel	3
+	Asynchronous Methods for Deep Reinforcement Learning	2016	Volodymyr Mnih Adrià Puigdomènech Badia Mehdi Mirza Alex Graves Tim Harley Timothy Lillicrap David Silver Koray Kavukcuoglu	3
+	Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor	2018	Tuomas Haarnoja Aurick Zhou Pieter Abbeel Sergey Levine	3
+	Data-efficient Deep Reinforcement Learning for Dexterous Manipulation	2017	Ivaylo Popov Nicolas Heess Timothy Lillicrap Roland Hafner Gabriel Barth-Maron Matej Vecerík Thomas Lampe Yuval Tassa Tom Erez Martin Riedmiller	3
+	Deep neuroethology of a virtual rodent	2020	Josh Merel Diego Aldarondo Jesse D. Marshall Yuval Tassa Greg Wayne Bence P. Ölveczky	3
+ PDF Chat	Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection	2017	Sergey Levine Peter Pástor Alex Krizhevsky Julian Ibarz Deirdre Quillen	3
+	One-Shot Imitation Learning	2017	Yan Duan Marcin Andrychowicz Bradly C. Stadie Jonathan Ho Jonas Schneider Ilya Sutskever Pieter Abbeel Wojciech Zaremba	3
+	Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates	2016	Shixiang Gu Ethan Holly Timothy Lillicrap Sergey Levine	3
+	Maximum a Posteriori Policy Optimisation	2018	Abbas Abdolmaleki Jost Tobias Springenberg Yuval Tassa Rémi Munos Nicolas Heess Martin Riedmiller	3
+ PDF Chat	Domain randomization for transferring deep neural networks from simulation to the real world	2017	Josh Tobin Rachel Fong Alex Ray Jonas Schneider Wojciech Zaremba Pieter Abbeel	3
+	Benchmarking Deep Reinforcement Learning for Continuous Control	2016	Yan Duan Xi Chen Rein Houthooft John Schulman Pieter Abbeel	3
+	High-Dimensional Continuous Control Using Generalized Advantage Estimation	2015	John Schulman Philipp Moritz Sergey Levine Michael I. Jordan Pieter Abbeel	3
+	Reinforcement Learning with Unsupervised Auxiliary Tasks	2016	Max Jaderberg Volodymyr Mnih Wojciech Marian Czarnecki Tom Schaul Joel Z. Leibo David Silver Koray Kavukcuoglu	3
+ PDF Chat	Fast Nonnegative Deconvolution for Spike Train Inference From Population Calcium Imaging	2010	Joshua T Vogelstein Adam M. Packer Timothy A. Machado Tanya Sippy Baktash Babadi Rafael Yuste Liam Paninski	3
+	Generative Adversarial Imitation Learning	2016	Jonathan Ho Stefano Ermon	3
+	Acme: A Research Framework for Distributed Reinforcement Learning	2020	Matt Hoffman Bobak Shahriari John Aslanides Gabriel Barth-Maron Feryal Behbahani Tamara Norman Abbas Abdolmaleki Albin Cassirer Fan Yang Kate Baumli	3
+ PDF Chat	Mapping the stereotyped behaviour of freely moving fruit flies	2014	Gordon J Berman Daniel M. Choi William Bialek Joshua W. Shaevitz	2
+	QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation	2018	Dmitry Kalashnikov Alex Irpan Peter Pástor Julian Ibarz Alexander Herzog Eric Jang Deirdre Quillen Ethan Holly Mrinal Kalakrishnan Vincent Vanhoucke	2
+ PDF Chat	Tractable nonparametric Bayesian inference in Poisson processes with Gaussian process intensities	2009	Ryan P. Adams Iain Murray David Mackay	2
+ PDF Chat	Dimensionality and Dynamics in the Behavior of C. elegans	2008	Greg J. Stephens Bethany Johnson-Kerner William Bialek William S. Ryu	2
+	Human-level performance in 3D multiplayer games with population-based reinforcement learning	2019	Max Jaderberg Wojciech Marian Czarnecki Iain Dunning Luke Marris Guy Lever Antonio García Castañeda Charles Beattie Neil C. Rabinowitz Ari S. Morcos Avraham Ruderman	2
+	Auxiliary-variable Exact Hamiltonian Monte Carlo Samplers for Binary Distributions	2013	Ari Pakman Liam Paninski	2
+	Empirical Bayes Gibbs sampling	2001	George Casella	2
+	A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning	2010	Stéphane Ross Geoffrey J. Gordon J. Andrew Bagnell	2
+	Learning Dexterous Manipulation for a Soft Robotic Hand from Human Demonstration	2016	Abhishek Gupta Clemens Eppner Sergey Levine Pieter Abbeel	2
+	Learning Awareness Models	2018	Brandon Amos Laurent Dinh Serkan Cabi Thomas Rothörl Sergio Gómez Colmenarejo Alistair Muldal Tom Erez Yuval Tassa Nando de Freitas Misha Denil	2