Learning Actionable Representations from Visual Observations

Debidatta Dwibedi, Jonathan Tompson, Corey Lynch, Pierre Sermanet

Type: Preprint

Publication Date: 2018-08-02

Citations: 17

Locations

arXiv (Cornell University) - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Learning Actionable Representations from Visual Observations	2018	Debidatta Dwibedi Jonathan Tompson Corey Lynch Pierre Sermanet
+	Learning Actionable Representations from Visual Observations	2018	Debidatta Dwibedi Jonathan Tompson Corey Lynch Pierre Sermanet
+	Learning to Act from Actionless Videos through Dense Correspondences	2023	Po-Chen Ko Jiayuan Mao Yilun Du Shaohua Sun Joshua B. Tenenbaum
+	Reinforcement Learning with Action-Free Pre-Training from Videos	2022	Younggyo Seo Kimin Lee Stephen James Pieter Abbeel
+ PDF Chat	Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations	2023	Negin Heravi Ayzaan Wahid Corey Lynch Pete Florence Travis Armstrong Jonathan Tompson Pierre Sermanet Jeannette Bohg Debidatta Dwibedi
+	Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations	2022	Negin Heravi Ayzaan Wahid Corey Lynch Pete Florence Travis Armstrong Jonathan Tompson Pierre Sermanet Jeannette Bohg Debidatta Dwibedi
+ PDF Chat	Pre-trained Visual Dynamics Representations for Efficient Policy Learning	2024	Hao Luo Bohan Zhou Zongqing Lu
+	Contrastive Learning from Demonstrations	2022	André Correia Luı́s A. Alexandre
+	Learning from Visual Observation via Offline Pretrained State-to-Go Transformer	2023	Bohan Zhou Ke Li Jiechuan Jiang Zongqing Lu
+ PDF Chat	Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers	2024	Vidhi Jain Maria Attarian Nikhil J Joshi Ayzaan Wahid Danny Driess Quan Vuong Pannag Sanketi Pierre Sermanet Stefan Welker Christine W. Chan
+	Reinforcement Learning with Videos: Combining Offline Observations with Interaction	2020	Karl Schmeckpeper Oleh Rybkin Kostas Daniilidis Sergey Levine Chelsea Finn
+	Reinforcement Learning with Videos: Combining Offline Observations with Interaction	2020	Karl Schmeckpeper Oleh Rybkin Kostas Daniilidis Sergey Levine Chelsea Finn
+	A Reliable Representation with Bidirectional Transition Model for Visual Reinforcement Learning Generalization	2023	Xiaobo Hu Youfang Lin Yue Liu Jinwen Wang Shuo Wang Hehe Fan Kai Lv
+	Representation Learning for Event-based Visuomotor Policies	2021	Sai Vemprala Sami Mian Ashish Kapoor
+	TACO: Temporal Latent Action-Driven Contrastive Loss for Visual Reinforcement Learning	2023	Ruijie Zheng Xiyao Wang Yanchao Sun Shuang Ma Jieyu Zhao Huazhe Xu Hal Daumé Furong Huang
+	Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation	2017	Pierre Sermanet Corey Lynch Jasmine Hsu Sergey Levine
+	VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training	2022	Yecheng Jason Ma Shagun Sodhani Dinesh Jayaraman Osbert Bastani Vikas Kumar Amy Zhang
+	Dynamics-aware Embeddings	2019	WILLIAM F. WHITNEY Rajat Agarwal Kyunghyun Cho Abhinav Gupta
+ PDF Chat	Time-Contrastive Networks: Self-Supervised Learning from Video	2018	Pierre Sermanet Corey Lynch Yevgen Chebotar Jasmine Hsu Eric Jang Stefan Schaal Sergey Levine Google Brain
+	Time-Contrastive Networks: Self-Supervised Learning from Video	2017	Pierre Sermanet Corey Lynch Yevgen Chebotar Jasmine Hsu Eric Jang Stefan Schaal Sergey Levine

Works That Cite This (16)

Action	Title	Year	Authors
+	Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning	2021	Bernie Wang Simon Xu Kurt Keutzer Yang Gao Bichen Wu
+	Semantic Visual Navigation by Watching YouTube Videos	2020	Matthew Chang Arjun Gupta Saurabh Gupta
+	Motion2Vec: Semi-Supervised Representation Learning from Surgical Videos	2020	Ajay Kumar Tanwani Pierre Sermanet Andy Yan Raghav Anand Mariano Phielipp Ken Goldberg
+ PDF Chat	Motion2Vec: Semi-Supervised Representation Learning from Surgical Videos	2020	Ajay Kumar Tanwani Pierre Sermanet Andy Yan Raghav Anand Mariano Phielipp Ken Goldberg
+	RIDM: Reinforced Inverse Dynamics Modeling for Learning from a Single Observed Demonstration	2019	Brahma S. Pavse Faraz Torabi Josiah P. Hanna Garrett Warnell Peter Stone
+	Recent Advances in Imitation Learning from Observation	2019	Faraz Torabi Garrett Warnell Peter Stone
+	Improving Sample Efficiency in Model-Free Reinforcement Learning from Images	2019	Denis Yarats Amy Zhang Ilya Kostrikov Brandon Amos Joëlle Pineau Rob Fergus
+ PDF Chat	Self-Supervised Disentangled Representation Learning for Third-Person Imitation Learning	2021	Jinghuan Shang Michael S. Ryoo
+	Active Perception and Representation for Robotic Manipulation.	2020	Youssef Zaky Gaurav Paruthi Bryan Tripp James Bergstra
+	Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels	2020	Ilya Kostrikov Denis Yarats Rob Fergus

Works Cited by This (22)

Action	Title	Year	Authors
+ PDF Chat	Learning Spatiotemporal Features with 3D Convolutional Networks	2015	Du Tran Lubomir Bourdev Rob Fergus Lorenzo Torresani Manohar Paluri
+ PDF Chat	Long-term recurrent convolutional networks for visual recognition and description	2015	Jeff Donahue Lisa Anne Hendricks Sergio Guadarrama Marcus Rohrbach Subhashini Venugopalan Trevor Darrell Kate Saenko
+	Continuous control with deep reinforcement learning	2015	Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver Daan Wierstra
+ PDF Chat	Rethinking the Inception Architecture for Computer Vision	2016	Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jon Shlens Zbigniew Wojna
+ PDF Chat	Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification	2016	Ishan Misra C. Lawrence Zitnick Martial Hebert
+	Loss is its own Reward: Self-Supervision for Reinforcement Learning	2016	Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell
+	PVEs: Position-Velocity Encoders for Unsupervised Learning of Structured State Representations.	2017	Rico Jonschkowski Roland Hafner Jonathan Scholz Martin Riedmiller
+	Proximal Policy Optimization Algorithms	2017	John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov
+	Unsupervised state representation learning with robotic priors: a robustness benchmark	2017	Timothée Lesort Mathieu Seurin Xinrui Li Natalia Díaz-Rodríguez David Filliat
+ PDF Chat	Time-Contrastive Networks: Self-Supervised Learning from Video	2018	Pierre Sermanet Corey Lynch Yevgen Chebotar Jasmine Hsu Eric Jang Stefan Schaal Sergey Levine Google Brain