Mapless Navigation among Dynamics with Social-safety-awareness: a reinforcement learning approach from 2D laser scans

Type: Preprint

Publication Date: 2020-05-01

Citations: 19

DOI: https://doi.org/10.1109/icra40945.2020.9197148

Download PDF

Abstract

We consider the problem of mapless collision-avoidance navigation where humans are present using 2D laser scans. Our proposed method uses ego-safety to measure collision from the robot's perspective and social-safety to measure the impact of robot's actions on surrounding pedestrians. Specifically, the social-safety part predicts the intrusion impact of the robot's action into the interaction area with surrounding humans. We train the policy using reinforcement learning on a simple simulator and directly evaluate the learned policy in Gazebo and real robot tests. Experiments show the learned policy smoothly transferred to different scenarios without any fine tuning. We observe that our method demonstrates time-efficient path planning behavior with high success rate in the mapless navigation task. Furthermore, we test our method in a navigation task among dynamic crowds, considering both low and high volume traffic. Our learned policy demonstrates cooperative behavior that actively drives our robot into traffic flows while showing respect to nearby pedestrians. Evaluation videos are at https://sites.google.com/view/ssw-batman.

Locations

  • arXiv (Cornell University) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ PDF Chat Socially-Aware Multi-Agent Following with 2D Laser Scans via Deep Reinforcement Learning and Potential Field 2021 Yuxiang Cui
Xiaolong Huang
Yue Wang
Rong Xiong
+ Socially-Aware Multi-Agent Following with 2D Laser Scans via Deep Reinforcement Learning and Potential Field 2021 Yuxiang Cui
Xiaolong Huang
Yue Wang
Rong Xiong
+ Deep Reinforcement Learning-Based Mapless Crowd Navigation with Perceived Risk of the Moving Crowd for Mobile Robots 2023 Hafiq Anas
Wee-Hong Ong
Owais Ahmed Malik
+ PDF Chat Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning 2021 Shunyi Yao
Guangda Chen
Quecheng Qiu
Jun Ma
Xiaoping Chen
Jianmin Ji
+ Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning 2021 Shunyi Yao
Guangda Chen
Quecheng Qiu
Jun Ma
Xiaoping Chen
Jianmin Ji
+ DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviors 2020 Adarsh Jagan Sathyamoorthy
Jing Liang
Utsav Patel
Tianrui Guan
Rohan Chandra
Dinesh Manocha
+ DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviors 2020 Adarsh Jagan Sathyamoorthy
Jing Liang
Utsav Patel
Tianrui Guan
Rohan Chandra
Dinesh Manocha
+ PDF Chat DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviors 2020 Adarsh Jagan Sathyamoorthy
Jing Liang
Utsav Patel
Tianrui Guan
Rohan Chandra
Dinesh Manocha
+ L2B: Learning to Balance the Safety-Efficiency Trade-off in Interactive Crowd-aware Robot Navigation 2020 Mai Nishimura
Ryo Yonetani
+ L2B: Learning to Balance the Safety-Efficiency Trade-off in Interactive Crowd-aware Robot Navigation 2020 Mai Nishimura
Ryo Yonetani
+ PDF Chat L2B: Learning to Balance the Safety-Efficiency Trade-off in Interactive Crowd-aware Robot Navigation 2020 Mai Nishimura
Ryo Yonetani
+ CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios 2018 Tingxiang Fan
Xinjing Cheng
Jia Pan
Dinesh Manocha
Ruigang Yang
+ Frozone: Freezing-Free, Pedestrian-Friendly Navigation in Human Crowds 2020 Adarsh Jagan Sathyamoorthy
Utsav Patel
Tianrui Guan
Dinesh Manocha
+ Frozone: Freezing-Free, Pedestrian-Friendly Navigation in Human Crowds 2020 Adarsh Jagan Sathyamoorthy
Utsav Patel
Tianrui Guan
Dinesh Manocha
+ PDF Chat Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulation 2024 Shuijing Liu
Kaiwen Hong
Neeloy Chakraborty
Katherine Driggs-Campbell
+ PDF Chat Frozone: Freezing-Free, Pedestrian-Friendly Navigation in Human Crowds 2020 Adarsh Jagan Sathyamoorthy
Utsav Patel
Tianrui Guan
Dinesh Manocha
+ Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation 2021 Linh Kästner
Junhui Li
Zhengcheng Shen
Jens Lambrecht
+ PDF Chat Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation 2022 Linh Kästner
Junhui Lil
Zhengcheng Shen
Jens Lambrecht
+ PDF Chat Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space 2024 Mahsa Golchoubian
Moojan Ghafurian
Kerstin Dautenhahn
Nasser L. Azad
+ PDF Chat Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space 2024 Mahsa Golchoubian
Moojan Ghafurian
Kerstin Dautenhahn
Nasser L. Azad

Works Cited by This (19)

Action Title Year Authors
+ Continuous control with deep reinforcement learning 2015 Timothy Lillicrap
Jonathan J. Hunt
Alexander Pritzel
Nicolas Heess
Tom Erez
Yuval Tassa
David Silver
Daan Wierstra
+ PDF Chat Socially aware motion planning with deep reinforcement learning 2017 Yu Fan Chen
Michael Everett
Miao Liu
Jonathan P. How
+ Learning End-to-end Multimodal Sensor Policies for Autonomous Navigation 2017 Guan-Horng Liu
Avinash Siravuru
Sai Prabhakar
Manuela Veloso
George Kantor
+ Proximal Policy Optimization Algorithms 2017 John Schulman
Filip Wolski
Prafulla Dhariwal
Alec Radford
Oleg Klimov
+ Intention-Net: Integrating Planning and Deep Learning for Goal-Directed Autonomous Navigation 2017 Wei Gao
David Hsu
Wee Sun Lee
Shengmei Shen
Karthikk Subramanian
+ Curiosity-driven Exploration for Mapless Navigation with Deep Reinforcement Learning 2018 Oleksii Zhelo
Jingwei Zhang
Lei Tai
Ming Liu
Wolfram Burgard
+ Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning 2018 Michael Everett
Yu Fan Chen
Jonathan P. How
+ CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios 2018 Tingxiang Fan
Xinjing Cheng
Jia Pan
Dinesh Manocha
Ruigang Yang
+ PDF Chat Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning 2019 Changan Chen
Yuejiang Liu
S. Kreiss
Alexandre Alahi
+ A Behavioral Approach to Visual Navigation with Graph Localization Networks 2019 Kevin Chen
Juan Pablo de Vicente
Gabriel Ocampo Sepúlveda
Fei Xia
Álvaro Soto
Marynel Vázquez
Silvio Savarese