Image-Goal Navigation in Complex Environments via Modular Learning

Type: Article

Publication Date: 2022-05-30

Citations: 4

DOI: https://doi.org/10.1109/lra.2022.3178810

Abstract

We present a novel approach for image-goal navigation, where an agent navigates with a goal image rather than accurate target information, which is more challenging. Our goal is to decouple the learning of navigation goal planning, collision avoidance, and navigation ending prediction, which enables more concentrated learning of each part. This is realized by four different modules. The first module maintains an obstacle map during robot navigation. The second predicts a long-term goal on the real-time map periodically, which can thus convert an image-goal navigation task to several point-goal navigation tasks. To achieve these point-goal navigation tasks, the third module plans collision-free command sets for navigating to these long-term goals. The final module stops the robot properly near the goal image. The four modules are designed or maintained separately, which helps cut down the search time during navigation and improve the generalization to previously unseen real scenes. We evaluate the method in both a simulator and in the real world with a mobile robot. The results in real complex environments show that our method attains at least a 17% increase in navigation success rate and a 23% decrease in navigation collision rate over some state-of-the-art models.

Locations

  • IEEE Robotics and Automation Letters - View
  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Image-Goal Navigation in Complex Environments via Modular Learning 2021 Qiaoyun Wu
Jun Wang
Jing Liang
Xiaoxi Gong
Dinesh Manocha
+ Hierarchical Image-Goal Navigation in Real Crowded Scenarios. 2021 Qiaoyun Wu
Jun Wang
Jing Liang
Xiaoxi Gong
Dinesh Manocha
+ Object Goal Navigation using Goal-Oriented Semantic Exploration 2020 Devendra Singh Chaplot
Dhiraj Gandhi
Abhinav Gupta
Ruslan Salakhutdinov
+ Subgoal-Driven Navigation in Dynamic Environments Using Attention-Based Deep Reinforcement Learning 2023 Jorge de Heuvel
Weixian Shi
Xiangyu Zeng
Maren Bennewitz
+ Combining Optimal Control and Learning for Visual Navigation in Novel Environments 2019 Somil Bansal
Varun Tolani
Saurabh Gupta
Jitendra Malik
Claire J. Tomlin
+ Building Intelligent Autonomous Navigation Agents 2021 Devendra Singh Chaplot
+ PDF Chat Interactive Semantic Map Representation for Skill-Based Visual Object Navigation 2024 Tatiana Zemskova
Aleksei Staroverov
Kirill Muravyev
Dmitry Yudin
Aleksandr I. Panov
+ Interactive Semantic Map Representation for Skill-based Visual Object Navigation 2023 Tatiana Zemskova
Aleksei Staroverov
Kirill Muravyev
Dmitry Yudin
Aleksandr I. Panov
+ Implicit Obstacle Map-driven Indoor Navigation Model for Robust Obstacle Avoidance 2023 Wei Xie
Haobo Jiang
Shuo Gu
Jin Xie
+ Combining Optimal Control and Learning for Visual Navigation in Novel Environments. 2019 Somil Bansal
Varun Tolani
Saurabh Gupta
Jitendra Malik
Claire J. Tomlin
+ Landmark Policy Optimization for Object Navigation Task 2021 Aleksey Staroverov
Aleksandr I. Panov
+ Goal-Driven Autonomous Mapping Through Deep Reinforcement Learning and Planning-Based Navigation. 2021 Reinis Cimurs
Il Hong Suh
Jin Han Lee
+ RECON: Rapid Exploration for Open-World Navigation with Latent Goal Models. 2021 Dhruv Shah
Benjamin Eysenbach
Nicholas Rhinehart
Sergey Levine
+ PDF Chat Enhancing Exploratory Capability of Visual Navigation Using Uncertainty of Implicit Scene Representation 2024 Yichen Wang
Qiming Liu
Zhe Liu
Hesheng Wang
+ ViNG: Learning Open-World Navigation with Visual Goals 2020 Dhruv Shah
Benjamin Eysenbach
Gregory Kahn
Nicholas Rhinehart
Sergey Levine
+ ViNG: Learning Open-World Navigation with Visual Goals 2020 Dhruv Shah
Benjamin Eysenbach
Gregory Kahn
Nicholas Rhinehart
Sergey Levine
+ PDF Chat ViNG: Learning Open-World Navigation with Visual Goals 2021 Dhruv Shah
Benjamin Eysenbach
Gregory Kahn
Nicholas Rhinehart
Sergey Levine
+ PDF Chat Learning Your Way Without Map or Compass: Panoramic Target Driven Visual Navigation 2020 David Watkins-Valls
Jingxi Xu
Nicholas R. Waytowich
Peter Allen
+ RECON: Rapid Exploration for Open-World Navigation with Latent Goal Models 2021 Dhruv Shah
Benjamin Eysenbach
Nicholas Rhinehart
Sergey Levine
+ PDF Chat Object Goal Navigation using Data Regularized Q-Learning 2022 Nandiraju Gireesh
D. A. Sasi Kiran
Snehasis Banerjee
Mohan Sridharan
Brojeshwar Bhowmick
Madhava Krishna

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (21)

Action Title Year Authors
+ PDF Chat Deep Residual Learning for Image Recognition 2016 Kaiming He
Xiangyu Zhang
Shaoqing Ren
Jian Sun
+ Proximal Policy Optimization Algorithms 2017 John Schulman
Filip Wolski
Prafulla Dhariwal
Alec Radford
Oleg Klimov
+ PDF Chat Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots 2018 Xin Ye
Zhe Lin
Haoxiang Li
Shibin Zheng
Yezhou Yang
+ CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios 2018 Tingxiang Fan
Xinjing Cheng
Jia Pan
Dinesh Manocha
Ruigang Yang
+ On Evaluation of Embodied Navigation Agents 2018 Peter Anderson
Anne Lynn S. Chang
Devendra Singh Chaplot
Alexey Dosovitskiy
Saurabh Gupta
Vladlen Koltun
Jana Košecká
Jitendra Malik
Roozbeh Mottaghi
Manolis Savva
+ PDF Chat Gibson Env: Real-World Perception for Embodied Agents 2018 Fei Xia
Amir Zamir
Zhiyang He
Alexander F. Sax
Jitendra Malik
Silvio Savarese
+ PDF Chat Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning 2019 Mitchell Wortsman
Kiana Ehsani
Mohammad Rastegari
Ali Farhadi
Roozbeh Mottaghi
+ PDF Chat Target-driven visual navigation in indoor scenes using deep reinforcement learning 2017 Yuke Zhu
Roozbeh Mottaghi
Eric Kolve
Joseph J. Lim
Abhinav Gupta
Li Fei-Fei
Ali Farhadi
+ PDF Chat Zero-Shot Visual Imitation 2018 Deepak Pathak
Parsa Mahmoudieh
Guanghao Luo
Pulkit Agrawal
Dian Chen
Fred Shentu
Evan Shelhamer
Jitendra Malik
Alexei A. Efros
Trevor Darrell
+ PDF Chat Habitat: A Platform for Embodied AI Research 2019 Manolis Savva
Abhishek Kadian
Oleksandr Maksymets
Yili Zhao
Erik Wijmans
Bhavana Jain
Julian Straub
Jia Liu
Vladlen Koltun
Jitendra Malik