VGPN: Voice-Guided Pointing Robot Navigation for Humans

Type: Article

Publication Date: 2018-12-01

Citations: 10

DOI: https://doi.org/10.1109/robio.2018.8664854

Abstract

Pointing gestures are widely used in robot navigation approaches nowadays. However, most approaches only use pointing gestures, and these have two major limitations. Firstly, they need to recognize pointing gestures all the time, which leads to long processing time and significant system overheads. Secondly, the user's pointing direction may not be very accurate, so the robot may go to an undesired place. To relieve these limitations, we propose a voice-guided pointing robot navigation approach named VGPN, and implement its prototype on a wheeled robot, TurtleBot 2. VGPN recognizes a pointing gesture only if voice information is insufficient for navigation. VGPN also uses voice information as a supplementary channel to help determine the target position of the user's pointing gesture. In the evaluation, we compare VGPN to the pointing-only navigation approach. The results show that VGPN effectively reduces the processing time cost when pointing gesture is unnecessary, and improves the user satisfaction with navigation accuracy.

Locations

  • arXiv (Cornell University) - View - PDF
  • 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO) - View
  • DataCite API - View

Similar Works

Action Title Year Authors
+ PDF Chat A survey on human-aware robot navigation 2021 Ronja MĂśller
Antonino Furnari
Sebastiano Battiato
Aki Härmä
Giovanni Maria Farinella
+ PDF Chat Automatic Navigation and Voice Cloning Technology Deployment on a Humanoid Robot 2024 Dongkun Han
Boyuan Shao
+ PDF Chat "Pass the butter": A study on desktop-classic multitasking robotic arm based on advanced YOLOv7 and BERT 2024 Haohua Que
Wenbin Pan
Jie Xu
Hao Luo
Pei Wang
Li Zhang
+ PDF Chat HyperPalm: DNN-based hand gesture recognition interface for intelligent communication with quadruped robot in 3D space 2022 Elena Nazarova
Ildar Babataev
Nipun Weerakkodi
Aleksey Fedoseev
Dzmitry Tsetserukou
+ HyperPalm: DNN-based hand gesture recognition interface for intelligent communication with quadruped robot in 3D space 2022 E. Nazarova
Ildar Babataev
Nipun Weerakkodi
Aleksey Fedoseev
Dzmitry Tsetserukou
+ PDF Chat Walk along: An Experiment on Controlling the Mobile Robot 'Spot' with Voice and Gestures 2024 Renchi Zhang
Jesse van der Linden
Dimitra Dodou
Harleigh Seyffert
Yke Bauke Eisma
Joost de Winter
+ Voice Recognition Robot with Real-Time Surveillance and Automation 2023 Lochan Basyal
+ Designing a Wayfinding Robot for People with Visual Impairments 2023 Shuijing Liu
Aamir Hasan
Kaiwen Hong
Chun-Kai Yao
Justin Lin
Weihang Liang
Megan A. Bayles
Wendy A. Rogers
Katherine Driggs-Campbell
+ PDF Chat Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation 2024 Yinpei Dai
Run Peng
Sikai Li
Joyce Chai
+ PDF Chat Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene 2021 Qi Wu
Cheng-Ju Wu
Yixin Zhu
Jungseock Joo
+ PDF Chat Robot voice a voice controlled robot using arduino 2024 Vineeth Teeda
K. Sujatha
Rakesh Mutukuru
+ PDF Chat On the Design of Human-Robot Collaboration Gestures 2024 Anas Shrinah
Masoud S. Bahraini
Fahad Khan
S. A. Syed Asif
Niels Lohse
Kerstin Eder
+ AR Point&Click: An Interface for Setting Robot Navigation Goals 2022 Morris Gu
Elizabeth Croft
Akansel Cosgun
+ Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene 2021 Qi Wu
Cheng-Ju Wu
Yixin Zhu
Jungseock Joo
+ PDF Chat ResQbot: A Mobile Rescue Robot with Immersive Teleperception for Casualty Extraction 2018 Roni Permana Saputra
Petar Kormushev
+ PDF Chat See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot 2024 Rayna Hata
Narit Trikasemsak
Andrea Giudice
Stacy A. Doore
+ PDF Chat A Mini-Review on Mobile Manipulators with Variable Autonomy 2024 Cesar Alan Contreras
Alireza Rastegarpanah
Rustam Stolkin
Manolis Chiou
+ PDF Chat Integrating Persian Lip Reading in Surena-V Humanoid Robot for Human-Robot Interaction 2025 Ali Abbasi
Aghil Yousefi‐Koma
Soheil Dehghani Firouzabadi
Parisa Rashidi
Alireza Naeini
+ PDF Chat Projecting Robot Navigation Paths: Hardware and Software for Projected AR 2022 Han Zhao
Jenna Parrillo
Alexander S. Wilkinson
Holly A. Yanco
Tom Williams
+ Projecting Robot Navigation Paths: Hardware and Software for Projected AR 2021 Han Zhao
Jenna Parrillo
Alexander S. Wilkinson
Holly A. Yanco
Tom Williams