UAV Localization Using Autoencoded Satellite Images

Type: Article

Publication Date: 2021-02-20

Citations: 61

DOI: https://doi.org/10.1109/lra.2021.3060397

Abstract

We propose and demonstrate a fast, robust method for using satellite images to localize an Unmanned Aerial Vehicle (UAV). Previous work using satellite images has large storage and computation costs and is unable to run in real time. In this work, we collect Google Earth (GE) images for a desired flight path offline and an autoencoder is trained to compress these images to a low-dimensional vector representation while retaining the key features. This trained autoencoder is used to compress a real UAV image, which is then compared to the precollected, nearby, autoencoded GE images using an inner-product kernel. This results in a distribution of weights over the corresponding GE image poses and is used to generate a single localization and associated covariance to represent uncertainty. Our localization is computed in 1% of the time of the current standard and is able to achieve a comparable RMSE of less than 3 m in our experiments, where we robustly matched UAV images from six runs spanning the lighting conditions of a single day to the same map of satellite images.

Locations

  • IEEE Robotics and Automation Letters - View
  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ UAV Localization Using Autoencoded Satellite Images 2021 Mollie Bianchi
Timothy D. Barfoot
+ UAV Localization Using Autoencoded Satellite Images 2021 Mollie Bianchi
Timothy D. Barfoot
+ PDF Chat Leveraging edge detection and neural networks for better UAV localization 2024 Théo Di Piazza
Enric Meinhardt-Llopis
Gabriele Facciolo
B. Bascle
Corentin Abgrall
Jean-Clément Devaux
+ LSVL: Large-scale season-invariant visual localization for UAVs 2022 Jouko Kinnari
Riccardo Renzulli
Francesco Verdoja
Ville Kyrki
+ LSVL: Large-scale season-invariant visual localization for UAVs 2023 Jouko Kinnari
Riccardo Renzulli
Francesco Verdoja
Ville Kyrki
+ PDF Chat Vision-Based UAV Self-Positioning in Low-Altitude Urban Environments 2023 Ming Dai
Enhui Zheng
Zhenhua Feng
Lei Qi
Jiedong Zhuang
Wankou Yang
+ Vision-Based UAV Self-Positioning in Low-Altitude Urban Environments 2022 Yong Dai
Jinglin Huang
Jiedong Zhuang
Wenbo Lan
Yongheng Cai
Enhui Zheng
+ FoundLoc: Vision-based Onboard Aerial Localization in the Wild 2023 Yao He
Iván Cisneros
Nikhil Keetha
Jay Patrikar
Zelin Ye
Ian Higgins
Yaoyu Hu
Parv Kapoor
Sebastian Scherer
+ PDF Chat UAV-VisLoc: A Large-scale Dataset for UAV Visual Localization 2024 Wenjia Xu
Yaxuan Yao
Jiaqi Cao
Zhiwei Wei
Chunbo Liu
Jiuniu Wang
Mugen Peng
+ PDF Chat Season-Invariant GNSS-Denied Visual Localization for UAVs 2022 Jouko Kinnari
Francesco Verdoja
Ville Kyrki
+ A Gis Aided Approach for Geolocalizing an Unmanned Aerial System Using Deep Learning 2022 Jianli Wei
Deniz Karakay
Alper Yılmaz
+ Real-time Geo-localization Using Satellite Imagery and Topography for Unmanned Aerial Vehicles 2021 Shuxiao Chen
Xiangyu Wu
Mark W. Mueller
Koushil Sreenath
+ PDF Chat Real-time Geo-localization Using Satellite Imagery and Topography for Unmanned Aerial Vehicles 2021 Shuxiao Chen
Xiangyu Wu
Mark W. Mueller
Koushil Sreenath
+ PDF Chat A Gis Aided Approach for Geolocalizing an Unmanned Aerial System Using Deep Learning 2022 Jianli Wei
Deniz Karakay
Alper Yılmaz
+ Long-range UAV Thermal Geo-localization with Satellite Imagery 2023 Jiuhong Xiao
Daniel Tortei
Eloy Roura
Giuseppe Loianno
+ PDF Chat Vision-Based GNSS-Free Localization for UAVs in the Wild 2022 Marius-Mihail Gurgu
Jorge Peña Queralta
Tomi Westerlund
+ Vision-based GNSS-Free Localization for UAVs in the Wild 2022 Marius-Mihail Gurgu
Jorge Peña Queralta
Tomi Westerlund
+ PDF Chat STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagery 2024 Jiuhong Xiao
Ning Zhang
Daniel Tortei
Giuseppe Loianno
+ UAV Pose Estimation using Cross-view Geolocalization with Satellite Imagery 2018 Akshay Shetty
Grace Xingxin Gao
+ UAV Pose Estimation using Cross-view Geolocalization with Satellite Imagery 2018 Akshay Shetty
Grace Xingxin Gao

Works That Cite This (14)

Action Title Year Authors
+ High-Fidelity Face Swapping with Style Blending 2022 Xinyu Yang
Zhijin Guo
Mowen Xue
Zijian Shi
+ PDF Chat iSimLoc: Visual Global Localization for Previously Unseen Environments With Simulated Images 2023 Peng Yin
Iván Cisneros
Shiqi Zhao
Ji Zhang
Howie Choset
Sebastian Scherer
+ PDF Chat Long-Range UAV Thermal Geo-Localization with Satellite Imagery 2023 Jiuhong Xiao
Daniel Tortei
Eloy Roura
Giuseppe Loianno
+ PDF Chat STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagery 2024 Jiuhong Xiao
Ning Zhang
Daniel Tortei
Giuseppe Loianno
+ Classification of electromagnetic interference induced image noise in an analog video link 2022 Anthony W. Purcell
Ciarán Eising
+ PDF Chat Season-Invariant GNSS-Denied Visual Localization for UAVs 2022 Jouko Kinnari
Francesco Verdoja
Ville Kyrki
+ KinePose: A temporally optimized inverse kinematics technique for 6DOF human pose estimation with biomechanical constraints 2022 Kevin Gildea
Clara Mercadal-Baudart
Richard Blythman
Aljoša Smolić
Ciaran Simms
+ PDF Chat Real-time Geo-localization Using Satellite Imagery and Topography for Unmanned Aerial Vehicles 2021 Shuxiao Chen
Xiangyu Wu
Mark W. Mueller
Koushil Sreenath
+ View Sub-sampling and Reconstruction for Efficient Light Field Compression 2022 Yang Chen
Martin Alain
Aljoša Smolić
+ Dynamic Channel Selection in Self-Supervised Learning 2022 Tarun Krishna
Ayush Rai
Yasser Abdelaziz Dahou Djilali
Alan F. Smeaton
Kevin McGuinness
Noel E. O’Connor