Distant Vehicle Detection Using Radar and Vision

Type: Article

Publication Date: 2019-05-01

Citations: 171

DOI: https://doi.org/10.1109/icra.2019.8794312

Abstract

For autonomous vehicles to be able to operate successfully they need to be aware of other vehicles with sufficient time to make safe, stable plans. Given the possible closing speeds between two vehicles, this necessitates the ability to accurately detect distant vehicles. Many current image-based object detectors using convolutional neural networks exhibit excellent performance on existing datasets such as KITTI. However, the performance of these networks falls when detecting small (distant) objects. We demonstrate that incorporating radar data can boost performance in these difficult situations. We also introduce an efficient automated method for training data generation using cameras of different focal lengths.

Locations

  • arXiv (Cornell University) - View - PDF
  • 2022 International Conference on Robotics and Automation (ICRA) - View

Similar Works

Action Title Year Authors
+ Distant Vehicle Detection Using Radar and Vision 2019 Simon Chadwick
Will Maddern
Paul Newman
+ Distant Vehicle Detection Using Radar and Vision 2019 Simon Chadwick
Will Maddern
P. R. Newman
+ A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection 2020 Felix Nobis
Maximilian Geisslinger
Markus Weber
Johannes Betz
Markus Lienkamp
+ A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection 2020 Felix Nobis
Maximilian Geisslinger
Markus Weber
Johannes Betz
Markus Lienkamp
+ PDF Chat A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection 2019 Felix Nobis
Maximilian Geisslinger
Markus Weber
Johannes Betz
Markus Lienkamp
+ NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Driving 2022 А. В. Попов
Patrik Gebhardt
Ke Chen
Ryan Oldja
Heeseok Lee
Shane Murray
Ruchi Bhargava
Nikolai Smolyanskiy
+ RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects 2020 Bin Yang
Runsheng Benson Guo
Ming Liang
Sergio Casas
Raquel Urtasun
+ PDF Chat See Further Than CFAR: a Data-Driven Radar Detector Trained by Lidar 2024 Ignacio Roldan
Andras Palffy
Julian F. P. Kooij
Dariu M. Gavrila
Francesco Fioranelli
Alexander Yarovoy
+ PDF Chat RadSimReal: Bridging the Gap Between Synthetic and Real Data in Radar Object Detection With Simulation 2024 Oded Bialer
Yuval Haitman
+ CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detection 2022 Jyh-Jing Hwang
Henrik Kretzschmar
Joshua Manela
Sean M. Rafferty
Nicholas Armstrong-Crews
Tiffany Chen
Dragomir Anguelov
+ PDF Chat Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors 2024 Lei Cheng
Arindam Sengupta
Siyang Cao
+ PDF Chat A Survey of Deep Learning Based Radar and Vision Fusion for 3D Object Detection in Autonomous Driving 2024 Di Wu
Feng Yang
Benlian Xu
Pan Liao
Bo Liu
+ RODNet: Radar Object Detection Using Cross-Modal Supervision 2020 Yizhou Wang
Zhongyu Jiang
Xiangyu Gao
Jenq‐Neng Hwang
Guanbin Xing
Hui Liu
+ PDF Chat RODNet: Radar Object Detection using Cross-Modal Supervision 2021 Yizhou Wang
Zhongyu Jiang
Xiangyu Gao
Jenq‐Neng Hwang
Guanbin Xing
Hui Liu
+ PDF Chat RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization 2021 Yizhou Wang
Zhongyu Jiang
Yudong Li
Jenq‐Neng Hwang
Guanbin Xing
Hui Liu
+ A Recurrent CNN for Online Object Detection on Raw Radar Frames 2024 Colin Decourt
Rufin VanRullen
Didier Salle
Thomas Oberlin
+ A recurrent CNN for online object detection on raw radar frames 2022 Colin Decourt
Rufin VanRullen
Didier Salle
Thomas Oberlin
+ RadarFormer: Lightweight and Accurate Real-Time Radar Object Detection Model 2023 Yahia Dalbah
Jean Lahoud
Hisham Cholakkal
+ RC-BEVFusion: A Plug-In Module for Radar-Camera Bird's Eye View Feature Fusion 2023 Lukas Stäcker
Shashank Mishra
Philipp Heidenreich
Jason Rambach
Didier Stricker
+ Probabilistic Oriented Object Detection in Automotive Radar 2020 Xu Dong
Pengluo Wang
Pengyue Zhang
Langechuan Liu

Works That Cite This (48)

Action Title Year Authors
+ PDF Chat Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review 2023 Shanliang Yao
Runwei Guan
Xiaoyu Huang
Zhuoxiao Li
Xiangyu Sha
Yong Yue
Eng Gee Lim
Hyungjoon Seo
Ka Lok Man
Xiaohui Zhu
+ PDF Chat CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detection 2021 Ramin Nabati
Hairong Qi
+ PDF Chat Bridging the View Disparity Between Radar and Camera Features for Multi-Modal Fusion 3D Object Detection 2023 Taohua Zhou
Junjie Chen
Yining Shi
Kun Jiang
Mengmeng Yang
Diange Yang
+ PDF Chat Accurate Cooperative Sensor Fusion by Parameterized Covariance Generation for Sensing and Localization Pipelines in CAVs 2022 Edward Andert
Aviral Shrivastava
+ PDF Chat Structural Information Guided Multimodal Pre-training for Vehicle-Centric Perception 2024 Xiao Wang
Wentao Wu
Chenglong Li
Zhicheng Zhao
Zhe Chen
Yukai Shi
Jin Tang
+ PDF Chat Boosting 3D Object Detection by Simulating Multimodality on Point Clouds 2022 Zheng Wu
Mingxuan Hong
Li Jiang
Chi‐Wing Fu
+ MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review 2021 Zhiqing Wei
Fengkai Zhang
Shuo Chang
Yangyang Liu
Huici Wu
Zhiyong Feng
+ PDF Chat 3D Object Detection for Autonomous Driving: A Comprehensive Survey 2023 Jiageng Mao
Shaoshuai Shi
Xiaogang Wang
Hongsheng Li
+ PDF Chat Milestones in Autonomous Driving and Intelligent Vehicles—Part II: Perception and Planning 2023 Long Chen
Siyu Teng
Bai Li
Xiaoxiang Na
Yuchen Li
Zixuan Li
Jinjun Wang
Dongpu Cao
Nanning Zheng
Fei‐Yue Wang
+ PDF Chat Multi-Task Cross-Modality Attention-Fusion for 2D Object Detection 2023 Huawei Sun
Hao Feng
Georg Stettinger
Lorenzo Servadei
Robert Wille