RangeDet: In Defense of Range View for LiDAR-based 3D Object Detection

Type: Article

Publication Date: 2021-10-01

Citations: 164

DOI: https://doi.org/10.1109/iccv48922.2021.00291

Abstract

In this paper, we propose an anchor-free single-stage LiDAR-based 3D object detector – RangeDet. The most notable difference with previous works is that our method is purely based on the range view representation. Compared with the commonly used voxelized or Bird's Eye View (BEV) representations, the range view representation is more compact and without quantization error. Although there are works adopting it for semantic segmentation, its performance in object detection is largely behind voxelized or BEV counterparts. We first analyze the existing range-view-based methods and find two issues overlooked by previous works: 1) the scale variation between nearby and far away objects; 2) the inconsistency between the 2D range image coordinates used in feature extraction and the 3D Cartesian coordinates used in output. Then we deliberately design three components to address these issues in our RangeDet. We test our RangeDet in the large-scale Waymo Open Dataset (WOD). Our best model achieves 72.9/75.9/65.8 3D AP on vehicle/pedestrian/cyclist. These results outperform other range-view-based methods by a large margin, and are overall comparable with the state-of-the-art multi-view-based methods. Codes will be released at https://github.com/TuSimple/RangeDet.

Locations

  • arXiv (Cornell University) - View - PDF
  • 2021 IEEE/CVF International Conference on Computer Vision (ICCV) - View

Works That Cite This (72)

Action Title Year Authors
+ PDF Chat PseudoAugment: Learning to Use Unlabeled Data for Data Augmentation in Point Clouds 2022 Zhaoqi Leng
Shuyang Cheng
Benjamin Caine
Weiyue Wang
Zhang Xiao
Jonathon Shlens
Mingxing Tan
Dragomir Anguelov
+ PDF Chat INT: Towards Infinite-Frames 3D Detection with an Efficient Framework 2022 Jianyun Xu
Zhenwei Miao
Da Zhang
Hongyu Pan
Kaixuan Liu
Peihan Hao
Jun Zhu
Zhengyang Sun
Hongmin Li
Xin Zhan
+ PDF Chat BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation 2023 Zhijian Liu
Haotian Tang
Alexander Amini
Xinyu Yang
Huizi Mao
Daniela Rus
Song Han
+ PDF Chat Li3DeTr: A LiDAR based 3D Detection Transformer 2023 Gopi Krishna Erabati
Hélder Araújo
+ PDF Chat Super Sparse 3D Object Detection 2023 Lue Fan
Yuxue Yang
Wang Feng
Naiyan Wang
Zhaoxiang Zhang
+ PDF Chat Embracing Single Stride 3D Object Detector with Sparse Transformer 2022 Lue Fan
Ziqi Pang
Tianyuan Zhang
Yu-Xiong Wang
Hang Zhao
Feng Wang
Naiyan Wang
Zhaoxiang Zhang
+ PDF Chat LidarNAS: Unifying and Searching Neural Architectures for 3D Point Clouds 2022 Chenxi Liu
Zhaoqi Leng
Pei Sun
Shuyang Cheng
Charles R. Qi
Yin Zhou
Mingxing Tan
Dragomir Anguelov
+ PDF Chat Motion Inspired Unsupervised Perception and Prediction in Autonomous Driving 2022 Mahyar Najibi
Jingwei Ji
Yin Zhou
Charles R. Qi
Xinchen Yan
Scott Ettinger
Dragomir Anguelov
+ PDF Chat Boosting 3D Object Detection by Simulating Multimodality on Point Clouds 2022 Zheng Wu
Mingxuan Hong
Li Jiang
Chi‐Wing Fu
+ PDF Chat Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completion 2022 Xiaopei Wu
Peng Liang
Honghui Yang
Liang Xie
Chenxi Huang
Chengqi Deng
Xuelong Li
Deng Cai