STD: Sparse-to-Dense 3D Object Detector for Point Cloud

Type: Article

Publication Date: 2019-10-01

Citations: 741

DOI: https://doi.org/10.1109/iccv.2019.00204

Abstract

We propose a two-stage 3D object detection framework, named sparse-to-dense 3D Object Detector (STD). The first stage is a bottom-up proposal generation network that uses raw point clouds as input to generate accurate proposals by seeding each point with a new spherical anchor. It achieves a higher recall with less computation compared with prior works. Then, PointsPool is applied for proposal feature generation by transforming interior point features from sparse expression to compact representation, which saves even more computation. In box prediction, which is the second stage, we implement a parallel intersection-over-union (IoU) branch to increase awareness of localization accuracy, resulting in further improved performance. We conduct experiments on KITTI dataset, and evaluate our method on 3D object and Bird's Eye View (BEV) detection. Our method outperforms other methods by a large margin, especially on the hard set, with 10+ FPS inference speed.

Locations

  • arXiv (Cornell University) - View - PDF
  • 2021 IEEE/CVF International Conference on Computer Vision (ICCV) - View

Similar Works

Action Title Year Authors
+ STD: Sparse-to-Dense 3D Object Detector for Point Cloud 2019 Zetong Yang
Yanan Sun
Shu Liu
Xiaoyong Shen
Jiaya Jia
+ PDF Chat PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud 2019 Shaoshuai Shi
Xiaogang Wang
Hongsheng Li
+ PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud 2018 Shaoshuai Shi
Xiaogang Wang
Hongsheng Li
+ IPOD: Intensive Point-based Object Detector for Point Cloud 2018 Zetong Yang
Yanan Sun
Shu Liu
Xiaoyong Shen
Jiaya Jia
+ From Voxel to Point: IoU-guided 3D Object Detection for Point Cloud with Voxel-to-Point Decoder 2021 Jiale Li
Hang Dai
Ling Shao
Yong Ding
+ PDF Chat From Voxel to Point: IoU-guided 3D Object Detection for Point Cloud with Voxel-to-Point Decoder 2021 Jiale Li
Hang Dai
Ling Shao
Yong Ding
+ PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection 2019 Shaoshuai Shi
Chaoxu Guo
Li Jiang
Zhe Wang
Jianping Shi
Xiaogang Wang
Hongsheng Li
+ PDF Chat PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection 2020 Shaoshuai Shi
Chaoxu Guo
Li Jiang
Zhe Wang
Jianping Shi
Xiaogang Wang
Hongsheng Li
+ SparsePoint: Fully End-to-End Sparse 3D Object Detector. 2021 Zili Liu
Guodong Xu
Honghui Yang
Haifeng Liu
Deng Cai
+ SparseDet: Towards End-to-End 3D Object Detection 2022 Jianhong Han
Zhaoyi Wan
Zhe Liu
Jie Feng
Bingfeng Zhou
+ PDF Chat FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds 2019 Jie Zhou
Xin Tan
Zhiwen Shao
Lizhuang Ma
+ FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds 2019 Jie Zhou
Xin Tan
Zhiwei Shao
Lizhuang Ma
+ Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection 2021 Jiageng Mao
Minzhe Niu
Haoyue Bai
Xiaodan Liang
Hang Xu
Chunjing Xu
+ PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection 2021 Shaoshuai Shi
Li Jiang
Jiajun Deng
Zhe Wang
Chaoxu Guo
Jianping Shi
Xiaogang Wang
Hongsheng Li
+ Fast Point R-CNN 2019 Yilun Chen
Shu Liu
Xiaoyong Shen
Jiaya Jia
+ Fast Point R-CNN 2019 Yilun Chen
Shu Liu
Xiaoyong Shen
Jiaya Jia
+ PDF Chat 3DSSD: Point-Based 3D Single Stage Object Detector 2020 Zetong Yang
Yanan Sun
Shu Liu
Jiaya Jia
+ 3DSSD: Point-based 3D Single Stage Object Detector 2020 Zetong Yang
Yanan Sun
Shu Liu
Jiaya Jia
+ Part-A^2 Net: 3D Part-Aware and Aggregation Neural Network for Object Detection from Point Cloud 2019 Shaoshuai Shi
Zhe Wang
Xiaogang Wang
Hongsheng Li
+ Boundary-Aware 3D Object Detection from Point Clouds. 2021 Rui Qian
Xin Lai
Xirong Li

Works Cited by This (28)

Action Title Year Authors
+ TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems 2016 Martı́n Abadi
Ashish Agarwal
Paul Barham
Eugene Brevdo
Zhifeng Chen
Craig Citro
Gregory S. Corrado
Andy Davis
Jay B. Dean
Matthieu Devin
+ PDF Chat DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs 2017 Liang-Chieh Chen
George Papandreou
Iasonas Kokkinos
Kevin Murphy
Alan Yuille
+ PDF Chat Multi-view 3D Object Detection Network for Autonomous Driving 2017 Xiaozhi Chen
Huimin Ma
Ji Wan
Bo Li
Tian Xia
+ PDF Chat 3D fully convolutional network for vehicle detection in point cloud 2017 Bo Li
+ PDF Chat Pyramid Scene Parsing Network 2017 Hengshuang Zhao
Jianping Shi
Xiaojuan Qi
Xiaogang Wang
Jiaya Jia
+ PDF Chat PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation 2017 Raffaelli Charles
Hao Su
Kaichun Mo
Leonidas Guibas
+ PDF Chat Feature Pyramid Networks for Object Detection 2017 Tsung-Yi Lin
Piotr Dollár
Ross Girshick
Kaiming He
Bharath Hariharan
Serge Belongie
+ PDF Chat ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes 2017 Angela Dai
Anne Lynn S. Chang
Manolis Savva
Maciej Halber
Thomas Funkhouser
Matthias Nießner
+ Joint 3D Proposal Generation and Object Detection from View Aggregation 2017 Jason S. Ku
Melissa Mozifian
Jungwook Lee
Ali Harakeh
Steven L. Waslander
+ PDF Chat 3DMV: Joint 3D-Multi-view Prediction for 3D Semantic Scene Segmentation 2018 Angela Dai
Matthias Nießner