SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again

Type: Article

Publication Date: 2017-10-01

Citations: 937

DOI: https://doi.org/10.1109/iccv.2017.169

Download PDF

Abstract

We present a novel method for detecting 3D model instances and estimating their 6D poses from RGB data in a single shot. To this end, we extend the popular SSD paradigm to cover the full 6D pose space and train on synthetic model data only. Our approach competes or surpasses current state-of-the-art methods that leverage RGBD data on multiple challenging datasets. Furthermore, our method produces these results at around 10Hz, which is many times faster than the related methods. For the sake of reproducibility, we make our trained networks and detection code publicly available.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ SSD-6D: Making RGB-based 3D detection and 6D pose estimation great again 2017 Wadim Kehl
Fabian Manhardt
Federico Tombari
Slobodan Ilić
Nassir Navab
+ SSD-6D: Making RGB-based 3D detection and 6D pose estimation great again 2017 Wadim Kehl
Fabian Manhardt
Federico Tombari
Slobodan Ilić
Nassir Navab
+ DPOD: Dense 6D Pose Object Detector in RGB images 2019 Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects 2019 Roman Kaskman
Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects 2019 Roman Kaskman
Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ PDF Chat HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects 2019 Roman Kaskman
Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ EfficientPose: An efficient, accurate and scalable end-to-end 6D multi object pose estimation approach 2020 Yannick Bukschat
Marcus Vetter
+ Inferring 3D Object Pose in RGB-D Images 2015 Saurabh Gupta
Pablo Arbeláez
Ross Girshick
Jitendra Malik
+ Deep-6DPose: Recovering 6D Object Pose from a Single RGB Image 2018 Thanh-Toan Do
Ming Cai
Trung Pham
Ian Reid
+ DPOD: 6D Pose Object Detector and Refiner 2019 Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ PDF Chat DPOD: 6D Pose Object Detector and Refiner 2019 Sergey Zakharov
Ivan Shugurov
Slobodan Ilić
+ PDF Chat RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images 2024 Zong-Wei Hong
Yen-Yang Hung
Chu-Song Chen
+ PDF Chat Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation 2024 Mengchen Zhang
Tong Wu
Tai Wang
Tengfei Wang
Ziwei Liu
Dahua Lin
+ Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Dataset 2022 Yang Fu
Xiaolong Wang
+ PDF Chat Real-Time Seamless Single Shot 6D Object Pose Prediction 2018 Bugra Tekin
Sudipta N. Sinha
Pascal Fua
+ PDF Chat Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking 2024 Jiyao Zhang
Weiyao Huang
Bo Peng
Mingdong Wu
Fei Hu
Zijian Chen
Bo Zhao
Hao Dong
+ MobilePose: Real-Time Pose Estimation for Unseen Objects with Weak Shape Supervision 2020 Tingbo Hou
Adel Ahmadyan
Liangkai Zhang
Jianing Wei
Matthias Grundmann
+ Real-Time Seamless Single Shot 6D Object Pose Prediction 2017 Bugra Tekin
Sudipta N. Sinha
Pascal Fua
+ Real-Time Seamless Single Shot 6D Object Pose Prediction 2017 Bugra Tekin
Sudipta N. Sinha
Pascal Fua
+ Single Shot 6D Object Pose Estimation 2020 Kilian Kleeberger
Marco F. Huber

Works That Cite This (372)

Action Title Year Authors
+ PDF Chat Deep learning-based spacecraft relative navigation methods: A survey 2021 Jianing Song
Duarte Rondao
Nabil Aouf
+ PDF Chat Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions 2022 Van Nguyen Nguyen
Yinlin Hu
Yang Xiao
Mathieu Salzmann
Vincent Lepetit
+ PDF Chat PhoCaL: A Multi-Modal Dataset for Category-Level Object Pose Estimation with Photometrically Challenging Objects 2022 Pengyuan Wang
Hyunjun Jung
Yitong Li
Siyuan Shen
Rahul Parthasarathy Srikanth
Lorenzo Garattoni
Sven Meier
Nassir Navab
Benjamin Busam
+ PDF Chat iCaps: Iterative Category-Level Object Pose and Shape Estimation 2022 Xinke Deng
Junyi Geng
Timothy Bretl
Yu Xiang
Dieter Fox
+ PDF Chat Bridging the Reality Gap for Pose Estimation Networks using Sensor-Based Domain Randomization 2021 Frederik Hagelskjar
Anders Glent Buch
+ FPCC-Net: Fast Point Cloud Clustering for Instance Segmentation. 2020 Yajun Xu
Shogo Arai
Diyi Liu
Fangzhou Lin
Kazuhiro Kosuge
+ PDF Chat Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review 2020 Guoguang Du
Kai Wang
Shiguo Lian
Kaiyong Zhao
+ DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries 2021 Yue Wang
Vitor Guizilini
Tianyuan Zhang
Yilun Wang
Hang Zhao
Justin Solomon
+ DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field 2023 Haowen Wang
Zhipeng Fan
Zhen Zhao
Zhengping Che
Zhiyuan Xu
Dong Liu
Feifei Feng
Yakun Huang
Xiuquan Qiao
Jian Tang
+ PDF Chat CRT-6D: Fast 6D Object Pose Estimation with Cascaded Refinement Transformers 2023 Pedro Castro
Tae‐Kyun Kim

Works Cited by This (12)

Action Title Year Authors
+ PDF Chat Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition 2015 Kaiming He
Xiangyu Zhang
Shaoqing Ren
Jian Sun
+ PDF Chat ImageNet Large Scale Visual Recognition Challenge 2015 Olga Russakovsky
Jia Deng
Hao Su
Jonathan Krause
Sanjeev Satheesh
Sean Ma
Zhiheng Huang
Andrej Karpathy
Aditya Khosla
Michael S. Bernstein
+ PDF Chat Fast Supervised Hashing with Decision Trees for High-Dimensional Data 2014 Guosheng Lin
Chunhua Shen
Qinfeng Shi
Anton van den Hengel
David Suter
+ PDF Chat PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization 2015 Alex Kendall
Matthew Koichi Grimes
Roberto Cipolla
+ 6D Object Detection and Next-Best-View Prediction in the Crowd. 2015 Andreas Doumanoglou
Rigas Kouskouridas
Sotiris Malassiotis
Tae‐Kyun Kim
+ PDF Chat 3D Bounding Box Estimation Using Deep Learning and Geometry 2017 Arsalan Mousavian
Dragomir Anguelov
John P. Flynn
Jana Košecká
+ PDF Chat Feature Pyramid Networks for Object Detection 2017 Tsung-Yi Lin
Piotr Dollár
Ross Girshick
Kaiming He
Bharath Hariharan
Serge Belongie
+ PDF Chat You Only Look Once: Unified, Real-Time Object Detection 2016 Joseph Redmon
Santosh Divvala
Ross Girshick
Ali Farhadi
+ Hashmod: A Hashing Method for Scalable 3D Object Detection 2015 Wadim Kehl
Federico Tombari
Nassir Navab
Slobodan Ilić
Vincent Lepetit
+ PDF Chat Fast Single Shot Detection and Pose Estimation 2016 Patrick Poirson
Phil Ammirato
Cheng-Yang Fu
Wei Liu
Jana Košecká
Alexander C. Berg