Indoor 3D Reconstruction with an Unknown Camera-Projector Pair

Type: Preprint

Publication Date: 2024-07-02

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2407.01945

Abstract

Structured light-based method with a camera-projector pair (CPP) plays a vital role in indoor 3D reconstruction, especially for scenes with weak textures. Previous methods usually assume known intrinsics, which are pre-calibrated from known objects, or self-calibrated from multi-view observations. It is still challenging to reliably recover CPP intrinsics from only two views without any known objects. In this paper, we provide a simple yet reliable solution. We demonstrate that, for the first time, sufficient constraints on CPP intrinsics can be derived from an unknown cuboid corner (C2), e.g. a room's corner, which is a common structure in indoor scenes. In addition, with only known camera principal point, the complex multi-variable estimation of all CPP intrinsics can be simplified to a simple univariable optimization problem, leading to reliable calibration and thus direct 3D reconstruction with unknown CPP. Extensive results have demonstrated the superiority of the proposed method over both traditional and learning-based counterparts. Furthermore, the proposed method also demonstrates impressive potential to solve similar tasks without active lighting, such as sparse-view structure from motion.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat Sparis: Neural Implicit Surface Reconstruction of Indoor Scenes from Sparse Views 2025 Yulun Wu
Han Huang
Wenyuan Zhang
Chao Deng
Ge Gao
Ming Gu
Yu-Shen Liu
+ Planar Surface Reconstruction from Sparse Views 2021 Linyi Jin
Shengyi Qian
Andrew Owens
David F. Fouhey
+ Planar Surface Reconstruction from Sparse Views. 2021 Linyi Jin
Shengyi Qian
Andrew Owens
David F. Fouhey
+ PDF Chat Planar Surface Reconstruction from Sparse Views 2021 Linyi Jin
Shengyi Qian
Andrew Owens
David F. Fouhey
+ PDF Chat Towards High-Fidelity Single-View Holistic Reconstruction of Indoor Scenes 2022 Haolin Liu
Yujian Zheng
Guanying Chen
Shuguang Cui
Xiaoguang Han
+ PDF Chat Sparse Views, Near Light: A Practical Paradigm for Uncalibrated Point-light Photometric Stereo 2024 Mohammed Brahimi
Bjoern Haefner
Zhenzhang Ye
Bastian Goldlüecke
Daniel Cremers
+ PDF Chat Floorplan-Aware Camera Poses Refinement 2022 Anna Sokolova
Filipp Nikitin
Anna Vorontsova
Anton Konushin
+ PDF Chat Towards Unified Structured Light Optimization 2025 Tinglei Wan
Tonghua Su
Zhongjie Wang
+ Exploiting Multiple Priors for Neural 3D Indoor Reconstruction 2023 Federico Lincetto
Gianluca Agresti
Mattia Rossi
Pietro Zanuttigh
+ PDF Chat Plane-Based Optimization of Geometry and Texture for RGB-D Reconstruction of Indoor Scenes 2018 Chao Wang
Xiaohu Guo
+ Floorplan-Aware Camera Poses Refinement 2022 Anna Sokolova
Filipp Nikitin
Анна Воронцова
Anton Konushin
+ Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Image 2021 Cheng Yang
Jia Zheng
Xili Dai
Rui Tang
Yi Ma
Xiaojun Yuan
+ 3D Scene Reconstruction with Multi-layer Depth and Epipolar Transformers. 2019 Daeyun Shin
Zhile Ren
Erik B. Sudderth
Charless C. Fowlkes
+ SparsePose: Sparse-View Camera Pose Regression and Refinement 2022 Samarth Sinha
Jason Zhang
Andrea Tagliasacchi
Igor Gilitschenski
David B. Lindell
+ Learning to Reconstruct and Understand Indoor Scenes from Sparse Views 2019 Jingyu Yang
Ji Xu
Kun Li
Yu‐Kun Lai
Huanjing Yue
Jianzhi Lu
Hao Wu
Yebin Liu
+ PDF Chat 3D Scene Reconstruction With Multi-Layer Depth and Epipolar Transformers 2019 Daeyun Shin
Zhile Ren
Erik B. Sudderth
Charless C. Fowlkes
+ 3D Scene Reconstruction with Multi-layer Depth and Epipolar Transformers 2019 Daeyun Shin
Zhile Ren
Sudderth Erik
Fowlkes Charless
+ Real-time Indoor Scene Reconstruction with RGBD and Inertia Input 2018 Zunjie Zhu
Feng Xu
+ PDF Chat A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras 2018 Qi Zhang
Chunping Zhang
Jinbo Ling
Qing Wang
Jingyi Yu
+ A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras 2018 Qi Zhang
Chunping Zhang
Jinbo Ling
Qing Wang
Jingyi Yu

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (0)

Action Title Year Authors