DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion
cs.CV
Submitted: 2026-07-10
Updated: 2026-10-12
Comments: Accepted to ACCV 2026
Code: https://github.com/sithu31296/DGSfM
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Global Structure-from-Motion (SfM) is an efficient paradigm for recovering camera poses and sparse 3D structure from unordered images.
Terminology
Abstract
Global Structure-from-Motion (SfM) is an efficient paradigm for recovering camera poses and sparse 3D structure from unordered images. However, its reliance on scale-ambiguous epipolar geometry makes global positioning sensitive to noisy baseline estimates and weak view-graph constraints, while false edges from visually ambiguous pairs can further degrade reconstruction. We propose DGSfM, a depth-aware global SfM pipeline that uses monocular depth maps as a scalable prior while preserving explicit multi-view optimization. For each image pair, we use a depth-aware relative pose solver to convert scale-ambiguous epipolar constraints into scale-aware relative pose constraints. We further improve robustness through view-graph filtering and depth-consistency-based correspondence pruning, which suppress false edges and matches that remain plausible under epipolar geometry alone. Finally, global scale averaging and depth-guided pose-point initialization align monocular depth maps into a common reconstruction scale and provide stable initialization for global positioning and bundle adjustment. Experiments on ETH3D and IMC2021 show that DGSfM consistently improves over strong global SfM baselines across sparse and dense matching front-ends, achieving substantial gains in pose accuracy. Code and project page: https://dgsfm.github.io/.
Sources
- Distributed Global Structure-from-Motion with a Deep Front-End
- MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimation
- VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequences
- RoMa v2: Harder Better Faster Denser Feature Matching
- Depth Anything 3: Recovering the Visual Space from Any Views
- Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis
- LoMa: Local Feature Matching Revisited
- UniDepthV2: Universal Monocular Metric Depth Estimation Made Simpler
- VGGT-$\Omega$
- MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details
- $\pi^3$: Permutation-Equivariant Visual Geometry Learning
- Depth Anything V2
- Bundle Adjustment in the Eager Mode
- UFM: A Simple Path towards Unified Dense Correspondence with Flow
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models