PURE: Refining Feed-forward 3D Reconstruction with Unlabeled Post-training
cs.CV
Submitted: 2026-10-10
Updated: 2026-10-20
Comments: Accepted by ACMMM 2026. Project Page: https://funnyguy525.github.io/PURE-Page/ Github: https://github.com/jiah-cloud/PURE
License: http://creativecommons.org/licenses/by/4.0/
The gist: Feed-forward 3D reconstruction models have achieved remarkable progress through large-scale training and strong learned priors.
Abstract
Feed-forward 3D reconstruction models have achieved remarkable progress through large-scale training and strong learned priors. However, they remain fragile when applied to dynamic in-the-wild videos, where non-rigid motion, occlusions, and illumination changes are prevalent. A key limitation lies in their reliance on expensive depth and camera pose annotations, which hinders scaling to diverse real-world dynamic data and restricts generalization. To address this issue, we propose PURE, an unlabeled post-training refinement framework that improves depth and camera estimation without requiring ground-truth supervision. Instead of relying on annotations, PURE elegantly distills robust structural knowledge from state-of-the-art 2D priors into 4D feed-forward architectures. PURE leverages relative depth constraints, affine-invariant geometry distillation, and pose refinement based on feature correspondences to stabilize geometric predictions under challenging dynamic conditions. Extensive experiments on both synthetic and real-world dynamic benchmarks demonstrate that PURE delivers consistent improvements across multiple state-of-the-art architectures. Furthermore, our data-efficient paradigm effectively mitigates domain shifts, successfully unlocking the architectural limits of these base models in challenging, in-the-wild dynamic scenes.
Sources
- Virtual KITTI 2
- Reconstructing 4D Spatial Intelligence: A Survey
- LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry
- TTT3R: 3D Reconstruction as Test-Time Training
- Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control
- ViPE: Video Pose Engine for 3D Geometric Perception
- PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
- Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors
- T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy
- Segment Anything
- UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Pass
- Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction
- Sekai: A Video Dataset towards World Exploration
- Depth Anything 3: Recovering the Visual Space from Any Views
- MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priors
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
- Align3R: Aligned Monocular Depth Estimation for Dynamic Videos
- TrackingWorld: World-centric Monocular 3D Tracking of Almost All Pixels
- ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals
- SAM 2: Segment Anything in Images and Videos
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models