GeoFix: Geometry Fixing for 4D Consistent Generation
cs.CV, cs.AI, cs.LG
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: Project Page: https://yeobinhong.github.io/GeoFix/
Code: https://github.com/Vchitect/VBench1https:
Project page: https://yeobinhong.github.io/GeoFix/1
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Video diffusion models increasingly serve as priors for 4D generation, but the generated videos often lack geometric consistency.
Abstract
Video diffusion models increasingly serve as priors for 4D generation, but the generated videos often lack geometric consistency. Recent approaches address this through post-training by designing geometric rewards, yet this can degrade texture and fine detail, requiring auxiliary appearance rewards and careful reward balancing. To address this challenge, we propose GeoFix, a unified framework that improves geometric consistency and visual quality with a single geometric reward, applicable to both training and inference-time reward alignment. Our reward measures cross-view depth consistency in static scene regions, targeting structural inconsistencies without directly constraining appearance or penalizing valid object motion. Crucially, depth agreement increases with camera field-of-view overlap even in real videos and 4D datasets, allowing a smaller camera movement to be mistaken for better geometry. We account for this effect by calibrating the reward against the overlap-dependent trend. GeoFix achieves a 39% improvement in WorldScore 3D consistency and a 4% increase in VBench Quality Score.
Sources
- VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
- MEt3R: Measuring Multi-View Consistency in Generated Images
- ReCamMaster: Camera-Controlled Generative Rendering from A Single Video
- VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generation
- Theoretical guarantees on the best-of-n alignment policy
- 4DNeX: Feed-Forward 4D Generative Modeling Made Easy
- Directly Fine-Tuning Diffusion Models on Differentiable Rewards
- VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation
- CamPilot: Improving Camera Control in Video Diffusion Model with Efficient Camera Reward Feedback
- Text-to-3D by Stitching a Multi-view Reconstruction Network to a Video Generator
- GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structure
- LoRA: Low-Rank Adaptation of Large Language Models
- Segment Any Motion in Videos
- VBench: Comprehensive Benchmark Suite for Video Generative Models
- VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models
- MUSIQ: Multi-scale Image Quality Transformer
- Free$^2$Guide: Training-Free Text-to-Video Alignment using Image LVLM
- Epipolar Geometry Improves Video Generation Models
- Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing
- Aligning Text-to-Image Models using Human Feedback
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models