Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion
cs.CV, cs.AI
Submitted: 2026-10-10
Updated: 2026-10-10
Project page: https://cvlab-kaist.github.io/DeepForcing
License: http://creativecommons.org/licenses/by/4.0/
The gist: Autoregressive video generators synthesize long videos through chunk-wise rollouts, yet they are typically trained to predict only the immediate future.
Abstract
Autoregressive video generators synthesize long videos through chunk-wise rollouts, yet they are typically trained to predict only the immediate future. This limited prediction horizon makes it challenging to maintain video quality over extended rollouts. To address this problem, we introduce Prospective Forcing, a multi-head prediction framework that injects long-range predictive signals into autoregressive video representations. Built on a rolling-window generator, Prospective Forcing attaches lightweight, offset-specific heads that share the same conditioning information and independently predict chunks at different future temporal offsets. By extending supervision beyond the next chunk, these heads encourage the shared history representation to retain information useful for longer-horizon prediction, supporting temporally consistent generation. At inference time, we accelerate sampling by using accepted future-chunk predictions to skip full-window backbone executions. We equip the head with learnable embeddings to generate multiple candidates for the next chunk, and a learned verifier either selects a candidate or rejects all and falls back to standard autoregressive generation.
Sources
- Layer Normalization
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- End-to-End Training for Autoregressive Video Diffusion via Self-Resampling
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Movie Gen: A Cast of Media Foundation Models
- Wan: Open and Advanced Large-Scale Video Generative Models
- Next Forcing: Causal World Modeling with Multi-Chunk Prediction
- CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer
- Video-Mirai: Autoregressive Video Diffusion Models Need Foresight
- Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models