TGuide: Faster Autoregressive Video Diffusion via Historical Trajectory Guidance
cs.CV
Submitted: 2026-10-10
Updated: 2026-10-10
Comments: 23 pages, 5 figures. Project page: https://zhuochen02.github.io/tguide/
Project page: https://zhuochen02.github.io/tguide
License: http://creativecommons.org/licenses/by/4.0/
The gist: Can autoregressive video diffusion be accelerated further when only four denoising steps remain? Existing feature caching approaches struggle in this regime, as large feature changes between
Abstract
Can autoregressive video diffusion be accelerated further when only four denoising steps remain? Existing feature caching approaches struggle in this regime, as large feature changes between denoising timesteps undermine both direct reuse and lightweight predictors. We observe that features across video chunks remain strongly correlated at matching denoising timesteps, offering a complementary source of guidance. Building on this insight, we introduce TGuide, a framework that accelerates autoregressive video diffusion through a lightweight Anchor-Transport-Correct (ATC) predictor guided by historical sampling trajectories. Our ATC combines two complementary references: the current chunk's preceding-step features preserve its spatial structure, while the previous chunk's same-timestep features provide information at the target denoising stage. By integrating these references through spatial retrieval and adaptive correction, ATC improves velocity prediction accuracy despite the large gaps between denoising steps. To mitigate error accumulation across both denoising steps and video chunks, we train the predictor on its own autoregressive rollouts, allowing it to adapt to states shaped by its own earlier predictions. An optional confidence-aware scheduler further adjusts the quality-efficiency trade-off. Experiments on Self Forcing, Causal Forcing, and HY-WorldPlay show that TGuide preserves generation quality while achieving denoising speedups of up to 1.89 times over the original 4-step generators. On Self Forcing, TGuide generalizes from 81-frame training videos to 333-frame generation, approximately four times the training length, while exceeding the original model's VBench score.
Sources
- SkyReels-V2: Infinite-length Film Generative Model
- $\Delta$-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers
- Context Forcing: Consistent Autoregressive Video Generation with Long Context
- Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers
- Infinite Worlds with Versatile Interactions
- Matrix-game 2.0: An open-source, real-time, and streaming interactive world model
- Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion
- HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration
- Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generation
- FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching
- Streaming Autoregressive Video Generation via Diagonal Distillation
- RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO
- Flow caching for autoregressive video generation
- MagCache: Fast Video Generation with Magnitude-Aware Cache
- MAGI-1: Autoregressive Video Generation at Scale
- FORA: Fast-Forward Caching in Diffusion Transformer Acceleration
- WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
- Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
- Motion-Aware Caching for Efficient Autoregressive Video Generation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models