Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
cs.CV
Submitted: 2026-06-08
Updated: 2026-10-17
Journal ref: Advances in Neural Information Processing Systems 2026
Code: https://github.com/madebyollin/taehv
Project page: https://xin1u.github.io/UltraFlash/1
License: http://creativecommons.org/licenses/by/4.0/
The gist: While recent autoregressive video diffusion models achieve remarkable streaming quality, they remain confined to low resolutions (e.g., 480P), leaving efficient, scalable, real-time high-resolution
Terminology
Abstract
While recent autoregressive video diffusion models achieve remarkable streaming quality, they remain confined to low resolutions (e.g., 480P), leaving efficient, scalable, real-time high-resolution video generation a fundamental open challenge. To bridge this gap, we present Ultra Flash, a cascaded streaming framework capable of real-time high-resolution video generation. Ultra Flash achieves 30 FPS at 1K resolution and 18 FPS at 2K resolution on a single GPU through three key contributions: (1) an architecture-preserving T2V-to-TV2V super-resolution training paradigm coupled with an AIGC-oriented data degradation pipeline that effectively preserves the generative capability of the base model, enabling enhanced high-resolution detail when cascaded after mainstream low-resolution generative models; (2) a causal streaming latent upsampler paired with a high-resolution decoder, which enhances spatiotemporal coherence while enabling efficient latent spatial scaling and precise high-resolution decoding with negligible computational overhead; and (3) a cascade high-resolution streaming video generation optimization scheme that first performs hybrid-reward-enhanced sparse causalization and single-step distillation of the super-resolution model, then introduces cascaded streaming self-forcing preference optimization with dynamic cache management, jointly enhancing overall coherence, improving quality, and enabling real-time high-resolution streaming video generation. Extensive experiments demonstrate that Ultra Flash reliably produces ultra-high-resolution streaming video while maintaining state-of-the-art visual quality and superior efficiency. Project Page: https://xin1u.github.io/UltraFlash/
Sources
- Longformer: The Long-Document Transformer
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models
- Generating Long Sequences with Sparse Transformers
- Self-Forcing++: Towards Minute-Scale High-Quality Video Generation
- DemoFusion: Democratising High-Resolution Image Generation With No $$$
- FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Space
- Seedance 1.0: Exploring the Boundaries of Video Generation Models
- Efficient Autoregressive Video Diffusion with Dummy Head
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
- LTX-Video: Realtime Video Latent Diffusion
- LTX-2: Efficient Joint Audio-Visual Foundation Model
- VEnhancer: Generative Space-Time Enhancement for Video Generation
- ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models
- Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion
- Pyramidal Flow Matching for Efficient Video Generative Modeling
- FIFO-Diffusion: Generating Infinite Videos from Text without Training
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shield
- Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models