VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment
cs.CV
Submitted: 2026-10-13
Updated: 2026-10-13
Code: https://github.com/Lightricks/LTX2
License: http://creativecommons.org/licenses/by/4.0/
The gist: Modern text-to-video (T2V) models generate visually compelling videos, yet meaning-preserving changes in prompt wording can substantially alter semantic realization and overall quality.
Terminology
Abstract
Modern text-to-video (T2V) models generate visually compelling videos, yet meaning-preserving changes in prompt wording can substantially alter semantic realization and overall quality. Existing prompt rewriting modifies the inference input, whereas conventional post-training constructs supervision from one prompt formulation at a time; neither explicitly optimizes reliability across equivalent forms. We introduce VARI (Verified Alignment over Representations of Intent), a group-structured framework that treats automatically verified formulations of the same visual intent as a shared supervision unit. VARI builds matched form-seed rollout pools, cross-scores each video against all forms, and applies a wording-independent structured intent audit to identify valid realizations and hard semantic failures. Group-Consistent Distillation (GCD) aligns every verified form with interchangeable valid realizations, while Form-Contrastive Flow-DPO (FC-DPO) learns group-level preferences from audited positive-negative pairs, prioritizing same-seed, different-form contrasts. On HunyuanVideo-1.5, VARI attains the highest T2V-CompBench, VBench, and StoryEval scores among the evaluated methods. On prompt-form extensions of T2V-CompBench and VBench, it improves weakest-form alignment over the strongest prompt-level baselines by 2.45 and 3.55 points and reduces cross-form drop by 30.5% and 32.2%, respectively, while preserving visual quality. Human evaluation, natural-caption controls, prompt-enhancement experiments, diversity analyses, and transfer to LTX-2.3 further support the robustness and transferability of these gains, while VARI requires no additional inference-time module.
Sources
- Lumiere: A Space-Time Diffusion Model for Video Generation
- Training Diffusion Models with Reinforcement Learning
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
- LTX-Video: Realtime Video Latent Diffusion
- Classifier-Free Diffusion Guidance
- Video Diffusion Models
- Imagen Video: High Definition Video Generation with Diffusion Models
- Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models
- Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation
- VideoPoet: A Large Language Model for Zero-Shot Video Generation
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Evaluating Text-to-Visual Generation with Image-to-Text Generation
- Latte: Latent Diffusion Transformer for Video Generation
- Scalable Diffusion Models with Transformers
- Movie Gen: A Cast of Media Foundation Models
- Video Diffusion Alignment via Reward Gradients
- Make-A-Video: Text-to-Video Generation without Text-Video Data
- Wan: Open and Advanced Large-Scale Video Generative Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models