FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Training
cs.CV
Submitted: 2026-10-13
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: Prompt optimization and generator post-training are two complementary ways to improve text-to-video (T2V) generation, and recent systems increasingly train both modules jointly.
Terminology
Abstract
Prompt optimization and generator post-training are two complementary ways to improve text-to-video (T2V) generation, and recent systems increasingly train both modules jointly. However, optimizing a prompt policy and a video generator from the same terminal reward creates two ambiguities: prompt quality is confounded with stochastic generation, and the two modules may realize overlapping local improvements. We introduce FlowCred, a two-level framework for joint T2V post-training. First, hierarchical credit assignment uses matched prompt-seed rollout grids to separate prompt-level credit from prompt-conditioned generator residuals under shared randomness. Second, functional coordination probes alternative current-policy prompts at states from actual generation trajectories, providing generator-aware evidence for prompt optimization while selectively attenuating generator updates already supported by conditioning changes. Across multiple T2V benchmarks, FlowCred consistently improves matched joint-training baselines. On LTX-2.5, FlowCred improves a strictly matched joint-training control from 61.47 to 64.46 on T2V-CompBench and from 55.58 to 58.08 on StoryEval, without increasing decoded-video or reward-model-call budgets. Factorial and realized-update analyses show complementary contributions from prompt shaping and generator routing, while human evaluation and transfer across backbones and updater families provide further supporting evidence.
Sources
- Scaling Reinforcement Learning for Diffusion Models via Velocity Matching
- Latent Reward Registers for Diffusion Preference Alignment
- LTX-2: Efficient Joint Audio-Visual Foundation Model
- CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Improving Video Generation with Human Feedback
- UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation
- Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimization
- Diffusion-State Policy Optimization for Masked Diffusion Language Models
- Video Diffusion Alignment via Reward Gradients
- STAR: SpatioTemporal Adaptive Reward Allocation for Text-to-Image RL Post-Training
- Wan: Open and Advanced Large-Scale Video Generative Models
- PromptRL: Prompt Matters in RL for Flow-Based Image Generation
- Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuning
- HunyuanVideo 1.5 Technical Report
- Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Models
- DanceGRPO: Unleashing GRPO on Visual Generation
- VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness
- Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformers
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models