H-DDCM: Hadamard Codebooks for Fast Generative Image and Video Compression
cs.CV, cs.AI, cs.LG
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: Project's webpage at https://h-ddcm.github.io/
Code: https://github.com/black-forest-labs/flux
Project page: https://h-ddcm.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Training-free diffusion-based compression methods repurpose the generative priors of a diffusion or a flow model to compress data without retraining them as task-specific codecs.
Abstract
Training-free diffusion-based compression methods repurpose the generative priors of a diffusion or a flow model to compress data without retraining them as task-specific codecs. Recent codebook-based approaches such as Turbo-DDCM achieve strong perceptual quality at ultra-low bitrates, but their reliance on dense Gaussian codebooks remains costly in both memory and computation, and scales poorly with the large latent dimensions of modern image and video generators. Their combinatorial bitstream encoding further becomes computationally heavy at this scale. We introduce H-DDCM, a scalable generative compression framework that replaces Gaussian codebooks with implicit randomized Hadamard dictionaries. The fast Walsh-Hadamard transform allows for implicitly synthesizing full-dimensional dictionaries with O(d d) compute for projection and reconstruction and O(d) memory, without materializing the full-dimensional dictionary. We further introduce an efficient table-free lexicographic coding scheme that makes combinatorial encoding practical at larger dimensions. Beyond images, we adapt the framework to an autoregressive video flow model and develop a streaming compression scheme that periodically re-encodes recently reconstructed frames into a fresh KV-cache prefix, preserving temporal context across segments at no additional transmitted bits. This enables long-form, close to real-time generative video compression on a single GPU. Across image and video benchmarks, H-DDCM achieves competitive rate-distortion-perception performance while substantially reducing the memory and computational overhead of codebook-based training-free generative compression.
Sources
- ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors
- A Residual Diffusion Model for High Perceptual Quality Codec Augmentation
- Lossy Compression with Gaussian Diffusion
- Towards Accurate Generative Models of Video: A New Metric & Challenges
- GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow
- ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models