Planner-Guided Recursive Exploration for Diffusion Language Model Decoding
cs.CL, cs.LG
Submitted: 2026-07-17
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: Masked diffusion language models (DLMs) enable parallel text generation by iteratively refining masked tokens, offering a promising alternative to autoregressive decoding.
Terminology
Abstract
Masked diffusion language models (DLMs) enable parallel text generation by iteratively refining masked tokens, offering a promising alternative to autoregressive decoding. Recent search-based decoding methods improve the accuracy--efficiency trade-off by exploring multiple candidate decoding trajectories before committing token updates. However, existing search-based decoding methods face two key limitations. First, they offer limited guidance on when search is actually beneficial for the current decoding state. Second, they typically rely on a shallow one-step search horizon, which may favor locally promising but suboptimal decoding trajectories. To address these limitations, we propose PRED, a planner-guided recursive exploration framework for DLM decoding. PRED employs a learned planner to determine when search should be triggered, and performs adaptive multi-step rollout to evaluate candidate trajectories over longer horizons. Moreover, the same planner is recursively applied to intermediate rollout states to determine whether additional branch expansion is needed, allowing PRED to re-initiate search when necessary. Experiments across multiple benchmarks and DLM backbones show that PRED achieves a better accuracy--efficiency trade-off than existing confidence-based and search-based decoding methods.
Sources
- LLaDA2.0: Scaling Up Diffusion Language Models to 100B
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- From Bits to Rounds: Parallel Decoding with Exploration for Diffusion Language Models
- Measuring Massive Multitask Language Understanding
- Measuring Mathematical Problem Solving With the MATH Dataset
- Empirical Analysis of Decoding Biases in Masked Diffusion Models
- DiffWave: A Versatile Diffusion Model for Audio Synthesis
- Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models
- dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching
- Score-Based Generative Modeling through Stochastic Differential Equations
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding
- Dream 7B: Diffusion Large Language Models
- Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decoding
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering