Full-duplex Spoken Language Modeling with Discrete Diffusion
cs.CL
Submitted: 2026-10-13
Updated: 2026-10-13
Project page: https://cchen1436.github.io/diffuplex-website
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce Diffuplex, a full-duplex spoken language model based on discrete diffusion that achieves an unprecedented balance between linguistic intelligence and response efficiency.
Abstract
We introduce Diffuplex, a full-duplex spoken language model based on discrete diffusion that achieves an unprecedented balance between linguistic intelligence and response efficiency. With thinking mode, Diffuplex delivers 13.0 tokens per forward pass, reaching an average of 1872 tokens per second and substantially surpassing the frontier autoregressive (AR) models in decoding speed. Without thinking, Diffuplex matches the first-audio latency of existing full-duplex models while achieving markedly stronger linguistic intelligence. This capability is enabled by separating when to say from what to say at the training level, rather than compressing both into a single autoregressive timeline. During inference, Diffuplex continuously tracks the user speech through an AR interaction policy, while independently generating and refining response content through parallel diffusion. Consequently, semantic computation is no longer bounded by the perception audio frame rate, allowing intelligence and responsiveness to improve simultaneously. Taken together, these results establish a new paradigm for spoken agents that can sustain real-time dialogue while devoting parallel computation to intelligent response generation. Training code and checkpoints will be avaliable soon.
Sources
- NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities
- Qwen2-Audio Technical Report
- CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
- ICASSP 2023 Deep Noise Suppression Challenge
- Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
- LoRA: Low-Rank Adaptation of Large Language Models
- Preserving Speech-to-Text LLM Capabilities in Speech-to-Speech Generation
- Raon-Speech Technical Report
- Kimi-Audio Technical Report
- Whisfusion: Parallel ASR Decoding with Masked Diffusion
- Diffusion-LM Improves Controllable Text Generation
- Decoupling Conversational Dynamics in Full-Duplex Spoken Models through Reinforcement Learning
- Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilities
- Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluency
- Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
- Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence
- PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Models
- Simple and Effective Masked Diffusion Language Models
- The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning
- Qwen3-Omni Technical Report
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering