D2: High-Capability Full-Duplex Spoken Language Models from Half-Duplex Backbones

arXiv:2610.17124 · cs.CL, cs.AI, eess.AS · Submitted 2026-10-12 · Read on arXiv

cs.CL, cs.AI, eess.AS

Submitted: 2026-10-12

Updated: 2026-10-12

Comments: 17 pages, including references and appendices. Demo: https://d2-duplex-demo.github.io/

Project page: https://d2-duplex-demo.github.io

License: http://creativecommons.org/licenses/by/4.0/

The gist: Full-duplex spoken language models (FD-SLMs) support simultaneous listening and speaking, but often lag behind half-duplex spoken language models (HD-SLMs) in general capabilities.

Abstract

Full-duplex spoken language models (FD-SLMs) support simultaneous listening and speaking, but often lag behind half-duplex spoken language models (HD-SLMs) in general capabilities. We propose Dialogue-to-Duplex (D2), a framework that converts pretrained HD-SLMs into high-capability FD-SLMs at fine temporal granularity. D2 adapts the original audio encoder to streaming through decoder-free representation distillation and learns full-duplex interaction through supervised fine-tuning. We systematically study the effects of chunk size on full-duplex interaction, general capabilities, and inference computation. We apply D2 to two distinct HD-SLM architectures, Qwen3-Omni and LLaMA-Omni 2. At a 12.5Hz update rate, Qwen3-Omni-D2 achieves 99.2% turn-taking success with 521-ms latency, 99.5% interruption success, and a state-of-the-art VoiceBench score of 70.1.

Sources

Related papers