ReasonXL: A Large-Scale Corpus for Language-Specific Reasoning in LLMs
cs.CL
Submitted: 2026-04-14
Updated: 2026-10-10
Comments: 4 pages
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Despite advances in multilingual capabilities, most large language models (LLMs) remain English-centric in their training and, crucially, in the reasoning traces they produce: even for non-English
Terminology
Abstract
Despite advances in multilingual capabilities, most large language models (LLMs) remain English-centric in their training and, crucially, in the reasoning traces they produce: even for non-English problems, they predominantly reason in English, leaving non-English users with intermediate reasoning they cannot follow. We address this disparity with two contributions. **(a)** We introduce ReasonXL, the first large-scale parallel corpus of cross-domain reasoning traces in five European languages (English, German, French, Italian, and Spanish): over 2.5M aligned samples (11B tokens) per language, each comprising prompt, reasoning trace, and final output, enabling direct supervision of language-specific reasoning. **(b)** Using ReasonXL, we demonstrate that LLMs can be adapted to reason entirely in a target language through a simple two-stage pipeline of supervised fine-tuning (SFT) and reinforcement learning with verifiable rewards (RLVR), matching or exceeding the base models' English-reasoning performance in two of four languages and recovering most of it in the remaining two.
Sources
- Language Models' Factuality Depends on the Language of Inquiry
- Llama-Nemotron: Efficient Reasoning Models
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- CLaS-Bench: A Cross-Lingual Alignment and Steering Benchmark
- propella-1: Multi-Property Document Annotation for LLM Data Curation at Scale
- Magistral
- Olmo 3
- Qwen3 Technical Report
- Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoning
- Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
- Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning
- Crosslingual Reasoning through Test-Time Scaling
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering