ELARSpeech: A 30K-Hour Dataset Across 675 Underrepresented Languages for Long-Tail Multilingual Speech Technologies
cs.CL, cs.AI, cs.SD
Submitted: 2026-10-14
Updated: 2026-10-19
Code: https://github.com/sanghyang00/elarspeech
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresent much of the linguistic long tail.
Abstract
Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresent much of the linguistic long tail. To address this gap, we introduce ELARSpeech, a large-scale multilingual speech resource comprising 30,202 hours of speech across 675 underrepresented languages, curated from the Endangered Languages Archive. Combining human-annotated and unlabeled recordings, the corpus spans diverse recording conditions, domains, and language families. Beyond corpus construction, our experiments show how ELARSpeech supports extending ASR and TTS capabilities to diverse underrepresented languages, with further benefits from pseudo-labeling unlabeled data. At the same time, our speech representation analysis reveals remaining limitations in transferring existing multilingual models to the linguistic long tail. Together, ELARSpeech provides both a resource and a testbed for extending multilingual speech technology further into the linguistic long tail. We publicly release the dataset, all trained ASR and TTS models, and the complete data construction pipeline to facilitate research on long-tail multilingual speech technologies.
Sources
- WorldSpeech: A Multilingual Speech Corpus from Around the World
- XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
- Seamless: Multilingual Expressive and Streaming Speech Translation
- ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
- OpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languages
- Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages
- Decoupled Weight Decay Regularization
- WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark
- BibleTTS: a large, high-fidelity, multilingual, and uniquely African speech corpus
- Automatic Speech Recognition in the Modern Era: Architectures, Training, and Evaluation
- 1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis
- ML-SUPERB: Multilingual Speech Universal PERformance Benchmark
- ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
- Qwen3 Technical Report
- Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages
- OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering