Lapras: Latent Reasoning for Time Series Language Models
cs.CL, cs.LG
Submitted: 2026-10-08
Updated: 2026-10-08
Code: https://github.com/yuc0805/Lapras
License: http://creativecommons.org/licenses/by/4.0/
The gist: Time Series Language Models (TSLMs) offer a promising path toward time series understanding by reasoning over temporal signals and producing natural language answers and explanations.
Terminology
Abstract
Time Series Language Models (TSLMs) offer a promising path toward time series understanding by reasoning over temporal signals and producing natural language answers and explanations. A common approach is Chain-of-Thought (CoT), which generates step-by-step rationales linking relevant signal patterns to final answers. Although these models learn from reference CoT traces during post-training, generating faithful descriptions of input time series at inference remains challenging. Expressing high-dimensional, continuous temporal representations in discrete language tokens may cause the model to neglect task-relevant patterns or describe them inaccurately. Because later reasoning steps build on these descriptions, early errors propagate, leading to incorrect answers with plausible explanations that are inconsistent with the input signal. We propose Lapras (Latent Post-trained Reasoning Across Series), a post-training framework that equips TSLMs with latent reasoning. A model trained with Lapras reasons through a sequence of continuous thoughts in the joint time series-language space, producing text only for the final answer. It learns this through teacher-student self-distillation, where a teacher trained on CoT reference traces reasons explicitly through text. The student aligns its hidden states with the teacher's at the answer stage, transferring the teacher's reasoning ability into its latent computation. We evaluate Lapras across four TSLM backbones on five time series question answering benchmarks. Lapras improves average F1 by up to 10.79% over explicit CoT while generating 23.9x fewer tokens. Lapras's continuous thoughts can also be decoded into readable reasoning traces via standard language decoding, preserving textual explanations. Together, these results highlight Lapras as a promising post-training paradigm for efficient, effective, and interpretable TSLM reasoning.
Sources
- Flamingo: a Visual Language Model for Few-Shot Learning
- Chronos: Learning the Language of Time Series
- MIRAGE: The Illusion of Visual Understanding
- Emerging Properties in Self-Supervised Vision Transformers
- An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models
- Learning Transferable Sensor Models via Language-Informed Pretraining
- A decoder-only foundation model for time-series forecasting
- LLM Latent Reasoning as Chain of Superposition
- Interleaved-Modal Chain-of-Thought
- MOMENT: A Family of Open Time-series Foundation Models
- Large Language Models Are Zero-Shot Time Series Forecasters
- TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Models
- Training Large Language Models to Reason in a Continuous Latent Space
- Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data
- OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Data
- Measuring Faithfulness in Chain-of-Thought Reasoning
- Latent Visual Reasoning
- Small Models Struggle to Learn from Strong Reasoners
- Large Language Models are Few-Shot Health Learners
- Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signals
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering