ThinkFuse: Trajectory-Aware Test-Time Fusion for Small Reasoning Models
cs.AI, cs.CL
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: Accepted to EMNLP 2026 Findings
Code: https://github.com/js-lee-AI/ThinkFuse
License: http://creativecommons.org/licenses/by/4.0/
The gist: Small reasoning models (SRMs) have shown strong performance on complex reasoning tasks by generating extended chain-of-thought trajectories, but they often fail to recover once their reasoning enters
Abstract
Small reasoning models (SRMs) have shown strong performance on complex reasoning tasks by generating extended chain-of-thought trajectories, but they often fail to recover once their reasoning enters an erroneous path. Existing test-time fusion methods rely on local fusion signals to determine when to trigger fusion, which can be misled by transient uncertainty fluctuations and may reinforce unstable reasoning trajectories. We propose ThinkFuse, a training-free test-time fusion framework that selectively intervenes in unreliable reasoning segments. ThinkFuse compares segment-level uncertainty shifts with trajectory-level uncertainty trends to identify unstable reasoning points and fuse auxiliary reasoning paths into the primary model's trajectory. Extensive experiments demonstrate that ThinkFuse outperforms baselines on mathematical and knowledge-intensive reasoning benchmarks, with consistent gains across model-family combinations, and remains robust with a smaller primary model. Our analysis shows that ThinkFuse requires fewer fusion triggers and generates fewer tokens, highlighting the efficiency of selective triggering. Our code is available at https://github.com/js-lee-AI/ThinkFuse.
Sources
- EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes
- EXAONE Deep: Reasoning Enhanced Language Models
- Training Verifiers to Solve Math Word Problems
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Multi-Layer GRPO: Enhancing Reasoning and Self-Correction in Large Language Models
- Efficiently Scaling LLM Reasoning with Certaindex
- StyleBench: Evaluating thinking styles in Large Language Models
- A Study on Thinking Patterns of Large Reasoning Models in Code Generation
- Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models
- Ministral 3
- Retro-Search: Exploring Untaken Paths for Deeper and Efficient Reasoning
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
- Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs
- Qwen3 Technical Report
- Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement
- Effective Learning for Small Reasoning Models: An Empirical Study on 0.5B Reasoning LLMs
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems