Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents
cs.CL, cs.AI
Submitted: 2026-10-13
Updated: 2026-10-19
Comments: 57 pages
Code: https://github.com/ace-agent/ace
License: http://creativecommons.org/licenses/by/4.0/
The gist: Thought templates, skill libraries, agent memories and caches turn many reasoning steps into one.
Abstract
Thought templates, skill libraries, agent memories and caches turn many reasoning steps into one. We call this reasoning contraction. A contracted memory saves reasoning steps and errors until its facts change, then quietly answers wrong. Most systems trust memories by counting successes and failures. We prove that such counters are badly tuned change detectors: a symmetric counter notices a partial change only after a power of its false-alarm horizon, and an unclipped one may never notice it. On five LLMs answering multi-hop questions over edited facts, ExpeL- and ACE-style counters serve 7.0-13.5x more stale answers than certified memories given the same information, and on code tasks with an exact verifier 35-73x more. Safety also has a price. When facts change and each memory is judged only by its own verified outcomes, one number, the certification load, sets how much reasoning any safe memory can skip, and under Zipf demand it yields a scaling law. Our recipe weighs each memory's failures by its own likelihood ratio, certifies its utility against live reasoning, and restarts the certificate when facts change, with the likelihood-ratio detector as the safety net for unannounced changes; for large edits it also invalidates the memory.
Sources
- Memory Reward Inflation in Self-Improving LLM Agents
- Program Synthesis with Large Language Models
- A Theory of Reliable Self-Evolution for Agent Harnesses
- Large Language Models as Tool Makers
- Evaluating Large Language Models Trained on Code
- SkillDroid: Compile Once, Reuse Forever
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- Quickest Change Detection Using Mismatched CUSUM
- Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
- Memory Injection Attacks on LLM Agents via Query-Only Interaction
- SelfEvoSkill: Paired Execution Audits for Skill Revision without External Outcome Supervision
- Conditional Performance Guarantee for Large Reasoning Models
- Learning Curve Theory
- Mistral 7B
- Conformal Selective Acting: Anytime-Valid Risk Control for RLVR-Trained LLMs
- ConSol: Sequential Probability Ratio Testing to Find Consistent LLM Reasoning Paths Efficiently
- MemOS: A Memory OS for AI System
- Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
- Self-Refine: Iterative Refinement with Self-Feedback
- Risk-Constrained Freshness-Aware Semantic Caching for Open-Web Retrieval-Augmented LLMs
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering