The internal model principle in reservoir computing
eess.SY, cs.SY, math.OC
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: Submitted to the American Control Conference (ACC) 2027
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: The paper studies learning in reservoir computing systems through the lens of the internal model principle.
Terminology
Abstract
The paper studies learning in reservoir computing systems through the lens of the internal model principle. The key idea is to model training signals as outputs of an exogenous signal generator, thus connecting reservoir computing to output regulation, observer theory, and frequency-domain interpolation. For linear signal generators, we characterize the steady-state response of a linear reservoir through invariant subspaces, establishing connections with Luenberger observers and classical frequency-domain interpolation. For nonlinear signal generators, we obtain analogous results using invariant manifolds, connecting synchronization to Kazantzis-Kravaris/Luenberger observers and readout training to nonlinear moment matching. Case studies illustrate how our perspective explains possible instability of trained predictors and informs reservoir design.
Sources
- Echo State Networks as State-Space Models: A Systems Perspective
- On Dominant Manifolds in Reservoir Computing Networks
- Machines that Predict Trajectories from Templates
Related papers
- One Request, Multiple Experts: LLM Orchestrates Domain Specific Models via Adaptive Task Routing
- A Geometric Decision Procedure for STL Feasibility and Repair
- Scaling up statistical model checking of cyber-physical systems via algorithm ensemble and parallel simulations over HPC infrastructures
- From Asymptotic to Designer-Assigned-Time Control: A Review of Stability Notions, Design Mechanisms, and Controller Architectures
- Battery Second Life: A Review of Experimental Studies
- Submodular Multi-Agent Policy Learning for Online Distributed Task Allocation in Open Multi-Agent Systems