Weak-Form Recovery of Stochastic Generators
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Weak-Form Recovery of Stochastic Generators".
Jane: Here's the gist of the paper. The gist The algorithm presents an algorithm for learning governing equations of a stochastic dynamical system from trajectory data, recovering interpretable symbolic expressions for both drift b(x) and diffusion a(x) in a single pass, yielding a model that can be queried directly for relaxation timescales, metastable escape rates, and stationary distributions<ref:2603.20904#pg16>.
Tom: How it works The algorithm recovers explicit polynomial expressions for the drift ˆb(x) and diffusion aˆ(x) in a single pass over the data<ref:2603.20904#pg16>.
Jane: It achieves this by aggregating each candidate term across the entire trajectory before regressing, so that fluctuations average out at the 1/√N rate<ref:2603.20904#pg16>.
Tom: This approach avoids estimating dynamics one time step at a time, which is problematic because stochastic trajectories are inherently rough and methods that estimate the dynamics from one time step at a time let process randomness and measurement error enter each regression contribution directly<ref:2603.20904#pg16>.
Paper summary: Tom: So we've gone through the paper on Weak-Form Recovery of Stochastic Generators. The authors are showing us an algorithm that recovers drift b(x) and diffusion a(x) in one pass, using state-dependent spatial kernels instead of time-indexed functions.
Jane: They prove that this method is consistent for the Euler–Maruyama coefficients, and they show how to get a finite-step correction for linking the two estimations together, which helps with additive Gaussian observation noise too.
Lu: The core idea is avoiding noise amplification at the source by summing increments weighted by a function K j(X tn), which leads to the signal growing linearly while the noise grows only as the square root of N.
Meng: From an engineering standpoint, it’s about getting a model that’s interpretable for downstream analysis, not just some black box that needs constant retraining.
Tom: The validation on the Ornstein–Uhlenbeck process, the double-well Langevin system, and the multiplicative-noise system shows they hit about five percent error on coefficients and zero point zero one in stationary density error <ref:2603.20904#pg1,double-well Langevin system, and>.
Jane: But we have to remember their caveat: exact support recovery from one trajectory takes a long record, like about T greater than two hundred for the double-well system, which isn't guaranteed for shorter data or weakly identified systems.
Lu: The implication is that this framework provides a robust way to extract crucial dynamical quantities like relaxation timescales and escape rates directly from observed trajectories.
Meng: It’s a powerful tool for model building when you need those specific physical parameters without running extensive forward simulations first.
Tom: So, the title Weak-Form Recovery of Stochastic Generators tells us they are focusing on making this recovery process work robustly for the stochastic nature of these systems.
Conclusion: Tom: So we’ve looked at how this paper, "Weak-Form Recovery of Stochastic Generators," tackles learning equations for systems that have randomness built in.
Jane: It basically shows a way to figure out both the drift and the diffusion of a stochastic equation just from watching it happen once.
Tom: Right, they use something called sparse symbolic regression but they adapt it for these random things by using state-dependent spatial kernels instead of those standard time windows.
Jane: And that’s the technical heart of it, isn't it? They’re replacing functions that depend on time with functions that depend on where you are in the system.
Tom: Exactly. They handle a problem where just looking at data one step at a time messes up your estimates because the trajectories are rough.
Jane: The authors prove that this state-dependent approach actually gives you consistent estimators for the drift and diffusion, which is pretty important for real science applications.
Tom: It’s good because it leads directly to things you care about, like relaxation timescales and escape rates from different states in those systems.
Jane: So what does this mean practically? It means we can get these important physical parameters straight out of a single trajectory without needing massive amounts of simulated data first.
Tom: And the authors validated it on three different kinds of systems—the Ornstein-Uhlenbeck process, a double-well system, and one with multiplicative noise.
Jane: That validation showed they got the coefficients pretty close to the truth, maybe within five percent error on those coefficients.
Tom: It’s promising because it shows that this method works across different types of drift and diffusion structures.
Jane: But we have to remember the caveat they mentioned—getting an exact support recovery from a single trajectory might take a long time, like over two hundred steps for the double-well case.
Tom: That’s the trade-off, right? You get a powerful way to extract these dynamics quickly, but you need enough data points to be sure you found all the structure.
Jane: So this paper opens up a new way for AI models to not just predict outcomes, but to understand the underlying physical rules of how those outcomes evolve.
ESHWAR R A, GAJANAN V HONNAVAR
PES University
stat.ME, math-ph, math.DS, math.MP, nlin.CD, physics.data-an, stat.ML
Submitted: 2026-03-21
Updated: 2026-10-18
Comments: 39 pages, 11 figures and 5 tables
Code: https://github.com/eshwarRA/Weak-Stochastic-SINDy
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 92/100
The gist: The gist The algorithm presents an algorithm for learning governing equations of a stochastic dynamical system from trajectory data, recovering interpretable symbolic expressions for both drift b(x)
Key concepts
- Drift b(x) and Diffusion a(x)
- These are the core functions defining the stochastic differential equation (SDE). The drift term describes the deterministic force driving the system, while the diffusion term represents the random noise or volatility affecting its movement. The paper focuses on recovering these two functions simultaneously from data.
- State-dependent spatial kernels Kj(Xtn)
- Instead of using time-indexed test functions that introduce bias in stochastic systems, this method uses a weighting function that depends only on the current state of the system at each point (Xtn). This spatial kernel approach ensures unbiased estimation because the weight at any step carries no information about future events.
- Trajectory Averaging vs. Time-step Estimation
- The key innovation is aggregating all candidate terms across the entire trajectory before performing a single regression, rather than estimating dynamics one time step at a time. This prevents process randomness and measurement errors from directly contaminating each individual dynamic estimation, leading to more stable results.
- Identification of Dynamical Quantities
- Once the drift and diffusion are found, the model allows for direct calculation of physical properties. This includes the relaxation timescale (related to spectral gaps), metastable escape rates (via Kramers' formula), and stationary distributions, making the recovered equation immediately useful for analysis.
Terminology
Summary
The gist The algorithm presents an algorithm for learning governing equations of a stochastic dynamical system from trajectory data, recovering interpretable symbolic expressions for both drift b(x) and diffusion a(x) in a single pass, yielding a model that can be queried directly for relaxation timescales, metastable escape rates, and stationary distributions<ref:2603.20904#pg16>.
How it works
The algorithm recovers explicit polynomial expressions for the drift ˆb(x) and diffusion aˆ(x) in a single pass over the data<ref:2603.20904#pg16>. It achieves this by aggregating each candidate term across the entire trajectory before regressing, so that fluctuations average out at the 1/√N rate<ref:2603.20904#pg16>. This approach avoids estimating dynamics one time step at a time, which is problematic because stochastic trajectories are inherently rough and methods that estimate the dynamics from one time step at a time let process randomness and measurement error enter each regression contribution directly<ref:2603.20904#pg16>.
Key methodological innovations
The core innovation is the reformulation that removes the amplification at the source, instead of forming noise-amplifying ratios at all<ref:2603.20904#pg16>. Instead of dividing the increment by ∆t to estimate a pointwise derivative and then averaging, it multiplies the raw increment by a statedependent weighting function Kj and sums along the trajectory<ref:2603.20904#pg16>. This formulation ensures that the noise term is a sum of zero-mean independent contributions, each of order √∆t, so its magnitude grows only as the square root of the number of terms while the signal grows linearly<ref:2603.20904#pg16>. Crucially, because the increment is never divided by ∆t, the variance does not blow up as the sampling rate increases<ref:2603.20904#pg16>.
Addressing bias and consistency
A key design choice makes trajectory averaging correct for stochastic data: weighting contributions by state instead of time<ref:2603.20904#pg16>. The natural weighting in the deterministic weak-form literature is a function of time, φj (tn); applied to a stochastic equation it turns out to be biased, and the bias grows as more data is collected<ref:2603.20904#pg16>. The algorithm sidesteps this entirely by using a state-dependent weighting Kj (Xtn), whose value at each step carries no information about the future<ref:2603.20904#pg16>. This spatial kernel approach guarantees unbiasedness, as the tower property gives E[Kj (Xtn)σ(Xtn)ξn] = 0 at every step<ref:2603.20904#pg16>.
Identification of dynamical quantities
Once b(x) and a(x) are identified, three practically important quantities follow directly without further simulation<ref:2603.20904#pg16>. These include the relaxation timescale, which is controlled by the spectral gap λ1 of L in L 2(µ), where 1/λ1 is the characteristic relaxation time<ref:2603.20904#pg16>. The escape rates from metastable states are related to inter-well transition rates via Kramers’ formula (11)<ref:2603.20904#pg16>. Furthermore, recovering the state-dependent structure of a(x) is essential for reproducing the correct local dynamics, which is key for systems with multiplicative diffusion<ref:2603.20904#pg16>.
Validation and performance
The algorithm was validated on three benchmark systems—the Ornstein–Uhlenbeck process, a double-well Langevin system, and a multiplicative-noise system<ref:2603.20904#pg16>. On these systems, the algorithm recovers all coefficients to within 5%, stationary densities to within 0.01 in total variation, and escape rates that match the true dynamics<ref:2603.20904#pg16>. The recovered symbolic model Lˆf = ˆb(x)f′ + 1/2 aˆ(x)f'' is immediately usable for downstream analysis, such as spectral computation and bifurcation tracking<ref:2603.20904#pg16>.
Conclusion
The algorithm recovers explicit, interpretable expressions for both the drift b(x) and diffusion a(x) in a single pass, and the recovered model can be used directly to compute relaxation timescales, metastable escape rates, and stationary distributions<ref:2603.20904#pg16>. A defining feature of the algorithm is that it averages each candidate term across the whole trajectory before regressing, rather than estimating the dynamics one time step at a time<ref:2603.20904#pg16>. Drift and diffusion are identified jointly from a single shared design matrix, and a drift-informed correction removes the systematic error that finite sampling introduces into the diffusion estimate, reducing it from 4.6% to 0.6% for state-dependent noise<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.7% error), Kramers escape rates (3.2% error), and position-dependent mixing timescales, with stationary-density total-variation distances below 0.01 and autocorrelation functions that faithfully track the true dynamics<ref:2603.20904#pg16>. Across three benchmark systems spanning linear through nonlinear drift and constant through state-dependent diffusion, the algorithm recovers spectral gaps (3.
Improvements for AI systems
-
Active learning of governing equations from trajectory data: The improved system can recover explicit, interpretable symbolic expressions for both drift b(x) and diffusion a(x) in a single pass via
trajectory averaging.
This allows the model to bequeried directly for relaxation timescales, metastable escape rates, and stationary distributions,
enabling real-time analysis of system stability without further simulation or black-box surrogates. -
Noise robustness against measurement error: The improved system incorporates a
drift-informed correction that removes the bias finite sampling introduces into the diffusion estimate, cutting it from 4.6% to 0.6% for state-dependent noise.
This ensures that spectral gap estimations remain consistent under measurement noise, unlike increment-based methods wherethe same 1/∆t amplification afflicts the diffusion estimator.
-
State-space aware dynamics modeling: The system recovers
position-dependent relaxation timescales
andstate-dependent mixing rate
by using state-dependent weighting functions rather than time weighting, which avoids the bias where temporal weights introduce errors thatgrow with dataset size.
This allows for precise characterization of local dynamics across the entire state space, such as recovering γ(x) = b'(x)a(x). -
Accurate metastable state quantification: The system can reliably estimate
Kramers escape rates
and accurately predict stationary densities by recovering the full generator Lˆf = ˆb(x)f′ + 1/2 aˆ(x)f''. This enables direct calculation of quantities like the mean escape time τKramers using the identified potential curvatures and barrier heights. -
Adaptive model selection: The system employs a
grouped K-fold
cross-validation scheme to select sparse coefficients, which is critical for identifying the correct sparsity level by avoidingover-regularised regime.
This ensures that only scientifically significant parameters are recovered, as evidenced by the sharp elbow in LassoCV error plots. -
Efficient computation via shared design matrix: The algorithm computes drift and diffusion jointly from a single shared design matrix A, which is reused for both regression systems. This
halv[es] the data-access cost
by ensuring thatboth A and the kernel evaluations need to be computed only once.
Abstract
Data-driven discovery of governing equations is well developed for deterministic systems but much less so for stochastic ones. We present a sparse-symbolic algorithm that recovers both the drift b(x) and the diffusion a(x) of a stochastic differential equation from a single discretely sampled trajectory. It replaces the time-indexed test functions of weak-form SINDy with state-dependent spatial kernels. Fixed-width time-window weighting induces a persistent endogeneity bias: for the Ornstein-Uhlenbeck process it erases the drift coefficient entirely, whatever the window shape. Spatial kernels avoid this through a martingale strong-law argument, linked to the estimating-function theory of Bibby and Sorensen. We prove consistency of the drift and diffusion estimators for the Euler-Maruyama coefficients, a T-1/2 central limit theorem for the drift, a finite-step correction that links drift and diffusion estimation, and a correction for additive Gaussian observation noise. The theorems assume ergodicity of the Euler-Maruyama chain, which holds for the OU and multiplicative systems but not for the cubic double well, so the double-well results are empirical. The method is validated on three benchmark SDEs (Ornstein-Uhlenbeck, a double well, and multiplicative diffusion), on eight further systems identified from single trajectories with elastic-net-stabilized sparse regression, and in a support-recovery experiment. Exact support recovery from one trajectory needs a long record (about T 200 on the double well) and is not guaranteed for shorter records or weakly identified systems.
Sources
Related papers
- Doubly robust inference via calibration
- Bayesian Empirical Bayes: Simultaneous Inference from Probabilistic Symmetries
- Optimal Watermark Localization in Mixed-Source Large Language Model Texts
- Small area learning
- Flexible Nonparametric Inference for Causal Effects under the Front-Door Model
- A Greedy PDE Router for Blending Neural Operators and Classical Methods