Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions

arXiv:2512.03974 · physics.comp-ph, cs.LG · Submitted 2025-12-03 · Read on arXiv

Listen

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions".

Jane: The gist The proposed method, DiffTTC, corrects machine learning potentials towards accurate predictions of phase diagrams by leveraging top-down learning to match experimental reference data.

Tom: First, who's behind it and why it matters.

Title and authors: Tom: Welcome back everyone. We’re diving into a paper today called "Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions." This research is looking at how we can make those machine learning models for materials much better at predicting phase diagrams, which are basically maps showing when materials change their structure under different conditions like temperature and pressure.

Jane: Right, so the authors are tackling a big problem with foundational machine learning potentials—the classical force fields that speed up molecular dynamics simulations. The issue is that these potentials often have significant deviations from experimental phase transition temperatures, sometimes by several hundred kelvins.

Lu: So they are focusing on using top-down learning to directly correct those wrong predictions and match them against experimental reference data, which is a really smart way to build consistency into the model from the start.

Meng: That sounds like it addresses a major practical hurdle for anyone trying to design new materials using these simulations. How does this approach actually work in practice?

Tom: Well, the paper says they are proposing a fine-tuning strategy via top-down learning that directly corrects wrongly predicted transition temperatures to match experimental reference data, and they use the Differentiable Trajectory Reweighting algorithm to minimize free energy differences between phases at the experimental target pressures and temperatures.

Jane: That algorithm is key because it helps them find those coexistence temperatures by solving an equation where the free energy difference between two phases equals zero at that specific pressure and temperature.

Lu: It’s interesting how they are using non-equilibrium free energy calculations, specifically techniques like the Frenkel-Ladd approach and the Reversible Scaling method, to get these absolute free energies for crystalline solid phases.

Meng: So they are not just tweaking the parameters randomly; they are using thermodynamic theory to define what the correct phase diagram *should* look like before training starts.

Tom: Exactly. They use a machine learning potential, specifically an adapted version of the MACE model combined with a Lennard-Jones potential as a prior, and they pretrain it using force matching against density functional theory reference data.

Jane: But the big move here is the DiffTTC method itself, which adjusts the model's parameters to correct those predicted transition temperatures by minimizing the magnitude of that predicted difference between phases at experimental coexistence points.

Title and authors: Lu: That minimizes a loss function that balances free energy differences between phases and pressure targets, allowing them to align the MLP-predicted phase diagram with an experimental reference.

Meng: So, if you’re using this method on pure Titanium, they show they can accurately correct the phase diagram in a pressure range up to five GPa, matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant <ref:2512.03974#pg2>.

Tom: That is a significant correction because it shows that their approach works for pure Titanium across that pressure range. They also mention that this method is model-agnostic, meaning it can handle multi-component systems with solid-solid or solid-liquid transitions.

Jane: That flexibility is important because MLPs are often used in complex scenarios, not just simple single materials. They are compliant with top-down training on other experimental properties too.

Lu: It means this isn't just a specific fix for one system; it’s a general strategy for improving the predictive quality of any MLP by leveraging experimental data directly to guide the tuning process.

Meng: From an engineering standpoint, that consistency with experiments is huge because it means we can trust the phase stability predictions more when we use these models to screen new alloys or materials.

Tom: And they found that this refined model significantly outperformed multiple reference models, including the pretrained baseline and a DP model from Wen et al., showing temperatures predicted within less than fifty kelvins of the experimental reference for both transitions.

Jane: Plus, they also kept the liquid-state diffusion constant close to what was predicted by the initial baseline, which means it’s not just about fixing one thing; it’s improving other dynamical properties too.

Lu: It reinforces that top-down training is a highly valuable addition to the common force matching training of MLPs because it directly addresses where the models are systematically biased in terms of phase stability.

Meng: So, for practical application, this means when we run MD simulations on a new material using an MLP trained with this method, we should have much more reliable predictions about whether that material will melt or crystallize under certain conditions.

Tom: That’s the idea behind refining machine learning potentials through thermodynamic theory of phase transitions. Now, let’s look at what they actually improved in their methodology.

Jane: The paper points out several improvements, starting with how they implement the top-down learning strategy to correct those transition temperatures directly against experimental measurements.

Title and authors: Lu: They also detail how incorporating volume data into the model helps ensure that the pressure penalty in the loss effectively preserves the predicted volumes at the coexistence temperature, which is crucial for aligning phase boundary slopes.

Meng: So, they are making sure that when you adjust for pressure, you don't accidentally mess up the size of your material phases; they are controlling both energy and volume simultaneously.

Tom: That control over both energy and volume is what allows them to align the MLP-predicted phase diagram with an experimental reference, which is a key part of their refinement process.

Jane: Beyond just temperature matching, they also showed that this method can lead to better out-of-target dynamical properties because after correction, the MLP-predicted diffusion constants differ more pronouncedly and show a better agreement with experiments.

Lu: That’s interesting because it shows that correcting the static phase diagram isn't just about getting the melting point right; it improves how fast things move once you get there.

Meng: So, for someone working on molecular dynamics simulations, this means the simulation results won't just be slightly off in terms of temperature; they should also be more accurate in terms of how quickly the material diffuses.

Tom: It really shows that this is a holistic correction process, not just a single point adjustment. So, what does this all mean when we wrap up this discussion on refining machine learning potentials through thermodynamic theory of phase transitions?

Jane: Essentially, the authors conclude that the DiffTTC refined model is a promising approach because it offers high flexibility for tuning phase stability to align with experimental targets, and they showed it predicts a phase diagram that closely agrees with the reference.

Lu: It’s about showing that top-down learning can be a powerful tool to address the limitations of foundational MLPs by directly training them to match experimental measurements.

Meng: It provides a way to make these models much more accurate and transferable for real material discovery tasks, moving them closer to being truly reliable predictors.

Lalam: This work suggests that by using thermodynamic theory alongside machine learning, we can create potentials that are not just good at calculating forces, but also good at predicting the actual physical behavior of materials under real-world conditions.

The paper's summary: Tom: So, basically, this paper is about taking those machine learning potentials we use for simulations and making them actually predict phase diagrams accurately by forcing them to match real experimental data.

Jane: It’s a top-down way of training those potentials, meaning you don't just train it on raw data; you actively guide the model toward matching what we already know about phase transitions.

Tom: They use this Differentiable Trajectory Reweighting thing to find the free energy differences between phases right at the exact pressures and temperatures we care about experimentally.

Jane: That’s a bit technical, but it means they are using thermodynamics—the theory of how energy changes with temperature and pressure—to set the rules for what a correct phase boundary should look like.

Tom: And they showed that by doing this, pure Titanium’s phase diagram was corrected to match experiments within tenths of kelvins across a whole range up to five gigapascals.

Jane: It’s important because it shows that these MLPs aren't just making guesses; they can be systematically tuned so their predictions align with the physical reality we measure in the lab.

Tom: But this isn't just about getting the melting point right; they also found that after this refinement, how fast things move in the liquid state, like diffusion constants, got better agreement with experiments too.

Jane: So what does this mean for us when we use these potentials to design new materials? It suggests that if we want our simulations to be trustworthy for predicting material stability under pressure and heat, this kind of direct experimental correction is a really valuable tool.

Tom: Yeah, it means the next step is figuring out how much more complex systems they can handle, like binary mixtures or even phases with lots of defects.

Jane: That’s right. The authors are looking ahead to test this method on those more complex scenarios, and see if pre-training the model on volume data could help them correct the shape of phase boundaries even better.

Tom: It sounds like they’re trying to build a super robust model that works across different types of material problems, which is what we need for real material discovery.

The paper's improvements: Tom: So, we’re talking about how they actually improved the method itself beyond just getting better temperature predictions for titanium.

Jane: They focused on making sure that when you tune the model parameters, it doesn't mess up other physical properties in a bad way.

Tom: One big point is how they use volume data to control the pressure penalty in the loss function, so they make sure the predicted volumes at coexistence temperature actually match what we expect.

Jane: That’s a crucial detail because if you only fix the energy, but mess up the volume, your phase boundary slope will be totally wrong.

Tom: And they found that this refined model doesn't just get better at predicting melting points; it also gets better at predicting diffusion constants in the liquid state.

Jane: It means for someone running molecular dynamics simulations, the results should be more reliable not just about when a material melts, but how quickly it can move around once it’s melted.

Tom: It sounds like they’re making a holistic correction, not just tweaking one number to look good on paper.

Jane: Exactly. By balancing the free energy differences and the pressure targets in that loss function, they are aligning the entire phase diagram with reality across multiple physical quantities simultaneously.

Tom: This approach is super flexible too; they mentioned it can be applied to multi-component systems, like binary mixtures or even phases with a lot of defects.

Jane: That means this isn't just a fix for one simple substance; it’s a general strategy that could work for many more complex material problems we face every day.

Tom: And they flagged some things too, which is important—they didn't say this method can predict everything perfectly, and there are still limitations to where it works best.

Jane: They admit the method relies on the initial force matching training being good, so if you start with a very poor baseline model, you might still see issues.

Tom: It’s a fair caveat because it grounds the paper in reality—it doesn't claim perfection; it claims high accuracy through a smart training strategy.

Jane: So what this implies for the future is that we need to keep exploring how to train these models so they are robust enough to handle those more complicated systems they are testing next.

Conclusion: Tom: So to wrap up, the paper "Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions" shows that top-down learning is a solid way to correct those systematic errors in material predictions by directly matching experimental data on phase transitions.

Jane: It means we can take existing machine learning potentials and fine-tune them to align their phase diagrams with real world experiments, which is a big step for making these simulations useful.

Tom: They proved this works well for pure Titanium up to five gigapascals, matching the experimental reference within tenths of kelvins and even improving liquid-state diffusion constants.

Jane: That’s tangible data showing it improves not just static properties like melting points, but dynamic things like how fast materials move in their liquid state.

Tom: The implication is that these MLPs become much more trustworthy for predicting material behavior under real operating conditions, which is exactly what engineers need to see.

Jane: They also showed this method can handle more complex systems than just single elements, like multi-component mixtures with solid-solid transitions.

Tom: Lu, what’s your take on the creative possibilities here?

Lu: I think the ability to correct these models top-down opens up a whole new space for material design; instead of guessing where a transition happens, you’re forcing the AI to follow established thermodynamic rules.

Meng: From an engineering standpoint, that flexibility is crucial because it means we aren't stuck with just one type of material problem; we can tackle binary systems right away.

Lalam: This kind of refinement helps build a better foundation for all future predictive models; it’s like giving the AI a really precise map of physical laws instead of just letting it wander around.

Tom: Lalam, that sounds powerful. So, what's the final word on this paper?

Lalam: It suggests that by using thermodynamic theory alongside machine learning, we can create potentials that are not just good at calculating forces, but also good at predicting the actual physical behavior of materials under real world conditions.

Jane: I think they’ve made a really strong case for why top-down training is a necessary addition to standard force matching training for these models.

Tom: They did their job well by showing concrete improvements in accuracy and transferability across different systems.

Lu: The future work they mention, testing pre-training on volume data or matching Gibbs free energy in the isobaric-isothermal ensemble, looks like it’s going to be a very interesting direction for this method.

Meng: I’m interested in that volume data idea; if we can control the volume penalty better, it could stabilize phase boundary slopes even more reliably.

Lalam: Having that kind of control over physical constraints across different ensembles will help build a culture where we trust the AI predictions more deeply because they’re physically grounded.

Technical University of Munich · Atomistic Modeling Center, Munich Data Science Institute, Technical University of Munich

physics.comp-ph, cs.LG

Submitted: 2025-12-03

Updated: 2025-12-03

DOI: 10.1038/s41524-026-02195-7

Code: https://github.com/tummfm/chemtrain

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 92/100

The gist: The gist The proposed method, DiffTTC, corrects machine learning potentials towards accurate predictions of phase diagrams by leveraging top-down learning to match experimental reference data.

Key concepts

Foundational Machine Learning Potentials: These are AI models trained on material data that aim to replace classical force fields. They allow scientists to gain microscopic insights into material behavior through Molecular Dynamics simulations, significantly speeding up the process of designing and discovering new materials.
Phase Transition Temperatures: These are the specific temperatures and pressures at which a material changes its physical state, such as solid to liquid. These values are crucial for accurately predicting how a material will behave under different conditions in real-world applications.
Top-Down Learning: This is a fine-tuning strategy where the machine learning model is adjusted directly to match experimental results. Instead of just training on standard properties, this method uses experimental phase transition data to correct the model's errors, making its predictions much more accurate for specific physical phenomena.
Differentiable Trajectory Reweighting: This algorithm is used to calculate the free energy differences between two different material phases. It works by simulating trajectories and reweighting them using a differentiable process, allowing the method to accurately determine phase stability at experimental pressures and temperatures.

Terminology

Accuracy — 2× in this paper · explained in 1 episode
Fine-Tuning — 2× in this paper · explained in 5 episodes
Phase Transition — 2× in this paper · explained in 2 episodes
Model-Agnostic — 1× in this paper · explained in 2 episodes
Phase Transitions — 1× in this paper · explained in 2 episodes
Transferability — 1× in this paper · explained in 5 episodes

Summary

The gist The proposed method, DiffTTC, corrects machine learning potentials towards accurate predictions of phase diagrams by leveraging top-down learning to match experimental reference data.

Introduction and Motivation

Foundational Machine Learning Potentials can resolve the accuracy and transferability limitations of classical force fields They enable microscopic insights into material behavior through Molecular Dynamics simulations, which can crucially expedite material design and discovery However, insufficiently broad and systematically biased reference data affect the predictive quality of the learned models Often, these models exhibit significant deviations from experimentally observed phase transition temperatures, in the order of several hundred kelvins This work proposes a fine-tuning strategy via top-down learning, directly correcting the wrongly predicted transition temperatures to match the experimental reference data Our approach leverages the Differentiable Trajectory Reweighting algorithm to minimize the free energy differences between phases at the experimental target pressures and temperatures We demonstrate that our approach can accurately correct the phase diagram of pure Titanium in a pressure range of up to 5 GPa, matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant Our approach is model-agnostic, applicable to multi-component systems with solid-solid and solid-liquid transitions, and compliant with top-down training on other experimental properties

Methods for Transition Temperature Computation

The computation of transition temperatures is based on the thermodynamic theory of phase transitions and direct solid-liquid interface simulations Two phases I and II are in equilibrium if they have equal temperature T, pressure P, and chemical potential µ The coexistence temperature Tˆ and pressure Pˆ are determined by solving the equation GII(T, ˆPˆ) − G I(T, ˆPˆ) = ∆G I→II(T, ˆPˆ) = 0 This process typically involves two steps: first, computing the free energy difference between phases at a reference pressure or temperature using methods like the Pseudo-Critical path method or the Frenkel-Ladd method Second, calculating the change in free energy with varying pressure or temperature using techniques such as multi-state reweighting or the Reversible Scaling method

Non-equilibrium Free Energy Calculations

Thermodynamic integration estimates free energies between two potentials by computing the integral ∆F I→II = F II − F I = ∫ Z 1/0 ∂u/∂λ dλ = Wrev Non-equilibrium approaches approximate the reversible work by driving the system from λ(0) = 0 to λ(ts) = 1 within a finite time ts to obtain the irreversible work Wirr as an upper bound The Frenkel-Ladd approach is an efficient method for computing absolute free energies of crystalline solid phases and, consequently, the free energy difference between the phases The Reversible Scaling path provides the free energy change across multiple temperatures within a single simulation for each phase at constant pressure

Machine Learning Potential and Refinement

MLPs are parametric models with parameters θ that derive forces f = −∂uθ(r)/∂r from a potential function uθ(r) that depends on all particle positions r The paper uses an adapted version of the MACE [11] model, combining it with the pairwise Lennard-Jones potential as an additive prior The MLP is pretrained using the Force Matching method, minimizing a loss function L(θ) that balances errors in potential energy uθ(hi, ˜ri), force fθ(hi, ˜ri), and stress σθ(hi, ˜ri) against DFT reference data The DiffTTC method adjusts the model’s parameters to correct predicted transition temperatures by minimizing the magnitude of the predicted difference ∆GI→II θ (Texp, Pexp) θ → 0 at the experimental coexistence point

Results and Discussion

The DiffTTC-refined model significantly outperformed multiple reference models, including the pretrained baseline, the DP model from Wen et al. [7], and the foundational MACE-MP-0b3 [15] model The phase diagram of the DiffTTC-refined model closely agreed with the experimental reference, with temperatures predicted within less than 50 K of the experimental reference for both transitions The RDF and ADF in the liquid phase predicted by the DiffTTC-refined model remained close to those predicted by the pretrained baseline and in good agreement with experimental data Our method is independent of the procedure to compute the free energy difference between two phases for the initial MLP The results strengthen the opinion that top-down training is a highly valuable addition to the common Force Matching training of MLPs The DiffTTC method can be applied to more complex systems, such as binary or ternary phase transitions or phases with constant defect concentration

Future Work

In future work, the authors plan to test the DiffTTC method for multicomponent systems and train an accurate and transferable MLP They also plan to test whether pretraining the MLP on volume data or matching the Gibbs Free Energy in the isobaric-isothermal ensemble might correct the slopes of the phase boundaries Moreover, they plan to test whether data from the same phase across different temperatures and pressures can be shared or reused to reduce computational cost associated with running molecular dynamics simulations independently for each temperature and pressure

Conclusion

The DiffTTC method is a promising approach to overcoming issues in foundational MLPs through top-down learning due to its high flexibility This method can tune the phase stability predicted for MLPs to align with experimental targets The authors conclude that the DiffTTC-refined model predicts a phase diagram closely agreeing with the experimental reference, noticeably outperforming all other presented models

The paper is 2512.03974.

--- Page 1 ---

Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions Paul Fuchsa, Julija Zavadlava,b,1 Multiscale Modeling of Fluid Materials, Technical University of Munich, Boltzmannstraße 15, Garching, 85748, Bavaria, Germany b Atomistic Modeling Center, Munich Data Science Institute, Technical University of Munich Walther-von-Dyck Straße 10 Garching, 85748 Bavaria Germany Abstract Foundational Machine Learning Potentials can resolve the accuracy and transferability limitations of classical force fields They enable microscopic insights into material behavior through Molecular Dynamics simulations which can crucially expedite material design and discovery However insufficiently broad and systematically biased reference data affect the predictive quality of the learned models Often these models exhibit significant deviations from experimentally observed phase transition temperatures in the order of several hundred kelvins Thus fine-tuning is necessary to achieve adequate accuracy in many practical problems This work proposes a fine-tuning strategy via top-down learning directly correcting the wrongly predicted transition temperatures to match the experimental reference data Our approach leverages the Differentiable Trajectory Reweighting algorithm to minimize the free energy differences between phases at the experimental target pressures and temperatures We demonstrate that our approach can accurately correct the phase diagram of pure Titanium in a pressure range of up to 5 GPa matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant Our approach is model-agnostic applicable to multi-component systems with solid-solid and solid-liquid transitions and compliant with top-down training on other experimental properties Therefore our approach can serve as an essential step towards highly accurate application-specific and foundational machine learning potentials Preprint December 4, 2025 arXiv:2512.03974v1 [physics.

Improvements for AI systems

A top-down learning strategy can be implemented to correct MLPs towards accurate predictions of phase diagrams by directly training MLPs to match experimental measurements, which can correct pretrained MLPs for discrepancies with experimental data without inducing a large deviation from the underlying reference data (Page 3).
The improved system can accurately correct the phase diagram of pure Titanium in a pressure range of up to 5 GPa, matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant (Page 1).
The system can be made model-agnostic, applicable to multi-component systems with solid-solid and solid-liquid transitions, and compliant with top-down training on other experimental properties (Page 1).
The DiffTTC method minimizes a loss function that balances free energy differences between phases and pressure targets, allowing the system to align the MLP-predicted phase diagram with an experimental reference (Page 8).
By incorporating volume data, the model can be optimized to ensure the pressure penalty in the loss effectively preserves the predicted volumes at the coexistence temperature, which is crucial for aligning phase boundary slopes (Page 16).
The refinement process can lead to better out-of-target dynamical properties; specifically, after correction, the MLP-predicted diffusion constants differ more pronouncedly and can show a better agreement with experiments (Page 17).

Abstract

Foundational Machine Learning Potentials can resolve the accuracy and transferability limitations of classical force fields. They enable microscopic insights into material behavior through Molecular Dynamics simulations, which can crucially expedite material design and discovery. However, insufficiently broad and systematically biased reference data affect the predictive quality of the learned models. Often, these models exhibit significant deviations from experimentally observed phase transition temperatures, in the order of several hundred kelvins. Thus, fine-tuning is necessary to achieve adequate accuracy in many practical problems. This work proposes a fine-tuning strategy via top-down learning, directly correcting the wrongly predicted transition temperatures to match the experimental reference data. Our approach leverages the Differentiable Trajectory Reweighting algorithm to minimize the free energy differences between phases at the experimental target pressures and temperatures. We demonstrate that our approach can accurately correct the phase diagram of pure Titanium in a pressure range of up to 5 GPa, matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant. Our approach is model-agnostic, applicable to multi-component systems with solid-solid and solid-liquid transitions, and compliant with top-down training on other experimental properties. Therefore, our approach can serve as an essential step towards highly accurate application-specific and foundational machine learning potentials.