Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching

summary

Video file (mp4)

The gist

The gist: This work presents, to the best of our knowledge, the first adaptive collocation sampling strategy for PINNs in metal AM.

In short

The work introduces a novel adaptive collocation sampling strategy for Physics-Informed Neural Networks (PINNs) used in metal Additive Manufacturing (AM). It proposes a two-stage framework using Conditional Flow Matching to dynamically select where to place training points based on process conditions. This method significantly improves generalization compared to traditional static sampling by focusing computational effort where thermal gradients are most complex.

Key concepts

Adaptive Collocation Sampling
This is a strategy for choosing the specific locations in a neural network's training data (collocation points). Instead of picking points randomly or statically, this method intelligently selects points based on the current process conditions, such as temperature profiles during metal printing. The goal is to place more 'attention' where the physics are hardest to model.
Conditional Flow Matching (CFM)
CFM is a generative modeling technique used here to approximate the complex distribution of high-residual errors that occur under different process conditions. It allows the system to efficiently generate relevant collocation points in a single step, making it possible to adapt sampling dynamically during training without needing separate models for every condition.
Domain-Informed Mixture Proposal
This is a method used in the second stage of sampling to balance exploration (trying new areas) and exploitation (focusing on known difficult areas). It combines points generated by a learned proposal with points from a base distribution, controlled by a mixture weight. This ensures the sampling process efficiently covers both general and specific thermal challenges.
Process Condition-Aware Sampling
This refers to tailoring the placement of training data based on the specific parameters of the metal AM process (e.g., laser power, scan speed). Conventional methods use fixed patterns, but this approach makes sampling decisions dependent on these conditions. The paper proves that making sampling condition-aware is strictly better for generalization than using fixed, static sampling points.

Terminology used across episodes

This episode discusses

The paper

Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching · Read on arXiv

Hyeonsu Lee, Jihoon Jeong

Texas A&M University

Accurate thermal modeling is essential in metal additive manufacturing (AM) for understanding the process-structure-property chain. Physics-informed neural networks (PINNs) offer effective surrogate thermal modeling by minimizing physics-based residual losses at collocation points. However, prior works typically rely on manually-crafted, static collocation sampling strategies, which are neither principled nor scalable across process conditions, hindering their generalization capability. In this work, we provide theoretical analysis through empirical risk minimization, showing that process condition-aware adaptive sampling is strictly more favorable than conventional static sampling for generalization. Building on this insight, we propose an adaptive sampling strategy within a two-stage framework: (1) a conditional Flow Matching model that learns approximate high-residual distributions across different process conditions, and (2) a mixed sampling strategy combining this distribution with a domain-informed base distribution to generate adaptive collocation points for refining the PINN predictor. Experiments on metal AM numerical benchmarks demonstrate that our method consistently outperforms state-of-the-art PINN baselines, achieving an average 62.1% reduction in relative L 2 error under an identical collocation budget, by capturing process-dependent heat dissipation regions often overlooked in the literature. To the authors' knowledge, this is the first adaptive sampling strategy for PINNs in metal AM, contributing to the enhanced generalization and broader applicability.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching".

Jane: The gist: This work presents, to the best of our knowledge, the first adaptive collocation sampling strategy for PINNs in metal AM.

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So, to wrap up, the paper "Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching" is arguing that process condition-aware adaptive sampling is critical for making parametric PINNs work well in metal AM <ref:2610.09126#pg6>.

Jane: It’s about moving away from those manually crafted, static sampling strategies and toward a framework that learns where to place those points based on the process conditions, using conditional Flow Matching models and domain knowledge <ref:2610.09126#pg3>.

Lu: The theoretical foundation they provide shows that the adaptive proposal is strictly superior to conventional proposals because it’s proportional to the squared residual under each process condition and instant <ref:2610.09126#pg4>.

Meng: From a deployment view, this means we’re looking at a more robust training pipeline where the sampling itself becomes smarter about what needs attention <ref:2610.09126#pg4>.

Lalam: The main contribution is providing that theoretical foundation for collocation sampling from a generalization standpoint, along with a practical framework that scales across process conditions via amortized generative modeling and domain knowledge integration <ref:2610.09126#pg6>.

Tom: It’s about giving PINNs the ability to truly generalize across the diverse process conditions inherent in metal AM, which is what they claim is essential for understanding the entire process-structure-property chain <ref:2610.09126#pg1>.

Conclusion: Tom: So, we’ve gone through how this paper uses adaptive sampling to make physics models work better for metal additive manufacturing <ref:2610.09126#pg4>.

Jane: Exactly. The title itself is pretty technical, but the core idea is that you can’t use a one-size-fits-all sampling strategy when you are trying to model something complex like metal AM where the process conditions change so much <ref:2610.09126#pg4>.

Lu: The authors are using conditional Flow Matching models to generate these points adaptively, which basically means the AI learns where it needs more data based on what’s happening in the model itself <ref:2610.09126#pg4>.

Meng: From a deployment standpoint, I’m looking at this because if you can make a PINN generalize across different material properties without needing to retrain everything from scratch for every new process, that cuts down on the cost of getting a model ready <ref:2610.09126#pg4>.

Lalam: I’m pretty sure this paper is showing that when you tune the sampling based on the residual, which is how much the model is failing in specific spots, you get way better results than just throwing a million points at it randomly <ref:2610.09126#pg4>.

Tom: It sounds like they’re claiming this adaptive approach doesn't just give you a slightly better fit, but it actually helps the model generalize across different process conditions <ref:2610.09126#pg4>.

Jane: That’s right. The theoretical analysis they did proves that their adaptive proposal is strictly better than the standard static sampling methods we usually see in these simulations <ref:2610.09126#pg4>.

Lu: Specifically, Theorem two point one shows that conventional static sampling is strictly inferior to the adaptive sampling method because it’s mathematically tied to reducing statistical error rather than just increasing the total number of samples <ref:2610.09126#pg4>.

Meng: So what does that actually mean for a production system? It means we can use fewer collocation points and still get high accuracy, which is pretty good for efficiency <ref:2610.09126#pg4>.

Lalam: I think the main thing they’re pointing out is that the optimal sampling proposal should be proportional to the squared residual under each process condition and instant <ref:2610.09126#pg4>.

Tom: That’s a big shift. It moves us from guessing where to sample to letting the AI tell us exactly where it needs attention based on its own error signals <ref:2610.09126#pg4>.

Jane: And they did show this in experiments, achieving about a sixty-two percent reduction in relative L two error compared to other state-of-the-art parametric PINNs when using the same number of samples <ref:2610.09126#pg4>.

Lu: The ablation study is also important because it confirms that you need that domain knowledge from the base distribution to get both peak accuracy and stable training <ref:2610.09126#pg4>.

Meng: I still have to think about how much data the Conditional Flow Matching generator itself needs to be trained on before we can even use this thing in a real scenario <ref:2610.09126#pg4>.

More episodes

← Home