Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation".
Jane: Here's the gist of the paper. The gist The study proposes an external projection-based coupling method that uses a pinhole camera model to relate two-dimensional temperature data from infrared thermography to three-dimensional point coordinates from stereocorrelation-based digital image correlation, which is particularly suited for analyzing curved surfaces How it works The core of the proposed method involves relating two different measurement modalities: pixel temperatures from infrared thermography and three-dimensional point coordinates from stereocorrelation-based digital image correlation The approach is based on the perspective projection equation, which maps three-dimensional object points to two-dimensional image planes using a pinhole camera model 1.
Tom: Calibration of the Projection Matrix M: The projection matrix M, which incorporates intrinsic and extrinsic camera parameters, is calibrated using a single image of a three-dimensional reference object, such as an open-book-shaped target This calibration can be performed without prior heating of the reference target.
Tom: Image Registration: After calibration, the actual image acquisition and evaluation are performed, where point coordinates x are determined by DIC and pixel coordinates xΘ are obtained from the IR image via edge detection.
Paper summary: Tom: So, to recap where we are, this paper introduces the "Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation". The core thesis is solving the problem of expressing two different datasets, DIC coordinates in a Lagrangian frame and IRT temperatures in an Eulerian frame, when you're looking at non-flat surfaces >
Jane: Right. The paper claims they propose an external projection-based coupling that uses the pinhole camera model to bridge that gap >
Lu: Basically, they use the perspective projection equation to relate two-dimensional temperature data measured by infrared thermography to three-dimensional point coordinates from stereocorrelation-based digital image correlation >
Meng: So they are taking the 2D pixel temperatures and linking them directly to the three dee material points derived from DIC through this camera model >
Lalam: And they do this by calibrating the projection matrix M using a single image of a three-dimensional reference object, which doesn't even have to be heated for that calibration >
Tom: That’s the key mechanism. They are using those calibrated parameters to accurately represent temperature fields at material points on an arbitrarily shaped surface >
Jane: The paper highlights that unlike existing multiview approaches, they use two independently calibrated industrial-grade systems and augment the experimental evaluation with this pinhole camera model >
Lu: They are focused on providing a modular approach to generate extensive and information-rich data for the calibration and validation of thermo-mechanically coupled constitutive models >
Meng: The paper claims this is especially useful for the calibration and validation of both isotropic and anisotropic materials, or even the detection of defects >
Lalam: And they also extend the global interpolation approach from forty-five into the temporal domain to get temperature gradients and rates on curved surfaces > <ref:2606.28905#pg3,extend the global interpolation approach>
Tom: So, essentially they’ve successfully coupled these two modalities to get a full-field dataset that includes both spatial information and temporal information on curved geometries >
Jane: It’s a neat combination because it tackles the inherent difficulty of relating DIC and IRT when you need everything in the same Lagrangian frame >
Conclusion: Tom: So looking at the title, "Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation", it sounds very specific about what they are doing with these two things >
Jane: It really is. The implication for me is that for experimental solid mechanics, this gives us a way to get temperature data that lives in the same reference frame as the mechanical measurements >
Lu: It means you can use this coupled data to test complex constitutive models that depend on how heat and deformation interact on curved geometries >
Meng: For production, it suggests we could potentially integrate these techniques into existing experimental workflows without needing a totally new setup for every single experiment >
Lalam: I'm confident that the main contribution is establishing this projection-based method as a way to express the temperature field in the same Lagrangian frame as mechanical fields >
Tom: So, they’re not just making a neat trick; they are providing a robust way to get full-field data, including gradients and rates on curved surfaces from these two sources >
Jane: And that capability means we can move beyond just knowing where the temperature is to understanding how it's changing over time across a surface >
Clausthal University of Technology
cs.CV, cond-mat.mtrl-sci, physics.optics
Submitted: 2026-06-27
Updated: 2026-10-20
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 77/100
The gist: The gist The study proposes an external projection-based coupling method that uses a pinhole camera model to relate two-dimensional temperature data from infrared thermography to three-dimensional
Key concepts
- External Projection-Based Coupling
- This is a method that connects two separate measurement systems—infrared thermography (measuring surface temperature) and stereocorrelation DIC (measuring 3D coordinates)—by using a pinhole camera model as a bridge. It maps the 3D points from DIC into the 2D image plane where the IRT data exists, allowing both datasets to be analyzed together in a common reference frame.
- Pinhole Camera Model
- This is a mathematical model used to describe how light travels from a 3D point on an object to its corresponding 2D projection on an image sensor. The paper uses this model, calibrated by a single reference image, to accurately project the 3D coordinates derived from DIC onto the pixel locations where temperature measurements were taken by infrared thermography.
- Radial Basis Functions (RBFs)
- RBFs are used as a global interpolation tool in both space and time. They help reconstruct a full-field dataset of temperature information on curved surfaces by taking discrete point data and creating a smooth, continuous representation. This enables the computation of temperature gradients and rates across the surface.
- Stereocorrelation-Based DIC
- This technique is used to determine precise three-dimensional point coordinates on a surface by analyzing patterns in images captured from multiple viewpoints. The paper uses this method to obtain the 3D point coordinates necessary for coupling with the temperature data from infrared thermography.
Summary
The gist The study proposes an external projection-based coupling method that uses a pinhole camera model to relate two-dimensional temperature data from infrared thermography to three-dimensional point coordinates from stereocorrelation-based digital image correlation, which is particularly suited for analyzing curved surfaces
How it works
The core of the proposed method involves relating two different measurement modalities: pixel temperatures from infrared thermography and three-dimensional point coordinates from stereocorrelation-based digital image correlation The approach is based on the perspective projection equation, which maps three-dimensional object points to two-dimensional image planes using a pinhole camera model
-
Calibration of the Projection Matrix M: The projection matrix M, which incorporates intrinsic and extrinsic camera parameters, is calibrated using a single image of a three-dimensional reference object, such as an open-book-shaped target This calibration can be performed without prior heating of the reference target.
-
Image Registration: After calibration, the actual image acquisition and evaluation are performed, where point coordinates x are determined by DIC and pixel coordinates xΘ are obtained from the IR image via edge detection. The relationship between these points is governed by the equation xΘ = M x.
-
Interpolation using Radial Basis Functions (RBFs): To compute in-plane temperature gradients and temperature rates on curved surfaces, radial basis functions (RBFs) are utilized as a global interpolation ansatz in both space and time The point coordinates x are projected into the IR image plane using the projection matrix M to evaluate point temperatures on an arbitrarily shaped surface.
-
Computation of Gradients and Rates: The in-plane temperature gradient is expressed as grad Θ = d ∂Θ / ∂Ψα a α, where the total derivative dxˆΘ/dx is computed by differentiating the projection equation (1). The temperature rate is defined as the material time derivative of the temperature, Θ = ˙ dΘˆ / d xˆΘ (xˆ(Ψ, t)), t dt = ∂Θˆ / ∂t + ∂Θˆ / ∂x Θ dx̂/dx∂x̂∂t.
Key Components and Methodology
The methodology is designed to provide a modular approach that is applicable independently of the specific system manufacturer or access to DIC codes, relying instead entirely on (three-dimensional) point coordinates and pixel temperatures The study emphasizes that this external calibration of the projection, while potentially less accurate than hybrid multiview frameworks, allows for straightforward coupling of data from industrial-grade imaging systems.
The reconstruction of a curvilinear surface from discrete pointwise data is achieved using surface parameters Ψ1 and Ψ2, which are then used in the RBF interpolation formula to define the point on the surface x(Ψ, t) The interpolation coefficients a s and b s in Eq. (10) are determined by solving a system of linear equations derived from stereocorrelation-based DIC.
Experimental Validation
The proposed approach was demonstrated through two experiments involving curved and complex surfaces in both purely thermal and thermo-mechanically coupled settings
-
Cylindrical Polymer Half-Shell: This example operated in an entirely thermal setting, where DIC point coordinates were used solely to capture the curved specimen surface. The results showed that temperature increases were observed only in the vicinity of the contact regions with the heat plate due to relatively low thermal conductivity.
-
Tube under Tension-Torsion Load: This thermo-mechanical setup involved a zinc die-casting alloy tube subjected to a proportional tension-torsion load, allowing for the evaluation of full-field data on a curved surface. The results demonstrated that the approach effectively couples point coordinates from stereocorrelation-based DIC with pixel temperatures from IRT, enabling the computation of spatial gradients and temporal rates.
Conclusion
The developed projection approach successfully couples point coordinates from stereocorrelation-based DIC with pixel temperature data from IRT to express the temperature field in the same Lagrangian frame as mechanical fields Furthermore, extending the radial basis function-based evaluation of full-field data to a spatial and temporal interpolation enables the evaluation of in-plane temperature gradients and temperature rates on flat and curved surfaces.
Experimental Validation
The proposed approach was demonstrated through two experiments involving curved and complex surfaces in both purely thermal and thermo-mechanically coupled settings
- Cylindrical Polymer Half-Shell: This example operated in an entirely thermal setting, where DIC point coordinates were used solely to capture the curved specimen surface.
Improvements for AI systems
-
Based on Equation (27) of Section 13, an improved system can perform direct coupling between pixel coordinates and real-world coordinates by reformulating the projection equation as:
xΘ = 1/σ(x) 'm˜⊤1 m˜⊤2#x + (m14 m24)! = 1/m˜⊤3 x + m34 'm˜⊤1 m˜⊤2#x + (m14 m24)!
. This allows for a more direct, coordinate-based relationship between the Lagrangian material points and the Eulerian pixel temperatures. -
The system can compute
in-plane temperature gradients and temperature rates on flat and curved surfaces
by utilizing the derived relations in Equations (6) and (9), which are computed fromcontinuous interpolation of the pixel temperatures with respect to time t and pixel coordinates xΘ
andof the point coordinates x with respect to time t and surface parameters Ψ
. -
The improved system can perform strain analysis on curved surfaces by leveraging Equation (25) for computing covariant metric coefficients, allowing for the determination of
in-plane temperature gradients (6)
which are essential inputs for calculating the deformation gradient Fˆ = ⃗aα ⊗ A⃗α" in Section 13.
Abstract
Full-field measurement techniques such as digital image correlation and infrared thermography are prevalent in experimental solid mechanics. Digital image correlation is used to analyze surface deformation, while infrared thermography quantifies surface temperature fields. However, sophisticated procedures are necessary to express both datasets in the same Lagrangian frame, especially when analyzing non-flat surfaces. In this study, we propose an external projection-based coupling that uses the pinhole camera model to relate two-dimensional temperature data measured by infrared thermography to three-dimensional point coordinates from stereocorrelation-based digital image correlation. Unlike existing multiview approaches, we utilize two independently calibrated industrial-grade systems and augment the experimental evaluation with the pinhole camera model. The projection matrix of the camera model is calibrated using a single image of a reference object. Through this projection, temperature fields are accurately represented at material points. Our method is particularly suited for, but not restricted to, curved surfaces and is straightforward to embed in existing experimental protocols, as the image registration is kept as is. Additionally, we use radial basis functions as a global interpolation ansatz in both space and time to compute in-plane temperature gradients and even temperature rates on curved surfaces, thereby providing an extensive and information-rich full-field dataset.
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models