Domain Shift in Echocardiography: Interpretable Quantification and Prediction of Cross-Dataset Left Ventricular Segmentation

arXiv:2607.19643 · cs.CV · Submitted 2026-07-22 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Hi, I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Domain Shift in Echocardiography".

Jane: Here's the gist of the paper. Detailed Research Summary: Domain Shift in Echocardiography: Interpretable Quantification and Prediction of Cross-Dataset Left Ventricular Segmentation This research addresses a critical bottleneck in deploying echocardiographic left ventricular (LV) segmentation models: cross-dataset generalization.

Tom: The core problem is that the sources of this domain shift—the differences between datasets—are rarely disentangled, making it difficult to predict transfer degradation before clinical deployment.

Jane: The study proposes an interpretable framework designed to analyze and predict this domain shift by strategically combining three distinct types of representations: 1.

Tom: Handcrafted Ultrasound Descriptors: Physically meaningful features extracted directly from the images.

Paper summary: Jane: So what did they actually find when they ran this analysis? They found that geometry-aware preprocessing really helped a lot with some of the poor transfer cases >

Tom: That's interesting. What does that mean in practice for someone using these models? Does it mean we should spend more time on how we frame the images instead of just tweaking the AI model architecture >

Lu: It suggests that much of what looks like a big difference between datasets is actually just field-of-view and framing inconsistencies rather than just intrinsic acoustic differences between the ultrasound machines >

Jane: And they also found that intensity znormalisation didn't change how separate the datasets were by more than zero point zero zero five, so brightness and contrast aren't the main thing causing the shift > <ref:2607.19643#pg1>

Meng: That’s good news for us in production. If we know it’s not just about brightness, we can stop wasting time on those kinds of pre-processing fixes >

Tom: The study also predicted the absolute Dice drop on held-out source-target pairs with an R squared value of zero point six one two, an MAE of zero point zero eight two, and a Spearman rho of zero point six eight one >

Lu: That prediction is solid enough to be useful for monitoring transfer risk before deployment >

Conclusion: Jane: So, looking at the title, "Interpretable Quantification and Prediction" really sums up what this work is aiming for, right >

Tom: Yeah. The authors Soroush Elyasi, Nasim Dadashi Serej, and Julie Wall did a lot of work here trying to figure out which specific image properties cause the model to fail when moving between different echo datasets >

Lu: It’s important because it moves us away from just treating domain shift as some kind of model failure that we fix after deployment >

Meng: If we can use this framework, maybe we can actually select the right source dataset for a new clinical application, or at least warn a doctor if the data they are using is too different from what the model was trained on >

Jane: Exactly. The main implication is that by combining these different ways of looking at the image—handcrafted features and latent representations—we get a better picture of what's actually causing the performance drop >

Soroush Elyasi, Nasim Dadashi Serej, Julie Wall, Massoud Zolgharni

THRIVE Centre, School of Computing and Engineering, University of West London

cs.CV

Submitted: 2026-07-22

Updated: 2026-10-17

Code: https://github.com/soroushelyasi/domain_shift

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 92/100

The gist: Detailed Research Summary: Domain Shift in Echocardiography: Interpretable Quantification and Prediction of Cross-Dataset Left Ventricular Segmentation This research addresses a critical bottleneck

Key concepts

Handcrafted Ultrasound Descriptors
These are physical features extracted directly from the ultrasound images, such as texture or shape metrics. They are manually designed to capture specific visual characteristics of the echocardiographic data. The study found that these features, when z-normalized, were effective in quantifying domain shift.
VAE Latent Features
These are compressed, abstract representations learned by a Variational Autoencoder (VAE). They capture the underlying distribution and general patterns within the ultrasound data in a lower-dimensional space. These features provide a holistic view of the dataset's structure.
Segmentation-Derived Latent Features
These features are learned directly from the LV segmentation process itself. They focus on anatomical and structural variations relevant specifically to identifying the left ventricle. The study showed these features were most informative for predicting transfer risk, emphasizing task-specific anatomy.

Terminology

Summary

Detailed Research Summary: Domain Shift in Echocardiography: Interpretable Quantification and Prediction of Cross-Dataset Left Ventricular Segmentation

This research addresses a critical bottleneck in deploying echocardiographic left ventricular (LV) segmentation models: cross-dataset generalization. The core problem is that the sources of this domain shift—the differences between datasets—are rarely disentangled, making it difficult to predict transfer degradation before clinical deployment.

The study proposes an interpretable framework designed to analyze and predict this domain shift by strategically combining three distinct types of representations:

  1. Handcrafted Ultrasound Descriptors: Physically meaningful features extracted directly from the images.

  2. Unsupervised VAE Latent Features: Learned features from a Variational Autoencoder, capturing underlying data distributions.

  3. Segmentation-Derived Latent Features: Task-specific representations learned directly from the LV segmentation process itself, emphasizing anatomical and structural variations relevant to the task.

Key Findings on Domain Shift Characterization

The central contribution of this work is its controlled multi-setting analysis, which allows researchers to separate artifacts introduced by preprocessing steps (like field-of-view or framing inconsistencies) from intrinsic acoustic differences between datasets. The study demonstrates that while dataset separability and transfer performance are related, they are not equivalent.

1. Impact of Preprocessing:

  • Geometry-Aware Preprocessing is Crucial: The application of geometry-aware preprocessing (specifically padding followed by resizing without cropping) substantially improved performance on cases exhibiting poor transfer. This suggests that a significant portion of the observed domain shift is attributable to field-of-view and framing inconsistencies rather than solely intrinsic acoustic differences.

  • Intensity Normalization is Minor: Changes in intensity normalization had a negligible effect on dataset separability (less than 0.005), indicating that brightness and contrast are not dominant axes of the domain shift.

2. Quantifying Transfer Risk:

The study successfully predicted absolute Dice drop on held-out source-target pairs with reasonable accuracy (R squared = 0.612, MAE = 0.082, rho = 0.681). Crucially, the analysis showed that task-specific segmentation features were most closely aligned with transfer performance because they effectively emphasized the anatomical and structural variations pertinent to LV segmentation.

3. Representation-Specific Discrepancy Measures:

The study rigorously compared the informativeness of different representations for quantifying domain shift:

  • Handcrafted Features (e.g., CMD): Showed strong predictive power, particularly in the z-normalised handcrafted features (r about 0.86, R squared about 0.70). However, their effectiveness was dependent on the specific feature set chosen and the discrepancy measure applied.

  • VAE Space (logWasserstein): Demonstrated high explanatory power (r about-0.90, R squared about 0.81).

  • LV-Segmentation Latent Features (log-MMD): Emerged as the most consistent practical default measure for monitoring domain shift (r about-0.92, R squared about 0.84).

4. Factors Influencing Transfer Risk:

The analysis revealed that transfer risk is related to:

  • The robustness and coverage of the source dataset.

  • The distance of target images from the source distribution.

  • Differences in anatomical framing (which was mitigated by geometry-aware preprocessing).

Furthermore, the study concluded that dataset identity, institutional acquisition practices, imaging protocols, export procedures, and cohort composition provided a more complete explanation for transfer behavior than scanner manufacturer alone.

Proposed Framework and Future Directions

The overarching contribution is the proposed framework: the complementary use of interpretable (handcrafted), unsupervised (VAE), and task-specific (segmentation) representations provides a practical methodology for characterizing and predicting cross-dataset transfer degradation. This framework allows for:

  1. Assessing Generalisability: Providing a quantifiable basis to evaluate segmentation models before clinical deployment.

  2. Source-Dataset Selection: Using feature-distance measures to identify source datasets that are most likely to yield good transfer performance or, conversely, identifying target images likely to transfer poorly.

  3. Prioritization: Identifying challenging cases for targeted annotation, model adaptation, or additional data collection without requiring prior target-domain model training.

While the study explored advanced techniques such as CycleGANs and VAE reconstructions (which showed limited improvement in segmentation performance), the primary takeaway is that feature-distance measures derived from representation-specific latent spaces offer a robust, interpretable tool for managing the inherent uncertainty of cross-dataset generalization in echocardiographic LV segmentation.

Improvements for AI systems

  1. Bold header: Geometry-aware Preprocessing Integration

This improvement involves applying a geometry-aware preprocessing pipeline to all echocardiographic images before feature extraction, as this substantially improved several poor transfer cases. The resulting AI system can more reliably segment LV across different scanner types by mitigating field-of-view and framing inconsistencies rather than intrinsic acoustic differences alone.

  1. Bold header: Representation-Specific Transfer Risk Estimation

The system should utilize representation-specific discrepancy measures, such as logWasserstein in VAE space or log-MMD in LV-segmentation latent features, to quantify domain shift. This allows the AI to anticipate [transfer risk] and select the most informative predictors for transfer risk estimation.

  1. Bold header: Unified Feature Ranking Framework

The improved system should employ a unified ranking that combines results from domain-separation analysis, z-distance correlation with Dice drop, and transfer-model permutation importance. This provides a more robust indication of the image-domain discrepancies most relevant to cross-dataset segmentation performance, leading to better feature selection.

  1. Bold header: Task-Specific Latent Feature Prioritization

The AI can prioritize segmentation-derived features over purely image-based latent features when assessing transfer risk, as these provide stronger task relevance when a trained model is available. This ensures the estimation reflects anatomical and structural variations critical for LV segmentation.

  1. Bold header: Robustness Against Global Intensity Scaling

The system should be engineered to recognize that intensity normalisation changed dataset separability by less than 0.005, indicating that brightness and contrast are not the dominant shift axis. This prevents reliance on simple intensity rescaling and focuses the model on more persistent features like texture, frequency-domain, gradient-based, and geometric descriptors.

Sources

Related papers