Streamline pathology foundation model by cross-magnification distillation
cs.CV
Submitted: 2025-09-27
Updated: 2026-10-11
Code: https://github.com/AI4Path-Lab/XMAG
Project page: https://bmirds.github.io/KidneyCancer
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Foundation models (FM) have transformed computational pathology but remain computationally prohibitive for clinical deployment due to their massive parameter counts and high-magnification processing
Terminology
Abstract
Foundation models (FM) have transformed computational pathology but remain computationally prohibitive for clinical deployment due to their massive parameter counts and high-magnification processing requirements. Here, we introduce XMAG, a lightweight FM developed through corss-magnification distillation that transfers knowledge from state-of-the-art 20x magnification teacher to an efficient 5x magnification student architecture. XMAG employs a compact backbone and operates entirely at 5x, requiring 11.3 times fewer patches per whole slide image (WSI) compared to existing approaches. Our Novel distillation framework incorporates dual-level knowledge transfer, aligning both global image representations and local spatial token mapping. We trained XMAG on 3.49 million images curated from publicly available datasets and evaluated performance across six clinically relevant histopathology analysis tasks spanning multiple cancer types. XMAG achieved diagnostic accuracy within 1% of substantially larger foundation models while delivering 30-fold processing acceleration, reaching 8.8 WSIs per minute processing speed. Our cross-institutional validation confirmed robust generalization. Further, we developed an end-to-end training strategy to further boost our model's performance to approach the larger FMs' performance. These results establish cross-magnification distillation as a viable approach for deploying FM capabilities in resource-constrained clinical environments, potentially enabling real-time pathology AI integration.
Sources
- Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
- Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology
- Distilling the Knowledge in a Neural Network
- A Stitch in Time: Learning Procedural Workflow via Self-Supervised Plackett-Luce Ranking
- Unleashing Foundation Vision Models: Adaptive Transfer for Diverse Data-Limited Scientific Domains
- A Simple Recipe for Competitive Low-compute Self supervised Vision Models
- SPIDER: A Comprehensive Multi-Organ Supervised Pathology Dataset and Baseline Models
- LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settings
- Towards Robust Foundation Models for Digital Pathology
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models