Exemplar: Few-Shot Biomedical Segmentation That Refits Exactly in Seconds

arXiv:2609.03080 · cs.CV · Submitted 2026-09-02 · Read on arXiv

Listen

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Exemplar: Few-Shot Biomedical Segmentation That Refits Exactly in Seconds".

Jane: The gist The Exemplar segmenter fuses frozen DINOv3 features with classical native-resolution filter responses in one lightweight head to achieve few-shot segmentation across eleven biomedical imaging datasets.

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So, to wrap up this discussion on "Exemplar: Few-Shot Biomedical Segmentation That Refits Exactly in Seconds," the main point is that they’ve shown a way to fuse frozen DINOv3 features with classical native-resolution filter responses in one lightweight head for few-shot segmentation.

Jane: And what they did is fitting this configuration from just the support masks, and it works across eleven biomedical imaging datasets, showing that classical priors and frozen self-supervised features are complementary when fused in this way.

Lu: The result is that under a single head fitted from dense masks, the classical bank alone reaches zero point six nine three on the eleven-dataset panel against a score of foreground intersection-over-union or centreline Dice, and the frozen features alone reach zero point six seven two; but fused they reach zero point seven eight two, which is better than either component separately on seven of the eleven datasets.

Meng: From an engineering standpoint, it’s useful because it lets you adapt quickly to new mask sets in seconds rather than retraining a massive model from scratch every time you get new data.

Lalam: My literature review confirms that this specific fusion strategy—concatenating the thirty-two features from the two scales with the thirty-five classical prior channels—is what drives that performance gain and makes it work across so many different tissue types <ref:2609.03080#pg2>.

Tom: The paper shows how to get a high-performing segmenter by combining pre-trained self-supervised vision models with traditional image processing techniques in a very efficient way.

Jane: It really suggests that for fast, few-shot segmentation tasks, you don't have to rely solely on the massive foundation models; incorporating targeted classical responses can provide a solid baseline that adapts quickly.

Conclusion: Tom: So we’ve been looking at Exemplar, this paper by Pru˚sek, Novozamsk, and Sroubek that claims to segment medical images incredibly fast.

Jane: It does show how you can take a model trained on tons of data—a big foundation model—and adapt it to a brand new image set in just a few seconds.

Lu: The core idea is fusing those frozen DINOv3 features with some classical filter responses right into one small head.

Meng: But what’s the catch, Tom? How much work is this actually doing compared to something like Cellpose-SAM that we know works well?

Tom: Well, they show it’s faster than those other methods when you look at the fit time. They say their process updates exactly with each new mask in seconds, which beats a median of twenty-five minutes for a different approach.

Jane: And the performance on ten biomedical datasets is surprisingly good. They use this fusion head and see it do better than using just the DINOv3 features or just the classical filters alone on seven out of those eleven datasets.

Lalam: I've checked the literature, and I’m pretty sure that fusing those two parts in one layer is exactly what unlocks that combined accuracy.

Lu: It proves that you don't always have to pick one approach over the other; combining them under a single learning mechanism creates a useful representation.

Tom: So, if we take away the massive training cost of retraining from scratch and instead focus on this quick adaptation, what does that mean for how we actually use these models in hospitals?

Jane: It means a researcher or even a clinician could be testing new segmentations on their specific patient scans and getting immediate feedback without waiting hours for a full re-train.

Meng: From an engineering standpoint, it’s cool if it fits fast, but the paper mentions that the per-set gradient fit is still the main cost. We need to know how much that actually slows down when we have thousands of new masks to process daily.

Tom: Exactly, so while the idea is neat for rapid prototyping, we gotta see if that per-set fit becomes a bottleneck in a real production pipeline.

Jane: Next up, we’ll look at what the authors suggest as the next step beyond just fitting these masks and how they plan to build on this work.

Czech Academy of Sciences Institute of Information Theory and Automation Czechia · Czech Technical University in Prague Faculty of Nuclear Sciences and Physical Engineering Czechia

cs.CV

Submitted: 2026-09-02

Updated: 2026-10-18

Comments: 5 pages, 3 figures, 2 tables. Submitted to IEEE ISBI 2027. Code, configurations, and the score records behind every reported number: https://github.com/michalprusek/Exemplar

Code: https://github.com/michalprusek/Exemplar

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 82/100

The gist: The gist The Exemplar segmenter fuses frozen DINOv3 features with classical native-resolution filter responses in one lightweight head to achieve few-shot segmentation across eleven biomedical

Key concepts

Frozen DINOv3 Backbone: This is a pre-trained vision model (DINOv3) whose internal weights are kept fixed during training. It provides powerful, general-purpose visual features that capture rich semantic information from the images without needing extensive retraining. These features are used as a foundation for the segmentation task.
Classical Native-Resolution Filter Responses: These are traditional image processing filters applied directly to the original image resolution. They represent established methods for extracting local details and edges. In Exemplar, a fixed bank of these responses is fused with the deep features to guide the final segmentation map.
Few-Shot Segmentation: This refers to the ability of a model to perform accurate segmentation when it is only provided with a very small number of labeled examples (masks). Exemplar excels here because it learns from these few masks without needing extensive retraining, making it ideal for new or specific medical imaging tasks.

Summary

The gist The Exemplar segmenter fuses frozen DINOv3 features with classical native-resolution filter responses in one lightweight head to achieve few-shot segmentation across eleven biomedical imaging datasets.

Overview

Exemplar is a few-shot segmenter that fuses a frozen DINOv3 backbone with a fixed bank of classical native-resolution filter responses in one lightweight head, fitted from the support masks alone. The system pairs an encoder with two scales for reading: a coarse grid for global semantic context and a fine grid for local detail edge guidance. A shared stem of 1×1 convolutions projects each scale to thirty-two channels, which an upsampler in the guided-filter family lifts to native resolution through a learned per-channel gain on an edge map reduced from the priors below.

Components and Fusion

The segmenter pairs a frozen backbone with a lightweight trainable head fitted from the support masks alone. Each image is encoded by a frozen DINOv3 ViT-L/16. The trainable head has 0.36M parameters and is fitted separately from scratch for each support set. The fusion head concatenates the features from the two scales with the frozen classical prior bank. This concatenation is followed by a 1×1 fusion layer and a nonlinearity and a second 1×1 convolution to produce the foreground map.

Complementary Strengths

The classical priors and frozen self-supervised features are complementary when fused in one head. Under a single head fitted from dense masks, the classical bank alone outscores the frozen DINOv3 features alone on seven of the eleven datasets, all seven significant. Second, a 0.36M-parameter head fitted on a single mask outperforms INSID3 when given sixteen masks. Comparisons use the paired Wilcoxon signed-rank test with Holm correction applied within each claim’s family.

Comparative Performance

Against forward-pass few-shot methods, Exemplar leads in 54 of 55 method-dataset comparisons, 52 of them significant after Holm correction. Against nnU-Net trained on the same support masks, the advantage depends on metric and annotation budget. At eight masks, nnU-Net is stronger on the panel mean (0.803 against 0.782) but Exemplar leads from a single mask and fits an order of magnitude faster. The prior bank provides the largest single gain in component ablation tests.

Conclusion

Exemplar demonstrates that classical priors and frozen self-supervised features are complementary when fused in one head. The preferable approach depends on the annotation budget and the downstream use. Beyond cost, Exemplar is limited in scope as it segments 2D images into a binary foreground. Its main practical limitation is the per-set gradient fit which dominates its computational cost. The method's intended use is an interactive tool where each added mask must update the model in seconds rather than re-fit it. The natural next step is replacing the fit with a closed-form or incremental update.

Ethics and Acknowledgments

This research was conducted retrospectively using publicly available, open-access biomedical imaging datasets. No new human or animal data were collected. This document is the result of the grant GA25-15933S funded by the Czech Science Foundation.

References

The paper references a wide range of prior work including Cellpose [1], StarDist [3], and Segment Anything family models [5]<ref:8pg,The paper references a wide range of prior work including Cellpose [1], StarDist [3], and Segment Anything family models [5].

--- Page 1 ---

EXEMPLAR: CLASSICAL PRIORS COMPLEMENT FROZEN FEATURES FOR FEW-SHOT MICROSCOPY SEGMENTATION AT NATIVE RESOLUTION Michal Pru˚sek 1,2 Adam Novozamsk y Filip Sroubek 1 The Czech Academy of Sciences, Institute of Information Theory and Automation, Czechia 2Czech Technical University in Prague, Faculty of Nuclear Sciences and Physical Engineering, Czechia ABSTRACT Segmenting a new biomedical dataset usually means a domainspecific model trained on substantial annotation, or a foundation model steered at inference time. We present Exemplar, a few-shot segmenter that fuses a frozen DINOv3 backbone with a fixed bank of classical native-resolution filter responses in one lightweight head, fitted from the support masks alone. In the few-mask, nativeresolution regime, classical priors and frozen self-supervised features are complementary: fused in one head, a single fixed configuration spans eleven biomedical imaging datasets. Under the same head, the classical bank alone reaches 0.693 on the eleven-dataset panel, scored by foreground intersection-over-union or centreline Dice, and the frozen features alone 0.672; the bank leads on seven of the eleven and the features on the rest, and fused they reach 0.782.

Improvements for AI systems

Improved few-shot segmentation capability by fusing frozen DINOv3 backbone with a fixed bank of classical native-resolution filter responses in one lightweight head, achieving a score of 0.782 on eleven biomedical imaging datasets and leading in 54 of 55 method-dataset comparisons.
Enhanced annotation efficiency by offering a method that, at a single annotated mask it reaches 0.703 on the same panel, against 0.682 for a from-scratch nnU-Net trained on that same mask, demonstrating superiority over methods like nnU-Net when fitting is constrained by budget.
Superior performance in low-annotation regimes by showing that classical priors and frozen self-supervised features are complementary: fused in one head, a single fixed configuration spans eleven biomedical imaging datasets, meaning the system leverages both structural information (classical priors) and learned features (frozen DINOv3) simultaneously for robust segmentation.
Increased speed and practicality in interactive workflows by demonstrating that from a single mask Exemplar is ahead of nnU-Net, which requires 2260 seconds to fit on the smallest field, suggesting an order of magnitude faster processing suitable for active learning environments.

Abstract

Segmenting a new microscopy dataset usually means training a deep network on its annotations, and training again for every added image. Exemplar solves a segmentation readout in closed form and updates it exactly with each new mask in seconds, as accurately as networks trained for minutes. Its linear readout combines frozen DINOv3 features, read at a magnification chosen from the masks, with classical filter responses at native resolution. Its regularisation and its pixel weighting are chosen exactly by leaving out one annotated image at a time, so none is set aside for validation. On ten biomedical datasets from cells to vessels and filaments, Exemplar is more accurate than every few-shot method that only applies a pretrained model, and on average than nnU-Net trained on the same masks. A fine-tuned Cellpose-SAM, the strongest baseline, is as accurate on average, but each of its fits takes a median of 25 minutes against 8.5 seconds, and it cannot be updated exactly.