Scalable Posterior Uncertainty for Flexible Density-Based Clustering
stat.ML, cs.LG
Submitted: 2026-03-03
Updated: 2026-10-20
License: http://creativecommons.org/licenses/by/4.0/
The gist: Density-based clustering is a well-established framework that defines clusters through topological or geometric features of the data-generating density, yielding flexible procedures that have proven
Terminology
Abstract
Density-based clustering is a well-established framework that defines clusters through topological or geometric features of the data-generating density, yielding flexible procedures that have proven effective on large and complex datasets. We address the problem of obtaining scalable Bayesian-style uncertainty quantification by combining density-based clustering with martingale posterior distributions. Density uncertainty is first quantified through a fully parallelized predictive resampling scheme driven by model score functions, naturally accommodating modern differentiable density estimators such as normalizing flows. Posterior samples of the clustering are then obtained by applying density-based clustering to each random density sampled from the martingale posterior, enabling inference on any clustering-related quantity. Casting the estimand as a density functional also enables a rigorous frequentist convergence analysis. We illustrate the method through applications to image and single-cell RNA sequencing data, where it recovers meaningful clustering structures, including the assignment of previously unseen data and biologically interpretable cell grouping, while running in minutes on a single GPU.
Sources
- Conformalized Bayesian Inference, with Applications to Random Partition Models
- Bayesian Level Set Clustering
- Martingale Posteriors from Score Functions
- Repulsive Mixture Model with Projection Determinantal Point Process
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier