Learning Representations from 3D Gaussian Splats
cs.CV
Submitted: 2026-05-28
Updated: 2026-05-28
Comments: 5 figures, 15 pages
Journal ref: Advances in Computational Collective Intelligence, CCIS 3043, pp. 119-133, 2027
DOI: 10.1007/978-3-032-37933-7_8
License: http://creativecommons.org/licenses/by/4.0/
The gist: 3D Gaussian Splatting (3DGS) is a recent approach for scene rendering.
Terminology
Abstract
3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of various geometric deep learning architectures for the classification of 3D scenes represented using Gaussian Splatting. We benchmark point-based and graph-based models across both traditional point cloud datasets and dedicated Gaussian Splatting datasets. Scenes are embedded into latent representations, which are evaluated through end-to-end classification, linear probing, and clustering analysis. Our study provides insight into the suitability of different geometry-aware architectures and input feature configurations for learning effective 3D Gaussian Splat representations. The results highlight consistent differences between architectural families and reveal the impact of Gaussian-specific attributes on the quality of representation.
Sources
- Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- ShapeNet: An Information-Rich 3D Model Repository
- Performance of Gaussian Mixture Model Classifiers on Embedded Feature Spaces
- 3D Gaussian Splatting for Real-Time Radiance Field Rendering
- ShapeSplat: A Large-scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
- PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
- Multi-view Convolutional Neural Networks for 3D Shape Recognition
- PointConv: Deep Convolutional Networks on 3D Point Clouds
- Learning Unified Representation of 3D Gaussian Splatting
- SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models