Concept Representations in Vector Space: Quantifying Sharedness and Idiosyncrasy of Meaning
cs.CL
Submitted: 2026-10-11
Updated: 2026-10-11
Comments: 22 pages, 6 figures. Preprint under review at Open Mind: Discoveries in Cognitive Science. Data, code and pre-registration: https://osf.io/dc6an
License: http://creativecommons.org/licenses/by/4.0/
The gist: Concepts are the basic units through which we navigate the world and communicate meaning.
Abstract
Concepts are the basic units through which we navigate the world and communicate meaning. But do you and I really mean the same thing when we think or speak about a concept? The present study develops a measurement framework for modeling and analyzing interindividual variation in concept representations through sentence embeddings, dense vector representations mapping entire utterances into a shared geometric space. The framework is developed in a theoretical argument and validated, demonstrated, and subjected to robustness checks in a pre-registered study. Short personal definitions, elicited from N = 125 participants, are encoded as sentence embeddings and submitted pairwise to a crossed random effects model yielding two concept-level quantities: sharedness (S b), the expected dissimilarity between two randomly drawn individuals, and idiosyncrasy (I b), the person-specific share of total dyadic variance. Two validity tests support the approach: the embedding space fully recovers concept and domain organization from participant definitions even with the target word excluded, and a parameter-free classifier achieves 0.630 accuracy in a within-participant extensional prediction task against a chance baseline of 0.500 and a consistency ceiling of 0.893. The framework finds theoretically interpretable variation in S b and establishes I b as a reliable source of dyadic variance across concepts. Results replicate across three encoders varying in architecture and capacity, providing a reproducible and scalable instrument for the empirical study of meaning variation.
Sources
- MMTEB: Massive Multilingual Text Embedding Benchmark
- How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
- Efficient Estimation of Word Representations in Vector Space
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
- Investigating the Frequency Distortion of Word Embeddings and Its Impact on Bias Metrics
- Attention Is All You Need
- Unsupervised Sentence Representation Learning with Frequency-induced Adversarial Tuning and Incomplete Sentence Filtering
- Language Models with Transformers
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
- Revealing emergent human-like conceptual representations from language prediction
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering