Encoded but Exposed: Language Embeddings can Reveal More Than They Should in Recommender Systems
cs.CR, cs.AI, cs.LG
Submitted: 2026-10-15
Updated: 2026-10-15
Journal ref: 3rd Workshop on Evaluating and Applying Recommender Systems with Large Language Models (EARL 2026), co-located with the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Language embeddings are increasingly used in recommenders to represent item content, but their privacy risks remain poorly understood.
Terminology
Abstract
Language embeddings are increasingly used in recommenders to represent item content, but their privacy risks remain poorly understood. We study whether item embeddings can reveal item identities when an adversary has access to auxiliary item text from external sources. We show that a simple cosine-similarity attack can recover item identities with high mean reciprocal rank across language models and candidate-set settings on two real-world datasets. Leakage is strongest when the adversary's partial information overlaps with the victim representation, but it also persists through semantic alignment between independently sourced descriptions. We further show that item leakage can propagate to user re-identification from sparse ratings. Finally, we evaluate obfuscated descriptions as a mitigation and find a clear leakage-utility tradeoff.
Sources
- M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systems
- RAID: An In-Training Defense against Attribute Inference Attacks in Recommender Systems
- Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoders
- Membership Inference on Word Embedding and Beyond
- Overlearning Reveals Sensitive Attributes
- Understanding Privacy Risks of Embeddings Induced by Large Language Models
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Estimating the Social Cost of Corporate Data Breaches
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills