Beyond Locality: Feature-Boundary Auditing for OS-Integrated AI
cs.CR, cs.AI
Submitted: 2026-06-08
Updated: 2026-10-12
License: http://creativecommons.org/licenses/by/4.0/
The gist: On-device inference reduces exposure to remote infrastructure, but it does not establish privacy for an operating-system assistant that aggregates cross-application data, retains derived state, or
Terminology
Abstract
On-device inference reduces exposure to remote infrastructure, but it does not establish privacy for an operating-system assistant that aggregates cross-application data, retains derived state, or delegates actions. We present a feature-boundary audit method for OS-integrated AI. It combines a taxonomy of six privacy-failure surfaces, a five-dimension control rubric with separate evidence grades, and explicit records for adjacent data and authority paths. We apply the method to Apple Foundation Models, Apple Private Cloud Compute, Android AICore/Gemini Nano, and Microsoft Recall using primary public documentation. The analysis distinguishes request isolation from contextual restraint, retained-state controls from non-retention, and attestation from task-appropriate disclosure. A formative comparison of two 20-item assessment records identifies ambiguities in notice, retention, path ownership, and accountability. The source-linked records identify supported controls and unresolved dependencies; we also specify a minimized event record and release comparison for fleet security triage and scoped forensic review.
Sources
- Towards Verifiably Safe Tool Use for LLM Agents
- A Vision for Access Control in LLM-based Agent Systems
- Android Private Compute Core Architecture
- Text Embeddings Reveal (Almost) As Much As Text
- Prompt Injection Attack to Tool Selection in LLM Agents
- Unveiling Privacy Risks in LLM Agent Memory
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Estimating the Social Cost of Corporate Data Breaches
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills