Foundations for Investigations of Agentic AI Systems from the Forensic Analysis of OpenClaw
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Security Radio. Generated commentary on the latest security and cryptography papers.
Nadia: I'm Nadia.
Elias: And I'm Elias, here with Priya.
Nadia: We're looking at the paper: "Foundations for Investigations of Agentic AI Systems from the Forensic Analysis of OpenClaw".
Elias: The gist: This work presents an empirical study of OpenClaw, a widely used single-agent assistant,
Nadia: First, who's behind it and why it matters.
Paper summary: Nadia: So, this paper, "Foundations for Investigations of Agentic AI Systems from the Forensic Analysis of OpenClaw," sets up a study on how to approach investigations into personal AI assistants. The thesis is that we need systematic forensic approaches because right now, reconstructing the internal state and actions during an agent's operation is largely unknown.
Elias: They focus their empirical work on OpenClaw, which they describe as a widely used single-agent assistant, examining its technical design through static code analysis and applying differential forensic analysis to find traces across the interaction loop.
Priya: They propose this five-plane agent artifact taxonomy as the way to structure the examination of these traces and assess their investigative value systematically.
Nadia: This taxonomy breaks down the agent into five functional planes: reasoning and cognition, identity and configuration, knowledge and recall, communication and I/O, and finally actions and effects.
Elias: They also mention that they implement a prototype tool that automatically extracts local artifacts from an OpenClaw installation to support this analysis.
Priya: The paper highlights that session transcripts are described as the single richest forensic artifact because they record not just communication but also reasoning traces and tool invocations.
Conclusion: Nadia: Looking at the paper, "Foundations for Investigations of Agentic AI Systems from the Forensic Analysis of OpenClaw," it seems like they’ve established an initial foundation for investigating these personal AI assistants by providing a concrete analysis method.
Elias: The authors use OpenClaw to show how differential forensic analysis can be applied to identify recoverable traces across different stages of an agent interaction loop, which is important because it shows what's actually possible.
Priya: What this means for us is that we have a proposed taxonomy, and they’ve even released an open-source artifact-extraction tool with a machine-readable schema that lets others try to structure their own investigations.
Nadia: The title of the paper points to these foundations, suggesting they are moving from just anecdotal evidence to a systematic way of analyzing agentic AI systems as they become more common in our lives.
Elias: They also pointed out some major challenges, like the nondeterminism introduced by LLM-mediated execution and how tool selection is co-determined by the model and the environment.
Priya: So, while they give us this structure, they also warn that identical inputs might not yield identical traces because of that unpredictability in how the AI decides what to do next.
Karlsruhe Institute of Technology · Fraunhofer Institute for Communication, Information Processing and Ergonomics FKIE
cs.CR, cs.AI
Submitted: 2026-04-07
Updated: 2026-10-19
Comments: Accepted at IMF 2026 (15th International Conference on IT Security Incident Management & IT Forensics), published in Digital Threats: Research and Practice. 20 pages. Code and experimental data available at: https://github.com/jgru/forensic-analysis-of-openclaw
DOI: 10.1145/3848419
Code: https://github.com/jgru/forensic-analysis-of-openclaw
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 92/100
The gist: The gist: This work presents an empirical study of OpenClaw, a widely used single-agent assistant, to establish an initial foundation for the systematic investigation of agentic AI by proposing an
Key concepts
- Agent Artifact Taxonomy
- A proposed framework organizing forensic evidence into five planes: Reasoning & Cognition (how it thinks), Identity & Configuration (what it is), Knowledge & Recall (what it knows), Communication & I/O (how info flows), and Actions & Effects (what it did). This structure helps investigators systematically categorize recurring investigative patterns across the AI's architecture.
- Differential Forensic Analysis
- A technique used to isolate the specific impact of an action by comparing two sequential system states. By comparing these differences, researchers could pinpoint exactly what changes occurred during a specific agent interaction, helping to distinguish between user requests and actual agent execution.
- Nondeterminism in Trace Generation
- The difficulty in reliably reconstructing traces because the LLM's planning, tool selection, and state transitions are influenced by stochasticity and evolving context. This means identical inputs can lead to different actions or traces, complicating traditional forensic assumptions about reproducibility.
Terminology
Summary
The gist: This work presents an empirical study of OpenClaw, a widely used single-agent assistant, to establish an initial foundation for the systematic investigation of agentic AI by proposing an agent artifact taxonomy.
Motivation and Problem
Agentic AI systems are increasingly deployed as personal assistants and are likely to become a common object of digital investigations Little is known about how their internal state and actions can be reconstructed during forensic analysis The central forensic question is not only what happened on the host, but what the assistant actually did versus what the user requested, knew, or intended—an attribution problem that current forensic understanding struggles to resolve. This work addresses this gap by establishing the foundation for the forensic examination of AI assistants.
Methodology
The study examines OpenClaw’s technical design via static code analysis and applies differential forensic analysis to identify recoverable traces across stages of the agent interaction loop. The experiment was conducted in a virtualized environment managed by Oracle VirtualBox, the guest virtual machine operated on Debian GNU/Linux 13 (Codename: Trixie). The analysis combined static code analysis, differential analysis, and file inspection to locate and interpret relevant traces. Specifically, differential forensic analysis allowed the researchers to isolate the specific effects of an action by comparing the differences between two sequential images.
Artifact Taxonomy
The researchers propose an agent artifact taxonomy that captures recurring investigative patterns. This functional taxonomy is organized into five artifact planes, each corresponding to a distinct aspect of the agent’s architecture. The five planes are:
-
Reasoning & Cognition (“The Brain”): How it thinks.
-
Identity & Configuration (“The DNA”): What it is / could do.
-
Knowledge & Recall (“The Memory”): What it knows.
-
Communication & I/O (“The Ears & Mouth”): How info flows.
-
Actions & Effects (“The Hands”): What it did.
Key Artifacts and Traces
Session transcripts are described as the single richest forensic artifact in the system, as they record not only communication but also reasoning traces, tool invocations, and context state. Within a session, individual user interactions are executed as runs. Run progression can be traced through debug log messages that mark stages such as prompt start, agent start, tool execution, agent end, and prompt end. Log data is stored in /tmp/openclaw/. The retention policy is hard-coded: log files older than 24 hours are deleted.
Challenges for Investigation
Agentic execution introduces an additional layer of abstraction and substantial nondeterminism in trace generation. The LLM, the execution environment, and the evolving context can influence tool choice and state transitions in ways that are largely absent from rule-based software. This nondeterminism is caused by sampling stochasticity, context assembly variability, and timing-dependent external state. Furthermore, the relevant context that shaped a decision is difficult to reconstruct retrospectively because the workspace environment, memory, and capabilities naturally evolve and change over time.
Implications for Forensics
The analysis highlights that structural artifacts, such as configuration files and credential stores, remained deterministic across runs. Conversely, agent-generated artifacts whose creation depends on LLM-mediated planning and tool choice exhibit variation. This suggests two qualitatively different classes of traces that require distinct analytical approaches. The proposed taxonomy provides a viable foundation for the systematic investigation of agentic assistants.
Conclusion
Agentic AI systems are becoming a durable part of the software ecosystem, and their delegated and context-dependent execution challenges long-standing forensic assumptions about reproducibility, provenance, and the completeness of local traces. The work provides an analysis tool as open-source software to structure investigations of agentic assistants. The findings underscore the need for sustained, systematic forensic research of agentic systems.
How it works
The analysis procedure involved three main steps:
-
Static code analysis provided an overview of the application’s architecture and potential data storage locations before generating any user data.
-
Differential forensic analysis was applied to isolate the specific effects of an action by comparing the differences between two sequential images. This tool detects changes across five specific categories: file or directory creation, deletion, renaming, content modification, and timestamp updates.
-
The remaining candidates of file system changes were subsequently verified and inspected in-depth using standard forensic tooling.
Artifact Examination Tool
The artifact-examiner, a Python-based command-line interface (CLI) tool, was developed to facilitate the analysis of OpenClaw. This tool offers several capabilities for investigators:
"Unified Timeline Analysis: It reconstructs a chronological view of all agent activities by merging events from logs, session transcripts, and configuration changes allows analysts to trace the sequence of actions leading up to a specific event"
Session Inspection: The tool provides interactive browsers for exploring agent sessions, including the ability to reconstruct conversation flows, tool invocations, and subagent spawns
Forensic Artifact Definition
A technical and concise description of forensic artifacts is provided via the artifacts/data/openclaw.yml file. This YAML file serves as a machinereadable schema that defines the location, structure, and semantic meaning of important artifacts generated by the OpenClaw agent. Each artifact entry includes Name, Documentation, and Sources.
Cross-System Mapping
The taxonomy was validated against artifacts reported by Walker et al. [23] for the agentic framework AutoGen and by Dragonas et al. [7] for the non-agentic ChatGPT mobile application. This mapping reveals a discriminative pattern where reasoning traces and actions are absent in the non-agentic system. The taxonomy was developed through a combination of literature review on agentic system architectures, code analysis as well as differential analysis, and validated against the abstract agent interaction loop described in Section 2.1.
Summary of Artifact Planes
The five planes capture analogous aspects of an AI agent:
"Reasoning & Cognition (“The Brain”): How it thinks Captures the LLM’s reasoning traces—a category of forensic evidence with no analog in traditional software"
"Identity & Configuration (“The DNA”): What it is / could do Encompasses the predominantly static artifacts that define the agent’s configured identity, capabilities, and operational boundaries"
"Knowledge & Recall (“The Memory”): What it knows Covers accumulated knowledge such as episodic memory, user profiles, and semantic indices—distinguished from DNA by being accumulated at runtime, often by the agent itself"
"Communication & I/O (“The Ears & Mouth”): How information flows to and from the agent Establishes who interacted with the agent, through which channels, and what each party could observe"
"Actions & Effects (“The Hands”): What it did Records concrete actions and their observable effects, providing the factual basis for determining what changes the agent caused"
Cross-Cutting Evidence
Session transcripts are cross-cutting and contribute direct or indirect evidence to multiple planes. A single JSONL file directly records reasoning traces (Brain), user and agent messages (Ears & Mouth), and tool invocations (Hands).
Improvements for AI systems
-
Establish a systematic forensic methodology by applying an
agent artifact taxonomy
to classify evidence across five planes: Reasoning & Cognition, Identity & Configuration, Knowledge & Recall, Communication & I/O, and Actions & Effects. This allows for a structured investigation of agentic systems by addressing questions such asHow is the agent configured?
andWhat information had the agent accumulated?
-
Implement enhanced context reconstruction by correlating modified timestamps of context-providing files with session transcript entries to approximate
the knowledge state that was active during the relevant period.
This helps investigators determine which context was available to the LLM at a specific point in time, addressing the challenge wherethe same request can produce different outcomes at different points in time.
-
Develop capabilities for autonomous action attribution by utilizing run history and subagent delegation records to determine
Did the agent execute unprompted or autonomous actions?
This allows for classifying observed actions on a spectrum:directly instructed by the user, interpretively derived from an ambiguous instruction, autonomously initiated by the agent, or indeterminate.
-
Improve model-mediated reasoning analysis by specifically identifying and analyzing
chain-of-thought blocks within assistant messages,
which can revealhow the agent interpreted a request, which alternatives it considered, and why it selected a particular tool.
This provides insight into the decision-making process that is otherwise largely absent from traditional software forensics. -
Enhance communication tracing by parsing structured headers in message content (e.g., Telegram messages) to extract
channel attribution, sender identity (e.g., display name, username, platform-specific user ID), and message timestamp,
providing a clearer view ofwho interacted with the agent
andthrough which channels.
Sources
- Started Off Local, Now We're in the Cloud: Forensic Examination of the Amazon Echo Show 15 Smart Display
- A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Estimating the Social Cost of Corporate Data Breaches
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills