Knowledge Graphs as Files: An Agent Harness Where Tool Creation and Tool Use Co-Evolve
cs.CL, cs.AI, cs.IR
Submitted: 2026-10-13
Updated: 2026-10-15
Comments: 27 pages. Code and data: https://github.com/leopoldwhite/DKGI
Code: https://github.com/leopoldwhite/DKGI
License: http://creativecommons.org/licenses/by/4.0/
The gist: Searching text-rich knowledge graphs requires following relations while examining textual evidence.
Terminology
Abstract
Searching text-rich knowledge graphs requires following relations while examining textual evidence. Predefined graph interfaces constrain what evidence agents can access, even when they write code to combine tool calls or process retrieved subgraphs. We propose direct knowledge graph interaction (DKGI), a harness in which language model agents create graph access tools directly over complete node and edge files. The agent writes Python code to follow relations, combine node sets, and select textual evidence, interleaving execution with shell search and file inspection. This lets agents process large node sets in bulk while returning selected text for the model to assess. Execution feedback guides tool creation and revision, while the evolving tools determine what evidence the agent gathers next. On benchmark datasets spanning three domains, training-free DKGI exceeds the strongest published baseline by at least 6.7 Hit@1 points on every graph, even with a minimal harness. Controlled ablations show the benefits of multi-turn programming over shell-only access and predefined graph tools, while trajectories show agents revising code to extend searches or address errors. These findings highlight the value of allowing tool creation and tool use to co-evolve during graph search. Our code and data are available at https://github.com/leopoldwhite/DKGI.
Sources
- GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases
- Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphs
- Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion
- Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
- Joint Optimization of Tool Creation and Use for Large Language Model Agents
- GRASP: Plan-Guided Graph Retrieval with Adaptive Fusion and Reranking on Semi-Structured Knowledge Bases
- Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
- PASemiQA: Plan-Assisted Agent for Question Answering on Semi-Structured Data with Text and Relational Information
- PyVision: Agentic Vision with Dynamic Tooling
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering