EditPPT: Structured Execution and Evaluation for Reliable Slide Editing

summary

Video file (mp4)

The gist

The gist The EDITPPT framework reframes slide editing as a constrained tool-selection problem executed via shape-level operations through the native PowerPoint COM interface, which addresses

In short

EditPPT reframes slide editing as a constrained tool-selection problem using PowerPoint's native COM interface. It uses a multi-agent framework to decompose requests into shape-level operations, ensuring precision and preservation. This approach outperforms open code generation by limiting the LLM's action space, leading to high success rates and better original deck preservation.

Key concepts

Shape-Level Operations
Instead of editing pixels, the system focuses on modifying specific PowerPoint objects like text boxes or charts using their unique IDs. This method ensures that changes are targeted precisely at the intended element without accidentally altering surrounding content or layout, which is crucial for reliable editing.
PowerPoint COM Interface
This is a built-in programming interface that allows external software, like the EDITPPT framework, to directly control and manipulate Microsoft PowerPoint applications. It acts as a shared bridge for parsing the presentation structure and executing deterministic edits directly within the application's object model.
Dual-Modal Validation
The system checks edits using two different methods: one structural validator verifies that the requested changes were made correctly according to the parsed data, while a Visual Language Model (VLM) validator checks for visual quality issues like overlaps or clipping. Separating these checks makes the evaluation much more robust.
Constrained Action Space
The framework limits each specialist agent to only a small subset of predefined, deterministic tools (e.g., 37 tools). This constraint prevents the LLM from generating arbitrary code or making broad, risky changes, forcing it to operate within a predictable and safe set of allowed actions.

Terminology used across episodes

This episode discusses

The paper

EditPPT: Structured Execution and Evaluation for Reliable Slide Editing · Read on arXiv

Jiheon Kim, Kyudan Jung, Jaegul Choo

KAIST AI

Reliable slide editing requires precise modifications to intended objects while preserving the rest of the presentation. We argue that slide editing is a problem of structured, constrained modification rather than open-ended code generation. Despite the complexity of real presentations, editing requests can largely be decomposed into the objects to change, the operations to apply, and the state to preserve. This perspective guides both evaluation and execution. For evaluation, we introduce DeckEdit-Bench, 183 editing tasks on 28 human-authored decks whose target and preserved objects are annotated at the shape level, so that intended and unintended changes are scored mostly by deterministic rules. For execution, we present EditPPT, a multi-agent framework that resolves targets before editing, restricts each specialist to a subset of 37 predefined tools, and validates each edit for instruction fulfillment and preservation, correcting or rolling back failed ones. Across five backbone models, EditPPT reaches 66.7-74.9% Task Success while keeping Preservation above 97%. Even with an open 27B model and no task-specific fine-tuning, it approaches Claude Code with Sonnet 5 in Task Success while better preserving the original deck. These results suggest that constraining how edits are executed, not only model scale, makes slide editing more reliable.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "EditPPT: Structured Execution and Evaluation for Reliable Slide Editing".

Jane: Here's the gist of the paper. The gist The EDITPPT framework reframes slide editing as a constrained tool-selection problem executed via shape-level operations through the native PowerPoint COM interface, which addresses cascading errors in long decks by narrowing the LLM action space and preserving application-resolved structure.

Tom: How it works EDITPPT processes an editing request through a five-stage pipeline (Figure 2) where it "(i) parses the relevant slides into structured representations of native PowerPoint objects, augmented with selective visual metadata, (ii) decomposes the instruction into a per-slide task list, (iii) dispatches each task to a specialist agent, (iv) executes deterministic shape-level operations through the PowerPoint COM interface, and (v) validates the result using complementary structural and visual validators before either accepting the edit or triggering recovery" The core mechanism involves using the running PowerPoint application as a shared interface for both parsing and editing, following evidence that "object-model-based slide manipulation can be more efficient and style-preserving than pixel-level".

Jane: The system employs a COM-based parser that produces a JSON object enumerating native PowerPoint objects and their properties, including "object type, geometry, text and font attributes, table and chart contents, image metadata, and slide-level elements".

Tom: This representation reduces input size significantly compared to raw XML by removing "package-level XML redundancy while preserving editable object state".

Paper summary: Tom: So, EDITPPT proposes a multi-agent framework that uses the native PowerPoint COM interface to do the actual editing. They claim this approach narrows the LLM action space while keeping application-resolved structure intact.

Jane: But how does it manage that complexity? If we're talking about long decks, where errors tend to cascade, what's stopping it from just making a mess?

Tom: The core mechanism involves parsing the request into structured representations of native PowerPoint objects and then using a planner to break that down into per-slide subtasks. Each task goes to a specialist agent who only uses a small subset of predefined tools.

Lu: They use this structure-first representation, which they call Augmented Slide Representation, where they produce a JSON object listing every shape ID and its properties before the agents even start working on anything.

Meng: I wonder about that parsing step. If we have to convert everything into a JSON object of native PowerPoint properties, isn't that going to be slow or create too much overhead for a fast editing loop?

Tom: They address that by using a COM-based parser that produces this JSON, which they say removes "package-level XML redundancy while preserving editable object state." It’s designed to be smaller than raw XML because it keeps the actual state of the objects.

Jane: And then they have this multi-agent dispatcher routing tasks based on object type, and each agent is tied to specific tools like text editing or chart editing. That sounds like a very specialized team of workers.

Lalam: I see how that specialization helps control the output. The agents are constrained to tools that are deterministic at the shape level, which should keep things predictable when they execute the changes via COM.

Tom: And they don't stop there with just execution; they have a dual-modal validation system after every edit. They separate instruction verification from visual quality assessment for more robust checking.

Jane: That sounds smart because you could have one agent follow the text instructions perfectly, and another module check if the visual layout still looks right, like making sure things aren't overlapping.

Lu: That separation is what they emphasize because replacing that dual-modal validator with just one Vision Language Model judge caused instruction following to collapse by over thirty-seven points and object preservation by nearly thirty-two points <ref:2608.20381#pg3>.

Conclusion: Tom: So, looking at the paper "EditPPT: Structured Execution and Evaluation for Reliable Slide Editing", the authors are showing that constraining *how* edits are executed, not just making the AI model bigger, actually makes slide editing more reliable.

Jane: What does that mean in simple terms for someone who isn't deep in AI engineering? What's the big picture implication here?

Tom: It means we can move away from relying on open-ended code generation for presentation editing and toward a system where the process is highly structured, using specific tools for specific parts of the deck.

Lu: The implication is that if you define the problem as constrained modification—targets, operations, preservation—you get better results than just letting an LLM wander around trying to write the whole deck from scratch.

Meng: For production use, this suggests that instead of a massive general-purpose model doing everything, we could deploy these specialized agents with their fixed toolsets for high-fidelity editing tasks.

Jane: So it’s about reliability through structure and constraint rather than just raw model size? That makes sense when you think about the cascading errors they were fighting against.

Tom: Exactly. The paper introduces EDITPPT and DECKEDITBENCH, showing that by using a COM-based parser and constrained tool execution, they mitigate length-induced error cascades in practical slide editing.

More episodes

← Home