PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis
cs.CL, cs.AI, cs.CV, cs.LG, cs.SE
Submitted: 2026-10-14
Updated: 2026-10-14
Comments: Work in progress
Project page: https://qiushisun.github.io/PrismaCoder-Home
License: http://creativecommons.org/licenses/by/4.0/
The gist: Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates.
Abstract
Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burgeoning, as models are increasingly asked to produce charts, webpages, animations, and semi-structured documents. Recently, proprietary models have pushed far ahead, producing interactive artifacts even from a text description or a screenshot alone. Yet their data and training remain closed, and open progress is held back by the quantity and quality of available data and by the pipelines and methods for producing it. Quality is the harder of the two, since a sample must be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or fail, code similarity does not map to the visual output, and task-specific verifiers do not generalize. To push open progress further, we start from the data side with PrismaForge, a hierarchical data pipeline centered on a synthesized rubric that decomposes these factors into checkable criteria. The same rubric serves as both filter and reward: it curates the supervised corpus, then drives reinforcement learning on visual-coding tasks. Leveraging PrismaForge for data synthesis and filtering, we build PrismaCoder-2M, the most diverse open dataset for multimodal code intelligence and the largest to date. On the model side, we train PrismaCoder-9B and PrismaCoder-35B on this data and release both. They lead the open state of the art by a wide margin and rival leading proprietary systems. Our analyses further show that the proposed rubric-based pipeline improves multimodal coding performance across model backbones. We release our code and data at https://qiushisun.github.io/PrismaCoder-Home/.
Sources
- Qwen3-VL Technical Report
- InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation
- Symbolic Graphics Programming with Large Language Models
- Gemma 4 Technical Report
- ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
- Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset
- On the Perception Bottleneck of VLMs for Chart Understanding
- Visual-ERM: Reward Modeling for Visual Equivalence
- Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers
- TechImage-Bench: Rubric-Based Evaluation for Technical Image Generation
- VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generation
- SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilities
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow
- A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond
- Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilities
- ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
- DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
- OmniSVG: A Unified Scalable Vector Graphics Generation Model
- ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering