DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision
cs.CL
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: 21 pages, 6 figures, including references and appendices. Benchmark website: https://yifan-lan.github.io/DecisionRobust/
Code: https://github.com/OmniJev/OneJev
Project page: https://yifan-lan.github.io/DecisionRobust
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Evaluating and Benchmarking the System One Model Jev
- Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
- JevAdvBench: A Benchmark and Black-Box Attacks for Reinforcement Learning for Calibrated Decisions Models
- The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation
- Forced Deferral: Manipulating Routing Decisions in Multimodal LLM Cascades
- NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
- Ignore Previous Prompt: Attack Techniques For Language Models
- Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search
- Visual Jev: Accurate and Efficient Decisions from Shared Visual Context
- GLiNER2: An Efficient Multi-Task Information Extraction System with Schema-Driven Interface
- PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering