DataVista: Diagnosing Multimodal LLMs on Data Video Understanding

arXiv:2610.11993 · cs.CV, cs.AI, cs.CL · Submitted 2026-10-08 · Read on arXiv

cs.CV, cs.AI, cs.CL

Submitted: 2026-10-08

Updated: 2026-10-08

Comments: 46 pages, 22 figures, 14 tables

Code: https://github.com/HKUSTDial/DataVista

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Accuracy — 59× in this paper · explained in 1 episode
Benchmark — 45× in this paper · explained in 2 episodes
Temporal Reasoning — 26× in this paper · explained in 3 episodes
Causal Reasoning — 16× in this paper · explained in 2 episodes
Benchmarking — 8× in this paper · explained in 4 episodes
Aggregation — 6× in this paper
Verification — 6× in this paper · explained in 2 episodes
Consistency — 5× in this paper · explained in 3 episodes
Core — 4× in this paper · explained in 2 episodes
Fidelity — 4× in this paper · explained in 2 episodes
Text-to-SQL — 3× in this paper · explained in 3 episodes
Commentary — 2× in this paper · explained in 2 episodes
Cognitive Load — 1× in this paper · explained in 2 episodes
F1 Score — 1× in this paper · explained in 4 episodes
Failure Modes — 1× in this paper · explained in 3 episodes
Fine-Tuning — 1× in this paper · explained in 5 episodes
Generalization — 1× in this paper · explained in 13 episodes
Generative AI — 1× in this paper · explained in 2 episodes
Instruction Tuning — 1× in this paper · explained in 3 episodes
Multi-hop Reasoning — 1× in this paper · explained in 3 episodes
Thinking mode — 1× in this paper · explained in 2 episodes
alpha — 1× in this paper

Sources

Related papers