Stable Scores, Unstable Answers: Frame Phase and Option Order in Video Multiple-Choice Evaluation
cs.CV
Submitted: 2026-10-06
Updated: 2026-10-06
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- Frame Sampling Strategies Matter: A Benchmark for small vision language models
- TempCore: Are Video QA Benchmarks Temporally Grounded?
- Stable Curves, Unstable Items: Item-Level Scaling Heterogeneity in Video LLMs
- Caved or Convinced: Temporal Sampling Gates Claim Deference in Video Large Language Models
- Same Evidence, Different Answer: Auditing Order Sensitivity in Multimodal Large Language Models
- When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding
- PAS: A Training-Free Stabilizer for Temporal Encoding in Video LLMs
- Qwen2.5-VL Technical Report
- Qwen3-VL Technical Report
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
- MiMo-VL Technical Report
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs
- Hearing the Order: Investigating Position Bias in Large Audio-Language Models
- Answer-Consistent Chain-of-thought Reinforcement Learning For Multi-modal Large Langauge Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models