AffectWorld: Benchmarking Emotion-Driven Future World Prediction
cs.CV, cs.AI
Submitted: 2026-10-13
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: The world encompasses both physical environments and human actors.
Terminology
Abstract
The world encompasses both physical environments and human actors. Predicting its evolution requires understanding both physical laws and how emotions shape human actions. However, existing world model benchmarks primarily assess physical plausibility and perceptual quality, leaving emotion-driven world evolution largely untested.We introduce AffectWorld, a benchmark that evaluates the chain Emotion-Action-World State through three tasks: World-State Consistency, Emotion-Action Consistency, and Causal Consistency. It comprises 1,498 everyday video samples annotated with plausible emotions, action tendencies, and atomic world-state constraints. A counterfactual subset of 233 samples tests whether changing an agent's emotion under fixed scene and event conditions yields corresponding changes in actions and consequences. We define eight metrics across the three tasks and an additional counterfactual metric, combining automatic visual assessment with human-calibrated VLM/LLM judgments. Evaluations of five SoTA world models (e.g., Cosmos3) required world-state change scores of 0.100-0.280 and counterfactual emotion sensitivity scores of 0.027-0.070 on a [0, 1] scale. These results reveal substantial gaps in generating the consequences of emotion-driven actions and adapting future predictions to emotional interventions. AffectWorld provides a testbed for advancing world models that capture how emotions shape future physical and social states.
Sources
- Cosmos World Foundation Model Platform for Physical AI
- Mental World Modeling
- World Models
- LTX-Video: Realtime Video Latent Diffusion
- Mastering Diverse Domains through World Models
- Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations
- DreamGen: Unlocking Generalization in Robot Learning through Video World Models
- WorldEval: World Model as Real-World Robot Policies Evaluator
- DINOv2: Learning Robust Visual Features without Supervision
- WorldSimBench: Towards Video Generation Models as World Simulators
- Large Emotional World Model
- HunyuanVideo 1.5 Technical Report
- WorldBench: Disambiguating Physics for Diagnostic Evaluation of World Models
- Wan: Open and Advanced Large-Scale Video Generative Models
- CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer
- EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
- Social World Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models