Barycentric Guidance: Turning Foundation Image Editors into Continuous Affective Controllers
cs.CV, cs.LG
Submitted: 2026-10-12
Updated: 2026-10-12
Comments: NeurIPS 2026
Code: https://github.com/harveymannering/BarycentricGuidance
License: http://creativecommons.org/licenses/by/4.0/
The gist: Emotions are expressed on a continuum and are naturally described in the valence-arousal (VA) space.
Abstract
Emotions are expressed on a continuum and are naturally described in the valence-arousal (VA) space. Existing VA-based image editors are typically training-based and domain-specific, limiting them to VA regions seen during training and making them brittle across datasets and domains. Meanwhile, despite producing high-quality edits, state-of-the-art foundation image editors are not continuous affective controllers: non-linear emotion representations in text encoders makes prompt interpolation poorly calibrated, so accurate and continuous VA control remains unreliable. To fill this gap, we introduce Barycentric Guidance, a training-free framework that turns pretrained foundation image editors into continuous affective controllers over VA, requiring no finetuning, extra data, or model changes. Our method maps any target VA point to simplex-based guidance weights, enabling VA controllability in three aspects: (i) accurate targeting of VA states, (ii) broad coverage across the VA plane, and (iii) continuous control. Across three face datasets, we improve VA target accuracy by 25-29%, expand VA-plane coverage by 28-50%, and increase expression diversity by 29-49%, over the strongest baseline. Unlike prior domain-specific methods, our training-free approach exploits the foundation model's inherent versatility, enabling generalization beyond human faces to animals, artworks, and complex scenes within a single framework. Code is available at https://github.com/harveymannering/BarycentricGuidance.
Sources
- EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Model
- FaceCrafter: Identity-Conditional Diffusion with Disentangled Control over Facial Pose, Expression, and Emotion
- FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
- Qwen-Image Technical Report
- Auto-Encoding Variational Bayes
- Score-Based Generative Modeling through Stochastic Differential Equations
- Flow Matching for Generative Modeling
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models
- Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editing
- PixelSmile: Toward Fine-Grained Facial Expression Editing
- Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control
- Towards Localized Fine-Grained Control for Facial Expression Generation
- A Unified and Interpretable Emotion Representation and Expression Generation
- Arc2Face: A Foundation Model for ID-Consistent Human Faces
- LoRA: Low-Rank Adaptation of Large Language Models
- EmoStyle: Emotion-Driven Image Stylization
- Qwen3-VL Technical Report
- Classifier-Free Diffusion Guidance
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models