Papers for

affective computing engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Literary reader feelings analysis separates story effects from word impact

LitArc-Bench: Disentangling Text-Specific Reader-Response Dynamics from Position and Lexical Affect

Abstract: When model predictions track an unfolding human affect trajectory, alignment may reflect narrative position, affective words, or text-specific reader-response dynamics. We introduce LitArc-Bench to separate these explanations: 39 Chinese-language literary excerpts segmented into seven checkpoints, with 430 questionnaires from 81 adults in two classroom groups (9,020 VAD ratings). We compare three future-blind model runs with leave-one-text-out position priors, lexical affect, and human-human references. Position alone reaches r = .470 for arousal, making raw alignment insufficient. Yet all six V/A transition advantages over a joint position-lexicon control have text-bootstrap intervals above zero. Cross-fitted models match the correct human text better than 38 mismatched texts in all nine model-dimension cells (p < .0001); a text-invariant negative control returns chance (p = 1). On human transitions at least 0.5 points against the position trend, models recover 69-76% of valence directions and 53-68% for arousal and dominance. Under crossed participant-text resampling, all nine identity intervals remain above zero; joint-control advantages are robust for valence and directional but less certain for arousal. High shape agreement still coexists with scale bias. LitArc-Bench identifies which components of literary reader response are recoverable beyond shallow explanations and why shape, calibration, and human variability require separate evaluation.

Fri 13 NovComputation and Language
The gist
When people read stories, their feelings can change because of where they are in the story, the words used, or how the story makes them feel uniquely. The authors created LitArc-Bench, a set of Chinese story pieces with detailed reader feelings data. They tested models to see if they could tell apart these different causes of feeling changes. Their work shows that it’s important to separate story position and word effects to understand reader emotions better. This helps improve how computers predict human responses to literature.
Open → 2611.18412v1

Dual path method improves cross subject emotion recognition from EEG

Beyond Modeling Order: Dual-Path Spatiotemporal Representation Learning for Cross-Subject EEG Emotion Recognition

Abstract: Cross-subject generalization remains a major challenge for EEG-based emotion recognition due to pronounced inter-subject variability in neural activity and emotion-related spatiotemporal patterns. Existing methods mainly alleviate inter subject differences through distribution alignment or contrastive learning, while paying limited attention to representation bias associated with fixed spatiotemporal modeling orders. We hypothesize that high-level emotion representations of the same EEG signal should remain consistent across different spatiotemporal modeling paths. Based on this hypothesis, we propose a Dual-Path Spatiotemporal Contrastive Learning (DP-STCL) framework for cross-subject EEG emotion recognition. DP-STCL employs two complementary encoders with independent parameters, namely a Temporal-to-Spatial (TS) path and a Spatial to-Temporal (ST) path, to model EEG spatiotemporal information under different integration orders. During representation learning, the same emotional stimulus is used to establish cross subject associations, while three complementary relations jointly constrain representation variations across subjects and modeling paths. This promotes stable and discriminative stimulus-related emotion representations. To further handle limited labeled target subject data, we introduce a LoRA-based few-shot adaptation strategy with low parameter overhead. Extensive cross-subject experiments on SEED, SEED-IV, SEED-V, and FACED show that DP-STCL consistently outperforms the compared methods, demonstrating its effectiveness in improving cross-subject EEG emotion recognition.

Mon 26 OctMachine Learning
The gist
Recognizing emotions from brain signals is hard because people's brains work differently. The authors suggest using two different ways to look at brain data—first focusing on how signals change over time, then across space, and vice versa. By making sure these two views agree when identifying emotions, their method learns better, more stable emotion patterns that work across different people. They also created a way to adapt the system quickly with only a little new data. Tests showed their approach works better than older ones.
Open → 2610.35540v1

Reinforcement learning improves emotional reasoning with diverse and grounded predictions

DSPO: Diversity-aware Subjective Policy Optimization for Robust Emotional Reasoning

Abstract: Reinforcement Learning has significantly advanced the complex reasoning capabilities of MLLMs. However, prevailing RL algorithms suffer a severe failure in emotion reasoning tasks. These methods heavily rely on deterministic hard-label supervision and point-wise isolated evaluation, creating a fundamental gap with the inherently subjective and continuously distributed nature of human emotions. Furthermore, unlike explicit physical objects, emotional states are deeply implicit within visual cues. This abstract nature exacerbates visual hallucinations in MLLMs, leading to plausible yet ungrounded emotional evidence. To address these limitations, we propose Diversity-Aware Subjective Policy Optimization (DSPO), a reinforcement learning framework that jointly promotes subjective affective coverage and visual grounding. First, we construct a context-grounded emotional distribution prior in the VAD space by combining the lexical prior of the annotated emotion with image-specific contextual information. Based on this prior, we introduce a Distribution-Aligned Emotional Diversity Reward (DEDR), which measures the leave-one-out marginal contribution of each candidate emotion within a rollout. DEDR rewards candidates whose inclusion brings the predicted affective set closer to the context-grounded prior, thereby preserving plausible subjective interpretations without encouraging unconstrained dispersion. We further develop Counterfactual Visual Intervention Gating (CVIG), which masks the visual region highlighted in the reasoning process and uses the resulting candidate-wise probability changes to reduce the weights of interpretations unsupported by visual evidence. Extensive experiments demonstrate that DSPO achieves state-of-the-art performance across multiple public benchmarks, especially on the cross-domain performance, i.e., improving +10.8\% on average cross-domain accuracy than EMO-R3.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Understanding human emotions from images is very hard for AI because feelings can be different for everyone and are not directly visible. The authors found that current AI methods struggle because they treat emotions as fixed labels and do not consider the variety of feelings people might have. They propose a new learning approach that encourages the AI to suggest a diverse set of emotions that better match the context of the image, while also checking that these feelings are supported by the actual visual clues. Their method improves the AI's ability to guess emotions more accurately, especially when tested on different kinds of images.
Open → 2609.36775v1

Multimodal emotion recognition improves with adaptive fusion and facial geometry

Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry

Abstract: Emotion Recognition in Conversations (ERC) requires integrating heterogeneous textual, audio, and visual cues while accounting for conversational context and emotional dynamics. We extend the Self-Distillation Transformer architecture for ERC with appearance+geometry visual representations, class-wise adaptive modality fusion, and a valence-arousal prior for affective transitions. On the MELD and IEMOCAP datasets, geometry-enhanced visual representations improve weighted F1 by 0.27 and 4.36 points over appearance-only features, respectively, while class-wise adaptive fusion provides further gains of 0.17 and 0.25 points over the original softmax gate. The valence-arousal prior yields targeted improvements of 0.30 and 0.74 accuracy points on emotionally shifted utterances while preserving performance on stable turns. These results indicate that structured facial cues, emotion-dependent modality weighting, and affective geometry provide complementary benefits for multimodal ERC.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Understanding emotions in conversations is hard because people express feelings through words, tone, and facial expressions. The authors improve emotion recognition by combining facial appearance and precise facial movements, adjusting how much each type of signal counts depending on the emotion, and using a model of how emotions change over time. They tested their approach on two conversation datasets and found better accuracy, especially when emotions shift during the conversation. This shows that using detailed facial cues and emotion-aware mixing of signals helps machines understand feelings more reliably.
Open → 2609.09924v1