Papers for

speech security teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Emotion shifts reveal problems in speech deepfake detectors

Too Emotional to Be Fake? Intra-Utterance Emotion Shifts Expose Failure Modes in Speech Deepfake Detectors

Abstract: Expressive speech synthesis can now change emotion within a single utterance, yet its impact on deepfake detection remains unclear. We introduce EmoShift, a benchmark comparing emotion-stable (AA) and emotion-changing (AB) speech to examine these effects while accounting for static emotion identity and acoustic confounds. It comprises 7,240 bona fide utterances from four source datasets and 9,720 synthetic utterances generated using four expressive TTS systems. Across seven detectors, we find that emotion changes can make synthetic speech appear more genuine, increasing spoof miss rates by up to 25.3 percentage points on OMG-Emotion at fixed thresholds. Conversely, emotion-changing bona fide speech increases false-alarm rates by up to 24.4 percentage points on IEMOCAP. Further analyses reveal detector-specific sensitivities to emotion trajectories, not fully explained by static emotion identity or splicing artifacts. These findings underscore the importance of emotion dynamics in deepfake detection.

Fri 16 OctSoundComputation and Language
The gist
Detecting fake speech generated by computers can be tricky when the emotion in the speech changes within one sentence. The authors created a new test called EmoShift to compare normal speech and speech that changes emotion. They found that when fake speech changes emotion, it is harder for detectors to spot it as fake. Also, real speech with emotion changes can sometimes be mistakenly flagged as fake. This shows that how emotions change during speech is important for detecting fakes but current detectors struggle with it.
Open → 2610.22832v1

Boundary and intra-segment learning improves partial audio deepfake detection

Boundary and Intra-Segment Learning for Partial Audio Deepfake Localization

Abstract: Partial audio deepfakes manipulate only selected speech regions, making them difficult to be localized. Existing methods exploit boundary cues for partial deepfake localization, but primarily focus on identifying boundary positions rather than modeling the feature changes that characterize authenticity transitions. Meanwhile, the internal characteristics of continuous bona fide and spoofed segments remain underexplored. In this paper, we propose Boundary and Intra-Segment Learning (BISL), which introduces boundary learning to model feature differences between adjacent frames and distinguish authenticity transitions from general acoustic variations. In addition, intra-segment learning captures the overall characteristics of continuous bona fide and spoofed segments while enhancing feature consistency within each segment. By jointly learning frame, boundary, and segment information, BISL enables more effective fine-grained partial audio deepfake localization. Experiments on multiple localization benchmarks show that BISL achieves an EER of 2.52\% and an F1-score of 97.40\% on PartialSpoof, outperforming the compared methods, while maintaining competitive performance on HAD and improved cross-dataset performance on LPS. The code will be made publicly available upon acceptance.

Tue 22 SeptSound
The gist
Audio deepfakes can be tricky to spot when only parts of the speech are faked. The authors introduce a new method called BISL that looks not just at the boundary between real and fake speech but also studies the entire authentic and fake segments. This helps the system better tell where the fake parts are, even if changes are subtle. Their approach shows better accuracy than earlier methods on several tests.
Open → 2609.25822v1