Partial speech spoofing detection improves false alarm control but challenge remains
Temporal Anchors and Editing Sensitivity in Partial Speech Spoofing: A Controlled Study
Sound
Summary
Detecting when parts of a speech recording have been faked is tricky because systems must spot fake parts while ignoring harmless edits. The authors studied how timing clues and training strategies affect this detection using special voice features. They found that some ways to train reduce false alarms on real edits but may slightly increase missed fake detections. The system’s performance also varies depending on the data and settings used. Their work includes tools and data to better understand and improve these partial spoofing detectors.
What this means in practice
- •For voice security teams: Improve detection of partially faked speech recordings while reducing false alarms on legitimate edits in voice authentication systems.
- •For digital audio forensics units: Use diagnostic tools to better identify and localize synthetic speech segments mixed into genuine audio recordings.
Authors
Xiaosu Su, Yun Cao, Yiping Ni, Xiaowei Yi
Abstract
Partial-spoof detectors must reject synthetic content while accepting benign edits. We diagnose temporal anchors and boundary-consistency training using frozen WavLM features, nonlinguistic unit controls, and source-locked evaluation. Genuine-genuine and genuine-fake splices contrast editing false alarms with synthetic-content misses; they do not isolate a unique causal artifact. With layer-6 features, phone units have higher PartialSpoof evaluation frame EER than soft frames (11.18% versus 9.59%). In 500 retrospective PS-eval cases, augmentation reduces genuine-splice false alarms; synthetic-core misses increase at 5% PS-development FPR but not demonstrably at 1%. A 200-case Llama A follow-up retains the false-alarm reduction but does not establish a miss-rate increase. Constructed-case ranking can improve while fixed-threshold misses rise. Consistency gives no uniform gain, and encoder-layer rankings change across corpora. We report frame and event localization with three seeds, including word units, and treat PS evaluation as retrospective. Audit code, selected training scripts, and result summaries are available at https://github.com/mysxs/partial-spoof-diagnostics.