Papers for

facial recognition developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Synthetic face data similarity does not always mean privacy leaks

Not All Similarity Is Leakage: Distribution-Aware Identity Leakage Assessment in Synthetic Face Datasets

Abstract: Synthetic data provides the means for more ethical and less biased facial recognition. Nonetheless, the limitations of generative models and the conditioning process they rely on pose a risk of identity leakage, resulting in synthetic samples that are overly similar to those seen in a generator's training set, mitigating privacy benefits. In this work, we show that previously proposed approaches are affected by two key limitations: high classifier dependence and a tendency to identify leakage with respect to real datasets that were not used in training. To address these shortcomings, we propose a novel metric called Scaled Overlap (SO), which adapts a non-parametric data-copying test for facial recognition and extends it to the identity level. By leveraging a multi-model setup that compensates for errors in individual classifiers, it provides insights into the true strength of identity leakage. Our analysis identifies leaking datasets (CemiFace, SFace2, IDNet) with the most acute leakage introduced by generative model conditioning in CemiFace, demonstrates that real datasets do not contribute equally to generator training, and shows that the majority of synthetic images are drawn from multiple identities rather than relying on a single identity. Ultimately, our study provides new insights into the quality of synthetic datasets and gives more reliable techniques to help the community ensure the trustworthiness of synthetic data.

Mon 19 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Synthetic facial images can help protect privacy, but sometimes they look too much like real people used to train the models, causing privacy issues. The authors found that previous ways of spotting this problem had flaws, so they created a better method called Scaled Overlap to measure true identity copying more accurately. Their findings show that some synthetic datasets have more identity leakage than others and that most synthetic images mix features from different people instead of copying just one. This helps improve how we trust and use synthetic face data.
Open → 2610.26077v1

Model predicts human disagreement to improve facial expression recognition

Predicting Human Disagreement for Calibrated Dynamic Facial Expression Recognition

Abstract: Dynamic facial expression recognition (DFER) benchmarks such as DFEW provide multiple annotator votes per clip, yet most models collapse them to a majority label and cannot represent human disagreement at inference time. We propose a disagreement-aware DFER framework that trains directly on the raw annotator count vector using a Dirichlet-Multinomial likelihood. Unlike mean-only soft-label objectives, the proposed likelihood provides scale-sensitive supervision for the Dirichlet concentration while preserving the predictive mean. A separate ambiguity head predicts annotation entropy for unseen clips, and a monotone Chow-style reject rule combines predicted ambiguity, vacuity, temporal instability, and input quality for selective prediction. On DFEW, the method preserves recognition accuracy while reducing ECE by 30% and AURC by 15%, and predicted ambiguity reaches a Spearman correlation of 0.52 with the annotation entropy of test clips. The calibration and selective-prediction gains transfer to FERV39k and remain under identity- and movie-disjoint DFEW splits.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Facial expression recognition computers usually guess one emotion per face video clip, ignoring when people disagree on what emotion it shows. The authors propose a new approach that trains the model to predict not just one label but how often different people chose each emotion, capturing disagreements. Their model also estimates uncertainty and decides when it’s unsure enough to refuse a prediction. This method keeps accuracy while being better calibrated and more aware of ambiguous cases.
Open → 2609.17130v1