Intentional Electromagnetic Interference Attacks on Facial Recognition

Computer Vision and Pattern RecognitionCryptography and SecurityMachine Learning

Summary

The authors show that face recognition systems can be tricked using radio waves that cause interference, something usually not tested before. They use common radio equipment to create this interference and check how well current face recognition methods handle it. To help others test and improve these systems, they also provide a collection of face images taken with and without this radio interference. This work adds a new way to evaluate biometric security beyond existing methods.

Authors

Tyler Fitzsimmons, Adam Czajka

Abstract

Attacks on general computer vision algorithms are often relegated to the digital domain, with the optimization performed purely in the digital world and then translated to physical mediums for implementation. In the field of biometrics, including facial recognition, physical presentation attacks targeting biometric sensors are dominant and present significant opportunity and risk. This paper highlights a critical vulnerability in the physical-to-digital pipeline of biometric sensors and provides a standardized approach for testing facial recognition system robustness against hardware attacks, going beyond and potentially complementing presentation attacks (as defined in ISO/IEC 30107 standard series). Specifically, in this work we (a) demonstrate that intentional electromagnetic interference is possible to be conducted with commonly accessible radio frequency (RF) equipment, (b) assess the robustness of state-of-the-art face recognition methods against RF-based attacks, and (c) provide a dataset composed of face images captured with and without electromagnetic interference to serve as a new benchmark for testing modern face matchers against RF-sourced interference.