Kernel machines show stronger resistance to adversarial attacks than neural networks

Adversarial Robustness of Kernel Machines: A Comprehensive Analysis

Machine LearningArtificial Intelligence

Summary

Some computer programs, called kernel machines, help computers recognize patterns, like images or tabular data. The authors tested how well these programs resist tricky, slightly changed inputs designed to fool them, called adversarial examples. They found that kernel machines are naturally better at handling these tricky inputs compared to another popular kind of program, neural networks. They also developed a way to train kernel machines to become even tougher against attacks.

What this means in practice

Authors

Rahul Kumar Yadav, Tunir Ghosh, Sudhendu Ahir, Parthe Pandit, Arjun Bhagoji

Abstract

Kernel machines are an important class of models in machine learning. However, the question of how robust modern kernel machines are to adversarial examples has not been studied comprehensively. In this paper, we provide a thorough empirical investigation of the adversarial robustness of kernel-based models for both binary and multiclass classification tasks, via white-box and black-box evasion attacks. We evaluate the native robustness of kernel machines, random feature classifiers, and the relatively newer Recursive Feature Machines. In addition, we provide an algorithm for approximate adversarial training of kernel machines. Our experiments on classification tasks on image and tabular datasets strongly indicate that kernel machines are natively more robust than neural networks, i.e., their performance degrades more gracefully against adversarial perturbations.