Backdoor attacks in fine-tuned large language models reduced effectively

Backdoor Purification for LoRA-Tuned LLMs via Null-Space Projection

Artificial IntelligenceCryptography and SecurityMachine Learning

Summary

Large language models can be tricked by hidden backdoors that cause them to act badly when certain secret inputs appear. The authors introduce a way to clean these models without needing to know the secret backdoor triggers or using extra training. They do this by finding directions related to the backdoor behavior and then removing those influences while keeping the model's normal skills intact. Their method greatly reduces the chance of the backdoor working, while still allowing the model to do its usual tasks well.

What this means in practice

Authors

Jianwei Li, Jung-Eun Kim

Abstract

With the rapid adoption of large language models (LLMs) and parameter-efficient fine-tuning (PEFT) methods, the risk of backdoor attacks has become more severe. Existing backdoor purification methods typically rely on at least one of the strong assumptions, such as prior knowledge of triggers, access to clean references, or aggressive retraining, and they often lack comprehensive evaluations. These constraints substantially limit their practical applicability. To overcome these challenges, our work proposes purifying LoRA-tuned LLMs without these assumptions and even without post-hoc retraining of the suspect parameters. Our objective is to significantly reduce the attack success rates (ASR) while preserving both (i) the base model's general capabilities and (ii) the new downstream skills learned through the adapter. Through a series of ablation studies, we progressively scale our approach from a single layer in a text classification setting to a full-parameter LLM in the generative task. Through careful data curation and feature approximation, we extract high-fidelity backdoor directions and, for each layer or head, construct orthogonal null spaces in both the input and output channels, onto which the LoRA updates are projected. Empirically, our null-space projection method reduces the ASR from nearly 100% to less than 10%, while preserving the base model's benign performance and the adapter's learned abilities during downstream task adaptation.