Backdoor attacks in fine-tuned large language models reduced effectively
Backdoor Purification for LoRA-Tuned LLMs via Null-Space Projection
Artificial IntelligenceCryptography and SecurityMachine Learning
Summary
Large language models can be tricked by hidden backdoors that cause them to act badly when certain secret inputs appear. The authors introduce a way to clean these models without needing to know the secret backdoor triggers or using extra training. They do this by finding directions related to the backdoor behavior and then removing those influences while keeping the model's normal skills intact. Their method greatly reduces the chance of the backdoor working, while still allowing the model to do its usual tasks well.
What this means in practice
- •For machine learning engineers: Clean backdoored fine-tuned language models without retraining and without knowing attack details to safely deploy them.
- •For security teams in ai companies: Reduce risks from backdoored adapters in LLM collaborations by applying purification that preserves performance and new skills.
Authors
Jianwei Li, Jung-Eun Kim
Abstract
With the rapid adoption of large language models (LLMs) and parameter-efficient fine-tuning (PEFT) methods, the risk of backdoor attacks has become more severe. Existing backdoor purification methods typically rely on at least one of the strong assumptions, such as prior knowledge of triggers, access to clean references, or aggressive retraining, and they often lack comprehensive evaluations. These constraints substantially limit their practical applicability. To overcome these challenges, our work proposes purifying LoRA-tuned LLMs without these assumptions and even without post-hoc retraining of the suspect parameters. Our objective is to significantly reduce the attack success rates (ASR) while preserving both (i) the base model's general capabilities and (ii) the new downstream skills learned through the adapter. Through a series of ablation studies, we progressively scale our approach from a single layer in a text classification setting to a full-parameter LLM in the generative task. Through careful data curation and feature approximation, we extract high-fidelity backdoor directions and, for each layer or head, construct orthogonal null spaces in both the input and output channels, onto which the LoRA updates are projected. Empirically, our null-space projection method reduces the ASR from nearly 100% to less than 10%, while preserving the base model's benign performance and the adapter's learned abilities during downstream task adaptation.