AI & ML
Backdoor Containment via Expert Quarantine and Shutdown in LLMs
arXiv cs.CR0 views
arXiv:2610.00663v2 Announce Type: replace-cross Abstract: Backdoored large language models (LLMs) can behave normally on benign inputs while producing attacker-specified outputs under hidden triggers. Existing defenses span four stages---prior-training, in-training, post-training, and inference-time---and share one of two underlying strategies: either suppress backdoor learning (by filtering poisoned data or interrupting its acquisition during optimization) or learn, then purify (by repairing model weights or gating inputs after a fully backdoored model has formed). We propose a third strategy, learn, but channel: allow backdoor formation during training but route it into a designated, quarantined component that can be disabled at deployment. To this end, we propose Quarantined Expert Shutdown QES, a computationally efficient containment strategy built in a regularization-steered MoE-like setting. Specifically, given a poisoned dataset, QES augments a Transformer-based language model with routed expert-specific LoRA branches and lightweight routers, and uses auxiliary routing objectives to attract trigger-conditioned behavior into a designated expert while preserving benign capability elsewhere. At deployment, mitigation reduces to a single constant-time operation: zeroing the quarantined expert's routing weight, without trigger screening or further updating model weights. Empirically, our methods reduce the attack success rate (ASR) from 100% to 0-10% on most settings across two tasks, three attacks, and four model families, while downstream utility is often preserved or only modestly affected. These results establish learn, but channel as a previously unexplored regime for backdoor containment in generative LLMs.
Source:https://arxiv.org/abs/2610.00663PreviousGeneric Number-of-Copies Amplification for Pseudorandom StatesNextBackdoor Purification for LoRA-Tuned LLMs via Null-Space Projection
Related posts
cBridge: Do You Need Gas on Both Chains?
0dev.to
Honor Puts a 4-DOF Titanium Gimbal Inside a Phone at 7,999 Yuan
0dev.to

Protesters break into Microsoft data center site in Amsterdam
0The Verge

After printing 40,000 whistles, this is the 3D printer I’d buy
0The Verge

A New Community For In-House UX People
0Smashing Magazine
A flaw in ChatGPT, a lesson for our front-ends
0dev.to