AI & ML
Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning
arXiv cs.CR0 views
arXiv:2610.10655v1 Announce Type: cross Abstract: Large Language Models (LLMs) inevitably internalize substantial amounts of sensitive or private information during pre-training, while LLM unlearning aims to selectively erase specific knowledge to prevent privacy leakage with minimal loss of model utility. However, existing methods struggle to balance forget quality with utility, and typically incur substantial computational costs due to parameter fine-tuning. To address this, we propose Nullify, a training-free, non-destructive activation steering method for LLM unlearning. Nullify employs steering vectors during inference to redirect privacy-related activations away from their memorized answers, while satisfying a null-space constraint that leaves retained-query activations essentially unaffected to maintain utility. Evaluations on TOFU and MUSE show that Nullify matches or surpasses established baselines in forget quality while achieving near-lossless preservation of model utility. By avoiding weight updates entirely, Nullify serves as an efficient, plug-and-play inference-time intervention framework.
Source:https://arxiv.org/abs/2610.10655PreviousWhen Routing Reveals Membership: Privacy Leakage from MoE Router TelemetryNextAdversarial Cues in Decision Models Used as Judges: The Role of Request Presentation
Related posts
Traffic Dropped Overnight? A Diagnosis Checklist For Affiliate Sites After A Google Update
0dev.to Beginners
15 Best Free AI Tools in 2026 (Actually Free, Tested)
0dev.to Beginners
Building Raasta: Flooded-Road Detection with Satellite Images and PyTorch
0dev.to Beginners
5 Google Business Profile Quick Wins for Small Businesses (No Ads Needed)
0dev.to Beginners
How To Recover An Affiliate Site After A Google Spam Update
0dev.to Beginners
When a PDF Export Turns Every Page Into a Picture, Define the Text Contract First
0dev.to Testing