AI & ML
Erased but Recoverable: On the Fragility of Concept Erasure Under Fine-Tuning
arXiv cs.CR0 views
arXiv:2611.24220v1 Announce Type: new Abstract: Existing concept erasure methods for text-to-image diffusion models primarily focus on suppressing target concepts while preserving non-target generation quality. However, in practical applications, open-source diffusion models are often further adapted through DreamBooth, LoRA, or Custom Diffusion. Such adaptations can reshape internal representations, thereby weakening or even reversing the erasure effects achieved by existing methods. We identify erasure persistence as a key yet underexplored dimension of concept erasure and analyze how downstream fine-tuning reshapes internal representations. Our analysis reveals that fine-tuning of the original model does not uniformly modify the model, but preserves certain high-contribution structures, particularly attention heads with stable output subspaces and response magnitudes. We also observe that, after downstream fine-tuning of concept-erased models, these heads' output representations more readily realign with their pretrained counterparts. Motivated by this observation, we propose Stable-Head-Aware Concept Erasure (SHACE), which improves erasure persistence by preserving stable attention structures during concept erasure. SHACE identifies stability-critical attention heads through Attention-Head Stability Profiling and keeps their corresponding parameter blocks unchanged during erasure via Stable-Head Gradient Preservation. Extensive experiments show that SHACE improves resistance to concept recovery across diverse fine-tuning settings while maintaining strong suppression and non-target generation quality.
Source:https://arxiv.org/abs/2611.24220PreviousGuarding the Kingdom of Skill-Based Agents in the AI Dynasty of Computation: Control-Flow Integrity for Agent SkillsNextWhat Survives the Shift from Text to Pixels? Conditional Protection against Prompt Injection in Image-Rendered Documents
Related posts
A Matching Lower Bound for Online Smooth Calibration
0arXiv stat.ML
How Path Integral Diffusion Decides a Finite Spin Glass
0arXiv stat.ML
Prescriptive Learning of Linear Policies with Feasibility Guarantees for Binary Decision-Making
0arXiv stat.ML
IQS-BO: In-Context Query Selection for Bayesian Optimisation
0arXiv stat.ML
Swiss-Knife: A Framework for Reconfigurable Externalised Multi-Objective Alignment at Decode Time
0arXiv stat.ML
Inverse Design for Conditional Distribution Matching
0arXiv stat.ML