AI & ML
Erased but Recoverable: On the Fragility of Concept Erasure Under Fine-Tuning
arXiv cs.CR0 views
arXiv:2611.24220v1 Announce Type: new Abstract: Existing concept erasure methods for text-to-image diffusion models primarily focus on suppressing target concepts while preserving non-target generation quality. However, in practical applications, open-source diffusion models are often further adapted through DreamBooth, LoRA, or Custom Diffusion. Such adaptations can reshape internal representations, thereby weakening or even reversing the erasure effects achieved by existing methods. We identify erasure persistence as a key yet underexplored dimension of concept erasure and analyze how downstream fine-tuning reshapes internal representations. Our analysis reveals that fine-tuning of the original model does not uniformly modify the model, but preserves certain high-contribution structures, particularly attention heads with stable output subspaces and response magnitudes. We also observe that, after downstream fine-tuning of concept-erased models, these heads' output representations more readily realign with their pretrained counterparts. Motivated by this observation, we propose Stable-Head-Aware Concept Erasure (SHACE), which improves erasure persistence by preserving stable attention structures during concept erasure. SHACE identifies stability-critical attention heads through Attention-Head Stability Profiling and keeps their corresponding parameter blocks unchanged during erasure via Stable-Head Gradient Preservation. Extensive experiments show that SHACE improves resistance to concept recovery across diverse fine-tuning settings while maintaining strong suppression and non-target generation quality.
Source:https://arxiv.org/abs/2611.24220PreviousGuarding the Kingdom of Skill-Based Agents in the AI Dynasty of Computation: Control-Flow Integrity for Agent SkillsNextWhat Survives the Shift from Text to Pixels? Conditional Protection against Prompt Injection in Image-Rendered Documents
Related posts
Our health check said "db ok" for 40 minutes. It was talking to a cache.
0dev.to WebDev
Banco do Brasil: acesso indevido pode ter exposto CPF, e-mail e dados bancários
0dev.to Security

When the Attacker Has No Return Address
0dev.to Security
La nube te mantiene responsable de todos modos; lo local simplemente nunca comet
0dev.to Security
Interrupções em bancos e redes da NSA são ligadas a correções de falhas por IA
0dev.to Security
Reverse Path Filtering Is Not a Substitute for Routing Policy
0dev.to Linux