AI & ML
Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders
arXiv cs.CR0 views
arXiv:2610.32059v1 Announce Type: cross Abstract: Diffusion-based image generation models produce high-quality images but may generate harmful or policy-violating content, motivating machine unlearning (MU) to selectively remove target concepts while preserving general capabilities. However, existing MU approaches often struggle with the distributed and entangled nature of concept representations, leading to inefficient optimization and imprecise edits when applied through large-scale fine-tuning over full diffusion trajectories. To bridge this gap, we propose Concept Acupuncturist (ConceptACP), a novel MU framework that integrates interpretability-guided analysis with inference-free fine-tuning for efficient and precise concept removal. By establishing mappings between semantic concepts and cross-attention blocks in the U-Net denoiser and localizing the most concept-relevant block for targeted optimization, ConceptACP avoids full diffusion trajectory optimization, thereby improving fine-tuning efficiency. To mitigate concept entanglement, we propose a feature-level correction mechanism based on Sparse Autoencoders (SAEs), where SAE-derived sparse, semantically meaningful feature activations are manipulated to construct targeted correction signals, which are then projected back to the output space of the corresponding block and used as supervision for precise concept removal. Consequently, ConceptACP eliminates the need for external inference-time modules while achieving efficient and fine-grained unlearning. Instantiated on SDXL-Turbo, ConceptACP improves the forgetting success rate by 36.34 percentage points in the standard one-step generation setting on average over the best-performing baseline, while preserving image quality and prompt fidelity, and generalizes effectively across other Stable Diffusion backbones. Our code is available at https://github.com/Eran-Xia/ConceptACP.
Source:https://arxiv.org/abs/2610.32059PreviousThe Entire Quantum Computer on a Classical LeashNextCurvature-Aware Clipping: Mitigating Bias in DPSGD via Approximate Second-Order Information
Related posts
‘A perfect scientist, a perfect mum’: researchers mourn two biologists’ deaths in Spanish train crash
0Nature News

Apple says memory costs and Siri AI will weigh on holiday quarter profit margins
09to5Mac

Making Local LLMs Usable on 8GB GPUs
0HackerNoon

Educational Byte: What Are Synthetic Tokens in Crypto Networks?
0HackerNoon
Your AI Assistant Is Waiting Around - An AI Agent Goes to Work
0HackerNoon
Your AI Agent's Memory Needs Two Clocks
0HackerNoon