Backend
When Routing Reveals Membership: Privacy Leakage from MoE Router Telemetry
arXiv cs.CR0 views
arXiv:2610.10616v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) language models produce routing information during inference that may be logged or exposed for monitoring, debugging, load analysis, and safety auditing. Unlike ordinary model outputs, this telemetry reveals a view of the model's internal computation, raising a privacy question: can it reveal whether an example was used to fine-tune the deployed model? We introduce a router-augmented membership inference attack that combines conventional output-side signals with aggregated routing features and applies a membership classifier learned from independently fine-tuned shadow models to the target model. Across three MoE architectures and three data domains, router telemetry consistently improves membership inference over a strong output-signal ensemble, increasing TPR at 1\% FPR by 2.7--9.4 percentage points across all nine settings. The leakage persists across full fine-tuning, frozen-router training, LoRA, and instruction tuning, and remains observable with only discrete expert selections, restricted telemetry, or a single shadow model. Mechanistic analysis further shows that the leakage does not require router-specific memorization: fine-tuning introduces membership information into hidden representations, while the router exposes a projection of this signal even when its parameters are frozen. Perturbing the telemetry reduces this additional leakage only as its fidelity degrades. Our results show that router telemetry can turn an operational signal into an additional privacy surface for fine-tuned MoE models.
Source:https://arxiv.org/abs/2610.10616PreviousTemporal transformer CAN encoder with federated lightweight heads for anomaly detectionNextNullify: Null-Space Activation Steering for Training-Free LLM Unlearning
Related posts

Google Cloud Spend Caps Reach General Availability With an API and Live Costs
0dev.to
I built a Tinder-style Website for finding coding project ideas
0dev.to
GSAP ScrollTrigger image sequence in WordPress without code: when DIY isn't worth it
0dev.to
Surviving AWS Spot Interruptions With Real Checkpointing
0dev.to
Forward Watch
0dev.to
How to Choose 3 Healthtech Email API Paths: Retention Rules That Survive Audits
0dev.to