Backend
Incentivize Contribution and Learn Parameters Too: Federated Learning with Strategic Data Owners
arXiv cs.MA0 views
arXiv:2505.12010v5 Announce Type: replace-cross Abstract: In federated learning (FL), a center trains a shared model from updates that clients compute on their private data. Collecting and training on data is costly, so a strategic client may contribute little data and free-ride on the model trained by the others. We study mechanisms that incentivize data contribution and learn the model at the same time. Our first mechanism, UPBReD, updates the clients ' contributions and the model jointly, and converges at a geometric rate to a Nash equilibrium of the contribution game together with the welfare-maximizing model for those contributions. This equilibrium can involve under-contribution, so our second mechanism, 2P-UPBReD, adds budget-balanced transfers that make full contribution a dominant strategy, after which training converges to the optimal model; we also give conditions under which every client prefers to participate. Both mechanisms trust what clients report about the data they use and the gradients they compute. We show that no payment rule can reward unverifiable contributions unless something the center observes depends on the data actually used. Building on this, T-2P-UPBReD checks each client's reported contribution against the other clients ' realized valuations of the trained model, and prices gradient reports with a budget-balanced charge. It elicits truthful contribution reports, makes gradient reports approximately truthful, still reaches full contribution and the optimal model, and never runs a deficit. Experiments on CIFAR-10, FEMNIST, and Twitter show that 2P-UPBReD matches the welfare of FedAvg trained on all data, while strategic clients without incentives lower the welfare of the learned model.
Source:https://arxiv.org/abs/2505.12010PreviousMisinformation Propagation in Benign Multi-Agent SystemsNextPrompt Stability Matters: Evaluating and Optimizing Auto-Generated Prompt in General-Purpose Systems
Related posts
Building AgentMesh: Exploring a Shared Compute Infrastructure for AI Workloads
0dev.to AI

Exploratory Testing with AI: Beyond Predefined Test Cases
0dev.to AI
Goravel file uploads and downloads with Storage
0dev.to WebDev
Reorder PDF Pages: Free Online PDF Page Reordering Tool — How-To Guide
0dev.to WebDev
Firecrawl in Production: Surviving 10K Concurrent Scrapes on Cloudflare Workers
0dev.to WebDev
I described what I shipped. Then I checked, and it wasn't the file I sent.
0dev.to WebDev