Backend
Exploring the Privacy--Size Tradeoff for Differentially Private Self-Attentive Variational Autoencoders
arXiv cs.CR0 views
arXiv:2611.05582v1 Announce Type: cross Abstract: Data tends to be most useful when it is shared, and the data most worth sharing is often the data that privacy obligations restrict. Synthetic data from a generator trained under differential privacy (DP) is one way to reconcile the two, but its utility depends on the privacy budget $\varepsilon$ and on how much data the generator sees - a parameter that most data sharing applications of synthetic data control. We present SAVANT, a self-attentive variational autoencoder for tabular data trained with DP-SGD that, to our knowledge, is the first to combine attention, a VAE, and DP in one tabular model. We evaluate it against two marginal mechanisms, PrivBayes and MST, jointly over the privacy budget and the dataset size on two public datasets, measuring the utility a downstream classifier loses by training on synthetic rather than real data. We find that, under the same DP guarantee, more data generally means more utility. For the marginal mechanisms it absorbs most of what a strict budget costs, and a noise-scaling argument suggests DP-SGD exchanges data fo budget at a worse rate. Two independent membership-inference attacks, judged against a measured null, found no aggregate membership signal.
Source:https://arxiv.org/abs/2611.05582PreviousFrom Claws to Conferences: Device-Independent Key Agreement Beyond Non-SignalingNextGeneralized Hyperrectangular Prediction Sets in Multivariate Conformal Prediction
Related posts
GTI-mSEMP Framework : A Proposed Framework to Simulate Malware Propagation with Inclusion of Attacker-Defender Strategy
0arXiv cs.NI
When Does Risk-Controlled Throughput Forecasting Actually Control Risk? A Reproduction Study on LEO Satellite Link
0arXiv cs.NI
Mobility-Aware Mobile Edge Computing for Energy-Balanced Data Collection in IoT-Enabled Underwater Sensor Networks
0arXiv cs.NI
Coexistence-Aware Antenna Tilt and Resource Allocation for Cellular-Connected UAV Corridors
0arXiv cs.NI
StarWorld: A Cross-Layer World Model for Starlink Prediction and Streaming
0arXiv cs.NI
The Confidence Score: a New Measure on Kernels
0arXiv eess.SP