AI & ML
Benchmarking Sensor-Fault Robustness in Forecasting
arXiv eess.SP0 views
arXiv:2605.10822v2 Announce Type: replace-cross Abstract: Cyber-physical system (CPS) forecasting models depend on sensor streams with noisy, biased, missing, or temporally misaligned readings, yet standard forecasting evaluation often selects models by nominal error without showing whether they remain robust under such faults. We introduce SensorFault-Bench, a CPS-grounded protocol that evaluates forecasting architectures and robustness-improvement methods through controlled synthetic stress tests of isolated input faults, together with an operational taxonomy of the methods. Across four real-world datasets and eight scored scenarios governed by a standardized severity model, it reports worst-scenario degradation, clean mean squared error (MSE), and worst-scenario fault-time MSE, separating relative robustness from absolute error. Explicit fault-training methods train on adjacent fault families disjoint from the scored scenarios. Empirically, forecasting architectures favored by clean MSE can degrade sharply under faults, and clean-MSE rankings can disagree with worst-scenario fault-time error rankings. Chronos-2, the evaluated zero-shot foundation model, matches or trails the last-value naive forecaster in clean MSE on the two single-target datasets and has the largest worst-scenario degradation on ETTh1 and Traffic, where all channels are forecast targets. For the evaluated robustness-improvement method set, paired deltas show selective degradation reductions: projected gradient descent adversarial training and randomized training lead where value faults dominate observed degradation, and fault augmentation leads on Traffic, where availability faults dominate. High degradation reveals fault sensitivity that clean MSE misses, while low degradation supports robustness only within the evaluated scenarios. The benchmark therefore screens forecasters before use in a specific deployment, which requires validation against its recorded faults.
Source:https://arxiv.org/abs/2605.10822PreviousConsistent Geometric Deep Learning via Hilbert Bundles and Cellular SheavesNextNeuromorphic Decoding and Dynamical Image Reconstruction from Populations of Spiking Retinal Ganglion Cells
Related posts
Test DOCX Breaks as a Many-to-One Conversion
0dev.to JavaScript
A Bayesian Optimized Biquad Filter-Burg Model for Real-Time EEG Phase Estimation
0arXiv eess.SP
Thought-deciphering via hierarchical EEG-to-text alignment
0arXiv eess.SP
Neuromorphic Decoding and Dynamical Image Reconstruction from Populations of Spiking Retinal Ganglion Cells
0arXiv eess.SP
Consistent Geometric Deep Learning via Hilbert Bundles and Cellular Sheaves
0arXiv eess.SP
Multi-Threshold Sampling: Signal Space, Sampling Operators, and First Recorded Crossing-Time Distributions
0arXiv eess.SP