AI & ML
Multiple testing in multi-stream sequential change detection
arXiv stat.TH0 views
arXiv:2501.04130v5 Announce Type: replace Abstract: Multi-stream sequential change detection involves simultaneously monitoring many data streams and raising an alarm when their distributions change. We study the multiple testing issues that arise naturally in this setting. We first point out a fundamental tension between the criteria used in change detection and multiple testing: any procedure with finite average run length (ARL) must have worst-case false discovery rate (FDR) and family-wise error rate equal to one. Given this conflict, we find a middle ground by introducing the error over patience (EOP) class of Type I error metrics, which measure error relative to expected monitoring time. To control the EOP, we propose procedures combining e-detectors, which generalize Shiryaev-Roberts and CUSUM methods, with the recent e-Benjamini-Hochberg and e-Bonferroni methods for multiple testing. Our EOP guarantees hold uniformly over changepoints and stopping times with finite expectation, allowing dependence when each e-detector remains valid using information from all streams. If finite ARL is forfeited, using e-processes instead yields ordinary FDR and per-family error control at stopping times. We also prove power and delay bounds for Gaussian changes, establish first-order minimax optimality, and compare our procedures with existing methods in numerical experiments.
Source:https://arxiv.org/abs/2501.04130PreviousTesting Treatment Effect Heterogeneity with Functional OutcomesNextRao-Blackwellized e-variables
Related posts
Five regression tests for channel-aware AI reply drafts
0dev.to
Our smart contract scan found 14 of 20 known bugs. Recount it yourself, and see where it falls short
0dev.to
Standup amnesia: a short about forgetting what you did yesterday, and the daily note I use now
0dev.to
US boy names that became girl names and vice versa
0Hacker News
Most voted crypto projects on Coinvote, Oct 26 to Nov 1, 2026
0dev.to Data
Bluesky This Week — trending topics & AI brand mentions (2026-11-02)
0dev.to Data