AI & ML
How large an effect would we have seen? Positive controls, detection floors and dataset pitfalls in scalp-EEG speech decoding
arXiv eess.SP0 views
arXiv:2610.20942v1 Announce Type: new Abstract: Objective. Studies that decode imagined speech from scalp electroencephalography (EEG) commonly validate their pipelines with a positive control, usually overt speech, and report null results without stating what effect size the pipeline could have detected. Approach. Using ds003626 ("Thinking out loud"), KaraOne and Track 3 of the 2020 International Brain-Computer Interface Competition, we audited decoding of overt speech, articulator preparation and imagined speech with artifact-channel subsets, band-limited decoding and trial selection, under a protocol that enforces split integrity by assertion. We injected class-dependent effects of known amplitude into the real recordings to measure the detection floor of five decoder families, and we checked the ds003626 labels against the dataset's acquisition protocol. Main results. On ds003626, two lip electrodes decoded overt speech at 0.7430 and the eight external channels at 0.7068, against 0.4231 for the 128-channel scalp montage, and no decodable signal survived in the 8-30 Hz band. On the other two corpora, within-subject accuracy rose monotonically with frequency into the range dominated by muscle activity. Band-power logistic regression detected an injected 8-30 Hz desynchronization of 0.54 uV under a criterion fixed in advance, whereas a compact convolutional network (EEGNet) detected nothing within subject up to 4.31 uV. In ds003626, the condition codes are the reverse of the intuitive reading, the class encoding changed between public releases, and condition is a deterministic function of time within each session. Significance. In these corpora the overt-speech positive control is dominated by myogenic signal and cannot validate a decoding pipeline. We recommend that speech-decoding studies report band-limited and artifact-channel accuracy, the direction of accuracy across frequency, and a measured detection floor.
Source:https://arxiv.org/abs/2610.20942PreviousRange Ambiguity Identification and Elimination by Leveraging Temporal Broadening Effect for THz SensingNextCross-subject decoding of imagined speech from scalp EEG: a leakage-controlled evaluation on three public corpora
Related posts
You Did Great for Three Days. Then Life Happened. Here Is a Habit System That Survives That.
0dev.to Beginners
Building an Agent Evaluation CI/CD Pipeline: Architecture, Budgets, and Regression Gates
0dev.to Testing
Truncado silencioso: cuando un verificador de LLM da el mismo puntaje a una respuesta correcta y a una incorrecta
0dev.to Testing
Your CI is red because of code you didn't write
0dev.to OpenSource
Summer 2026 Internships: 8 New Openings This Week (Nov 2)
0dev.to Programming
Ruby Receptionist Alternatives: 5 Options Compared (2026)
0dev.to Programming