AI & ML
Thought-deciphering via hierarchical EEG-to-text alignment
arXiv eess.SP0 views
arXiv:2611.03623v2 Announce Type: replace-cross Abstract: Non-invasive brain-to-text interfaces offer alternative communication pathways for people with communication disabilities. However, sentence-level decoding from electroencephalography (EEG) remains challenging. We propose a hierarchical EEG-text alignment framework that retrieves sentences by progressively decoding coarse-grained semantic information and fine-grained sentence representations. We hypothesize that broader semantic context can be more reliably captured from EEG than individual sentences. Accordingly, EEG representations are first aligned with semantic classes, followed by sentence retrieval within the predicted class. Among over 2,000 unique text samples, our approach achieves average top-5 and top-10 retrieval accuracies of 62.6\% $\pm$ 1.0\% and 83.5\% $\pm$ 1.0\%, respectively, compared with 50.3\% $\pm$ 2.3\% and 68.3\% $\pm$ 2.0\% for direct EEG-sentence alignment. Qualitative analysis further reveals that decoding performance depends strongly on textual context. These findings demonstrate the potential of hierarchical semantic alignment for improving sentence-level EEG-to-text decoding.
Source:https://arxiv.org/abs/2611.03623PreviousNeuromorphic Decoding and Dynamical Image Reconstruction from Populations of Spiking Retinal Ganglion CellsNextA Bayesian Optimized Biquad Filter-Burg Model for Real-Time EEG Phase Estimation
Related posts
Test DOCX Breaks as a Many-to-One Conversion
0dev.to JavaScript
A Bayesian Optimized Biquad Filter-Burg Model for Real-Time EEG Phase Estimation
0arXiv eess.SP
Neuromorphic Decoding and Dynamical Image Reconstruction from Populations of Spiking Retinal Ganglion Cells
0arXiv eess.SP
Benchmarking Sensor-Fault Robustness in Forecasting
0arXiv eess.SP
Consistent Geometric Deep Learning via Hilbert Bundles and Cellular Sheaves
0arXiv eess.SP
Multi-Threshold Sampling: Signal Space, Sampling Operators, and First Recorded Crossing-Time Distributions
0arXiv eess.SP