AI & ML
LWM-TF: A Wireless Foundation Model on 5G NR Time-Frequency Resource Grids
arXiv math.IT0 views
arXiv:2610.21013v1 Announce Type: new Abstract: Received OFDM grids preserve both pilot and payload observations, yet wireless foundation models are rarely pre-trained on them. We introduce LWM-TF, a 9.58M-parameter factorized masked autoencoder pre-trained on complex 5G NR uplink grids taken after the FFT and before channel estimation. Each block attends first across OFDM symbols and then across resource blocks and receive antennas, and the mask follows the same two axes. Because the payload phase is unpredictable, the model reconstructs the normalized log-power of each masked token and predicts its scale separately; ablations show that the two terms are complementary and that this target outperforms complex-signal reconstruction. The encoder is pre-trained on 850,496 physical uplink shared channel (PUSCH) slots from a 10^6-slot dataset simulated with the NR transmit chain under various channel conditions. With the encoder frozen, linear probes classify modulation, predict CRC success, and detect UE mobility. On a separately generated test set, 16 labeled slots per class give 0.85 modulation accuracy, 0.82 CRC area under the ROC curve (AUROC), and 0.73 mobility AUROC, ahead of a supervised CNN on every paired draw. With 10,000 labels the probes reach 0.94, 0.96, and 0.92, well above engineered receiver statistics, and detect mobility where the CNN stays at chance. Without any impairment labels, distances in the frozen feature space flag unseen waveform impairments with 0.78 macro AUROC, against 0.68 for receiver statistics. A single pre-trained encoder thus provides receiver features that transfer across tasks, most strongly when labels are scarce.
Source:https://arxiv.org/abs/2610.21013PreviousAnalog RF Computing for Integrated Data and AI Flows Over Wireless NetworksNextFour-Level Quantized Soft Information Aided Hard-Decision Decoder for Product-like Codes
Related posts

Apple 'HomeView Ultra' With 9-Inch 360º Screen Detailed in New Report
0MacRumors

Apple Isn't Done With 2026: Here's What's Still Coming
0MacRumors

Mark Gurman: Apple Initially Aimed to Release iPhone Duo in November
0MacRumors

iOS 27.2.1 Coming Soon, iOS 27.3 Beta Likely Available Tomorrow
0MacRumors
Grokipedia offers lessons in how AI can help Wikipedia
0Hacker News New
Are Prediction Markets Missing the Voters Who Could Decide the 2026 Midterms?
0Hacker News New