AI & ML
Programmable GPU-Accelerated dApps for Real-Time Edge Inference and ISAC on NVIDIA Aerial Testbed
arXiv cs.NI0 views
arXiv:2512.06493v3 Announce Type: replace Abstract: The transition of cellular networks to (i) software-based systems on commodity hardware and (ii) platforms for services beyond connectivity introduces critical system-level challenges. As sensing emerges as a key feature toward 6G standardization, supporting Integrated Sensing and Communication (ISAC) with limited bandwidth and piggybacking on communication signals, while maintaining high reliability and performance, remains a fundamental challenge. In this paper, we provide two key contributions. First, we present a programmable, open-source framework for processing PHY signals through real-time, GPU-accelerated Artificial Intelligence (AI) applications on the edge Radio Access Network (RAN) infrastructure. Building on the Open RAN dApp architecture, the framework interfaces with a GPU-accelerated gNB based on NVIDIA Aerial Testbed (ATB), feeding PHY data to custom AI logic with about 84 $\mu$s of framework latency per slot and control loops with inference in about 123 $\mu$s for lightweight TensorRT models, multiple inference engines, and support for several AI backends. We evaluate the framework on two GPU platforms, with different GPU sharing modes and an increasing number of cells and dApps. Second, we demonstrate the framework capabilities through cuSense, an indoor localization dApp that consumes uplink DMRS channel estimates, removes static multipath components, and runs a neural network to infer the position of a moving person. Evaluated on a 3GPP-compliant 5G NR deployment, cuSense achieves a mean localization error of 73 cm on runs unseen during training, with 79% of predictions falling within 1 meter, and runs live in 241 $\mu$s, without dedicated sensing hardware or modifications to the 5G signals. The framework is released as open source, together with the cuSense dataset, providing a reference design for future AI-native RANs and ISAC applications.
Source:https://arxiv.org/abs/2512.06493PreviousfRAC: Remote Accelerator Calls on Hostless FPGAsNextSplitCom: Communication-efficient Split Federated Fine-tuning of LLMs via Temporal Compression
Related posts
I wanted one screen that said whether a kids' app was worth installing
0dev.to

Before I Could Build GPT, I Had to Teach a Machine to Learn
0dev.to
Cogent and OpenAI build cyber defense factories for enterprises
0OpenAI Blog
ChatGPT Plus for veterans and servicemembers
0OpenAI Blog
Hitting 200 Strokes: What the Signature Maker Does at Its Stroke Limit
0dev.to
A Lightweight, Open-Source Network Digital Twin Blueprint for IoT-Edge Environments
0arXiv cs.NI