AI & ML
4D Point Splatting for mmWave Radar Micro-Doppler Differentiable Rendering
arXiv eess.SP0 views
arXiv:2611.08342v1 Announce Type: cross Abstract: Millimeter-wave radar resolves the micrometer displacements of a moving body as micro-Doppler, enabling gait, gesture, activity, pose and vital-sign sensing. Each task relies on a downstream model trained on real data, yet radar datasets lag orders of magnitude behind vision and language. Brute-force collection will not close that gap, and existing synthesis methods (forward-only simulators, learned generators and static-scene inverse renderers) cannot fit a real capture of a moving body, leaving a sim2real gap. We present 4D Point Splatting (4DPS), a physics-based differentiable renderer that fits an explicit moving scene to a real capture. Using the synchronized camera to initialize the room and body, we represent the scene as oriented points carrying material, normal and velocity, and splat each point into range and Doppler bins. Our output is the raw complex return a real radar records, so we apply the same signal processing on the rendered data to obtain any representation for training any SOTA downstream model. We fit 235 sequences on HuPR and 100 on RT-Pose, two datasets with different radars. Our reconstructions set the state of the art, with median correlations of 0.940 and 0.830 on range-azimuth, 0.829 and 0.695 on range-Doppler, and 0.988 and 0.966 on micro-Doppler. Our renders also set the state of the art in downstream sim2real gap. On RT-Pose, a pose model trained on them reaches 21.9 cm MPJPE on real data, against 16.7 cm for real training and 127.6 cm for the RF-Genesis baseline, where both the rendered- and real-trained models learn nearly the same features. Our custom CUDA kernels fit a sequence in 5.7 minutes on HuPR and 12.9 on RT-Pose on one H100, making dataset-scale inverse rendering of mmWave radar possible for the first time. This work can enable synthetic data generation for any human-centered downstream task and model, and scene editing for data augmentation.
Source:https://arxiv.org/abs/2611.08342PreviousFlexible Piezoelectric Tactile Sensing System for Intelligent Object RecognitionNextDDA-Net: Accurate TDD Channel Estimation via Deep Unfolding the Doppler-Delay-Angle Representation of Channel Signals
Related posts

Count outcomes, not agents
0dev.to
Scientist World turns 1,000 papers into executable research environments
0dev.to
I struggle to believe that AI R&D is ingenious
0Hacker News
Palo Alto Networks in talks to buy AI agent security startup Clutch for $500M
0TechCrunch
I built a vocabulary battle game for English learners — and my crowdfunding is still at zero backers
0dev.to
Meta Just Bought Conductor — the Race in AI Coding Is No Longer About the Model
0dev.to