Industry
On-Device Super-Resolution Imaging for a Low-Cost SPAD Array on a 640-KB-SRAM Microcontroller
arXiv eess.IV0 views
arXiv:2610.09098v1 Announce Type: new Abstract: This work presents a super-resolution (SR) deep-learning (DL) architecture to simultaneously upscale low-resolution (LR) depth and intensity images acquired by a consumer-grade VL53L9CX time-of-flight (ToF) sensor, a compact single-photon avalanche diode (SPAD) ranging device, while targeting deployment on a resource-constrained microcontroller (MCU) with only 640 KB SRAM and 2 MB Flash. The VL53L9CX provides 54 $\times$ 42 depth and intensity measurements. The proposed framework performs $\times$4 spatial SR to reconstruct 216 $\times$ 168 depth and intensity images simultaneously. The network employs separate reconstruction branches for intensity and high-resolution (HR) depth. We train the network with efficient loss functions and investigate the performance by testing multiple compact, hardware-oriented backbones, including Spatially Adaptive Feature Modulation (SAFM), Swift Parameter-Free Attention Network (SPAN), and Residual Local Feature Network (RLFN). We evaluate the network on both synthetic and real measurements, with particular attention to constrained activation and memory storage. We export the selected network to ONNX, quantize it to INT8, generate C inference code for an STM32H563ZI Arm Cortex-M33 MCU, and integrate it with our simplified sensor's firmware. This work is the first to demonstrate a compact DL SR model on a low-cost bare-metal MCU for a consumer-grade LR SPAD sensor, integrated with customized MCU firmware to enable on-device SR inference.
Source:https://arxiv.org/abs/2610.09098PreviousHybrid++: The Bridge between PDE Models and Deep Learning for Gamma Noise RemovalNextDiagnosing Diversity Collapse and Validating Mask-Conditioned Diffusion for Labeled Microtubule Microscopy
Related posts

How to find local businesses with bad websites (a field guide for freelance web designers)
0dev.to Design
Hardware Security Keys Explained: The Physical Devices Taking Over From 2FA Codes
0dev.to Security

Triple your Nintendo Switch 2's storage for just $99
0Tom's Hardware

Google data center wins approval in Minnesota after protests delay council vote twice — 200-acre project moves forward despite opposition from local residents, tech giant scales down project and drops
0Tom's Hardware
Our 'Best AI Coding Tool for Enterprise' Pick Got Acquired — and Stopped Selling
0dev.to Security

AI apps with hidden sexual and violent deepfake features made it into the App Store
09to5Mac