Open Source
Binarized Spectral Compressive Imaging
arXiv eess.IV0 views
arXiv:2305.10299v4 Announce Type: replace-cross Abstract: Existing deep learning models for hyperspectral image (HSI) reconstruction achieve good performance but require powerful hardwares with enormous memory and computational resources. Consequently, these methods can hardly be deployed on resource-limited mobile devices. In this paper, we propose a novel method, Binarized Spectral-Redistribution Network (BiSRNet), for efficient and practical HSI restoration from compressed measurement in snapshot compressive imaging (SCI) systems. Firstly, we redesign a compact and easy-to-deploy base model to be binarized. Then we present the basic unit, Binarized Spectral-Redistribution Convolution (BiSR-Conv). BiSR-Conv can adaptively redistribute the HSI representations before binarizing activation and uses a scalable hyperbolic tangent function to closer approximate the Sign function in backpropagation. Based on our BiSR-Conv, we customize four binarized convolutional modules to address the dimension mismatch and propagate full-precision information throughout the whole network. Finally, our BiSRNet is derived by using the proposed techniques to binarize the base model. Comprehensive quantitative and qualitative experiments manifest that our proposed BiSRNet outperforms state-of-the-art binarization methods and achieves comparable performance with full-precision algorithms. Code and models are publicly available at https://github.com/caiyuanhao1998/BiSCI and https://github.com/caiyuanhao1998/MST . An online Gradio demo is available on Hugging Face at https://huggingface.co/spaces/CaiYuanhao/MST
Source:https://arxiv.org/abs/2305.10299PreviousRadiative Gaussian Splatting for Efficient X-ray Novel View SynthesisNextLifting 3D Gaussians: A Wavelet Multiresolution Representation for Scalable Gaussian Splatting Streaming
Related posts
Receita Federal publica código da Calculadora de Tributos no GitHub
0dev.to GitHub
Lifting 3D Gaussians: A Wavelet Multiresolution Representation for Scalable Gaussian Splatting Streaming
0arXiv eess.IV
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
0arXiv eess.IV
GramStatTexNet: Efficient, Interpretable, and Neuro-Inspired Texture Analysis-by-Synthesis
0arXiv cs.GR
Webhook Rate-Limiting Queue Design for US/EU Delayed Jobs, Retry, and DLQ
0dev.to Go
Capability Internet: A Network Architecture for Autonomous Agents
0arXiv cs.NI