AI & ML
SUSpMV: A High Frequency Sparse Matrix Vector Multiplier on HBM Enabled FPGA written in SUS
arXiv cs.DC0 views
arXiv:2610.10403v1 Announce Type: cross Abstract: SUSpMV is a Sparse Matrix Vector multiplication (SpMV) accelerator written in the upcoming HDL SUS. By leveraging SUS's unique latency counting and inference mechanism, SUSpMV could be designed with very deep pipelines yet small design complexity overhead. This enables an efficient implementation which employs all 32 HBM channels on the Alveo U280 FPGA at 400MHz for streaming matrix data into 32 Compute Units (CUs). Input and output vectors are stored in DDR memory, which allows zero-overhead chaining of multiplications and increases overall system memory bandwidth by not sharing HBM bandwidth with the CUs. A CU processes the SpMV in tiles of width 1024 and a dynamically chosen height, up to 32768. Each CU is capable of accumulating the multiplications with up to 6 separate matrix entries per cycle, resulting in the combined theoretical peak computational throughput of 153.6 GFLOPs. The matrix storage format is designed to exploit density variation within a given matrix by dynamically switching between one representation optimized for denser regions, and a second optimized for sparser regions, allowing jumps of up to 255 rows between each entry. Evaluation demonstrates a 79% geometric mean improvement over prior work on the same platform. We achieve a peak throughput of 144.9 GFLOPs, or 94% of our theoretical computational throughput, compared to 98 GFLOPs reached by prior work.
Source:https://arxiv.org/abs/2610.10403PreviousThe Economic Security of Exponential EIP-1559NextVeriNC: Finding Design Risks of In-Network Computing Systems
Related posts
Traffic Dropped Overnight? A Diagnosis Checklist For Affiliate Sites After A Google Update
0dev.to Beginners
15 Best Free AI Tools in 2026 (Actually Free, Tested)
0dev.to Beginners
Building Raasta: Flooded-Road Detection with Satellite Images and PyTorch
0dev.to Beginners
5 Google Business Profile Quick Wins for Small Businesses (No Ads Needed)
0dev.to Beginners
How To Recover An Affiliate Site After A Google Spam Update
0dev.to Beginners
When a PDF Export Turns Every Page Into a Picture, Define the Text Contract First
0dev.to Testing