AI & ML
TensorDex: A Compact, Tensor-Centric Storage System for Modern AI Models
arXiv cs.DC0 views
arXiv:2604.17104v3 Announce Type: replace Abstract: Modern model hubs store hundreds of petabytes of large language models (LLMs), with fine-tuned variants dominating the storage footprint. These variants contain substantial cross-model redundancy that delta compression can exploit by storing only the difference between a target and a reference model. However, compression effectiveness depends critically on choosing a similar reference. At model-hub scale, this is challenging because model lineage metadata is often missing or unreliable, and different tensors within the same model may be most similar to tensors from different models. Consequently, model-level pairing leaves substantial redundancy unexploited. We present TensorDex, a lossless, tensor-centric storage system that performs delta compression at tensor granularity. TensorDex decomposes models into tensors, uses compact bit-level fingerprints to predict tensor-pair compressibility, and incrementally organizes tensors into multi-center clusters to select effective bases as new models arrive. Evaluated on 2,890 randomly sampled Hugging Face models, TensorDex reduces storage footprint by 70.5%, 37% lower than the state-of-the-art design. It achieves 22.9 GB/s compression and 28.4 GB/s decompression throughput, 3.86x and 1.49x faster than the next-best system, respectively.
Source:https://arxiv.org/abs/2604.17104PreviousWattlytics: A Web Platform for Co-Optimizing Performance, Energy, and TCO in HPC ClustersNextPrefixFlow: Training-Time KV Caching for Schedule-Level Prefix Reuse in LLM RL Training
Related posts
Lavoro su piattaforma e algoritmi: cosa cambia con la direttiva europea per chi progetta il software
0dev.to
LifeVal Benchmark Targets Everyday Personal Assistant Tasks Shaped by ChatGPT User Feedback
0dev.to
Oracle files to sell $20B in new stock, bonds to finance AI buildout
0Hacker News
7.9% to 48.1%: LLM rewrote Qwen weights, no training
0dev.to
Spousal Open Work Permits in Canada: Who Qualifies in 2026 and What to Prepare
0dev.to
Reading ingredient lists from phone photos: a crop bug, a model bench, and why the AI never gives the verdict
0dev.to