AI & ML
LatentStore: An Efficient Latent-First Storage System for AI-Generated Images
arXiv cs.DB0 views
arXiv:2605.19385v3 Announce Type: replace-cross Abstract: The explosive growth of AI-generated images has created a sustainability challenge for storage infrastructure. Platforms like Midjourney and Adobe Firefly already host billions of generative images, yet conventional object stores persist them as blobs with full-resolution pixels, consuming huge amounts of storage capacity and bandwidth. Unlike natural photos, however, AI-generated images can be deterministically reconstructed from compact, model-native latent tensors, making persistent image storage fundamentally redundant. This paper presents LatentStore, a latent-first storage system for AI-generated images. LatentStore treats compressed latents as durable storage objects and uses on-demand GPU reconstruction on the read path to trade inexpensive compute for large persistent storage savings. Our design is guided by the first large-scale analysis of AI-generated image access we are aware of, based on a 35-month, 2-billion-request production trace from a major generative-content platform. Motivated by the trace analysis, LatentStore keeps frequently accessed images in decoded pixel format for fast hits, stores less-active objects as compressed latents to expand effective cache capacity, and continuously adjusts the splits between the image and latent cache to optimize user-perceived access latency. We build a LatentStore prototype and evaluate it with the production trace. LatentStore reduces persistent storage by 78.7% with competitive or even lower mean and tail latency over a pure image-based storage.
Source:https://arxiv.org/abs/2605.19385PreviousA Memory-Efficient Distributed Algorithm for Approximate Nearest Neighbour Search with Arbitrary DistancesNextStructure then Query: Enabling Precise Analytical Queries over Unstructured Documents
Related posts

Apple 'HomeView Ultra' With 9-Inch 360º Screen Detailed in New Report
0MacRumors

Apple Isn't Done With 2026: Here's What's Still Coming
0MacRumors

Mark Gurman: Apple Initially Aimed to Release iPhone Duo in November
0MacRumors

iOS 27.2.1 Coming Soon, iOS 27.3 Beta Likely Available Tomorrow
0MacRumors
Grokipedia offers lessons in how AI can help Wikipedia
0Hacker News New
Are Prediction Markets Missing the Voters Who Could Decide the 2026 Midterms?
0Hacker News New