AI & ML
Fast and Actionable Classification of HPC I/O Time Series
arXiv cs.DC0 views
arXiv:2611.09646v1 Announce Type: new Abstract: Input/output (I/O) is a major bottleneck for highperformance computing (HPC) performance. One of the challenges is the contention between jobs when sharing the parallel file system. However, tackling this issue depends on knowing the temporal behavior of jobs. In this paper, we propose a clusteringbased approach to characterize jobs' temporal I/O behavior. We propose SAGE, a lightweight method that cuts I/O traces into short windows and learns an alphabet from them. The trace then becomes a sequence of symbols, which we call ''genome'', and we use clustering to separate them into classes. We evaluate SAGE and its two-stage variant SAGE-2 on 819,771 real traces from 2 HPC systems. We compare them against other techniques from the state of the art on three metrics, including one we propose. Compared to K-shape, the best baseline available, SAGE-2 lowers the median intra-cluster metrics by 9.1% on average, and achieves this in 2 minutes of clustering time versus 3.8 hours, a 109x speedup. More importantly, clusters created by SAGE and SAGE-2 carry enough information to act on: we evaluate the use of the cluster centroids for I/O scheduling, and show that our approach can decrease I/O stretch by up to 24% compared to the state of the art (round-robin placement).
Source:https://arxiv.org/abs/2611.09646PreviousTowards Sustainable Federated Learning via Carbon-Aware Client SelectionNextConcurrent Use of FP32 and FP64 Computing Units on GPUs and Mixed-Precision Placement in WENO Reconstruction
Related posts
W-2 vs 1099 Calculator: A Worked Offer Comparison for 2026
0dev.to

I tested ChatGPT's PDF Content Credentials: what survives a re-save, a print and an edit
0dev.to
I Built ResearchLens AI to Make Data Exploration and ML Benchmarking Easier
0dev.to
Fold Epic Paper Airplanes
0Hacker News
The Midterms Were a Pretty Good Sign for the Right-to-Repair Movement
0Wired
New Hulu Doc ‘Get Huge’ Shows the Deadly Toll of Looksmaxxing
0Wired