Backend
Bounding Queue Waits for Fair Scheduling of Bursty HPC Workloads via Hierarchical Algorithms
arXiv cs.DC0 views
arXiv:2610.32027v1 Announce Type: new Abstract: HPC clusters are shared among many projects, each holding an allocation of node-hours, and ensuring fairness is becoming harder. Foundation models workflows and automated pipelines have made job submissions bursty and concentrated among a few heavy users, so occasional users absorb queueing delays created by frequent ones, with no indication of how long their jobs will wait. Existing schedulers either forget past usage, protect only the job at the head of the queue, or assume that running jobs can be preempted. We propose HyDRA, a Hybrid Deadline and Ranking-Aware scheduler that enforces fairness among users while bounding the queue wait of every job. HyDRA assigns each job a deadline on arrival based on its size, the priorities of its project and user, the current backlog, and how far its project and user are from their entitled share. It ranks waiting jobs by a priority score that grows with waiting time, serves jobs close to their deadlines first, and backfills a job only when no deadline, or fairness limit is violated. We evaluate HyDRA on workloads derived from a year of ALCF Polaris job traces, against conventional schedulers and variants inspired by PCS, Themis, and the PBS job-sort formula used at ALCF. HyDRA achieves $2\times$ the project-level Jain's fairness of the best baseline, starts 47\% of jobs by their deadlines compared with at most 36\% for the baselines even for largest workloads, and lowers the 95th-\%ile bounded slowdown by 4.2$\times$ relative to the next best baseline, at a moderate cost in utilization.
Source:https://arxiv.org/abs/2610.32027PreviousKVStream: Adaptive Parallel Storage Management for KV Caching in Large-Scale LLM ServingNextDemocratizing LLM Training with the Edge: Challenges, Systems, and the Road Ahead
Related posts

One rebuild, not twenty: what caching a live market dashboard taught me
0dev.to AI
Rate-Limit Error Handling for Structured Candidate Scoring and Moderation APIs
0dev.to AI
DevRel Didn't Die, Its Audience Changed
0dev.to AI
Google ships Gemini 4 Argon, previews Carbon for cyber work
0dev.to AI
Giving AI agents hands without handing over the keys: how we think about safety at TwinMCP
0dev.to AI
Building a Multi-Tenant EKS Platform for 12 Teams: RBAC, Network Policies, and Karpenter with Terraform
0dev.to AWS