Backend
A Runtime System for Mitigating Crossbar Port Contention on SM-Partitioned GPUs
arXiv cs.DC0 views
arXiv:2611.24458v1 Announce Type: new Abstract: To avoid scheduling delays when running concurrent workloads on a GPU, Streaming Multiprocessor (SM) partitioning mechanisms such as CUDA Green Contexts restrict each workload to separate SMs. Despite this partitioning, concurrent workloads still significantly slow down latency-critical workloads, which recent studies attribute to shared L2 cache and memory contention. However, contention also occurs at the crossbar ports connecting each Graphics Processing Cluster (GPC) of SMs to the L2 cache, as all SMs in a GPC share one port. Green Contexts spread workloads across GPCs, placing concurrent workloads in the same GPCs and forcing latency-critical memory requests to queue behind background requests. Packing workloads into separate GPCs avoids this contention, but forces latency-critical memory requests through fewer ports, limiting memory bandwidth. Consequently, neither spreading nor packing is always faster across workloads and GPUs. Based on these observations, we present GPCPlace, a runtime system that dynamically selects between spreading and packing by profiling workloads on the target GPU to estimate both slowdowns, and hooks kernel launches in the CUDA driver to set SM masks without application modifications. Across 14 GPUs and 112 workload cases, GPCPlace speeds up latency-critical workloads by up to 1.15x on average and 2.38x maximum over Green Contexts without degrading throughput.
Source:https://arxiv.org/abs/2611.24458PreviousScaleBench: An Extensible and Reproducible Experimental Platform for Kubernetes Autoscaling ResearchNextMine Locally, Verify Globally: Exact Recovery, Compilation, and Distortion of Mined Temporal Rules
Related posts
Where Was the Author of The Ugly Duckling Born? What 11 LLMs Taught Me About Connecting Facts
0dev.to Machine Learning

Airfoil noise: one model saw the test condition at other frequencies, one did not
0dev.to Machine Learning
Comment BlackRock et les géants de la gestion d'actifs intègrent-ils la blockchain ?
0dev.to Tutorial
How to Download Pinterest GIFs Without Losing the Animation
0dev.to Tutorial
I built a tool that finds the hiring team behind any job link
0dev.to Career
NGO Near Me: Education Support and Community Development in India
0dev.to Career