AI & ML
Neural Memory Orchestration
arXiv cs.DC0 views
arXiv:2611.23857v1 Announce Type: new Abstract: Modern HPC workloads increasingly stall on the memory hierarchy rather than on compute, and page faults from mmap'd files, swap, and tiered memory are a growing fraction of wall time. Heuristic prefetchers in the kernel handle stride-like and temporally clustered patterns well but degrade sharply on the irregular, data-dependent access streams typical of these workloads. Learned prefetchers have been shown to capture such patterns in simulation but have not been taken to a deployed pipeline running against live workloads on real hardware. We present Overseer, an end-to-end learned page-prefetching system. An eBPF collector observes page faults on the target host, a transformer predictor (OverNet) runs on network-attached inference hardware and emits future page addresses, and a kernel-resident enforcer materializes those pages into the target's address space before they are demanded. OverNet encodes fault sequences through per-instance ordinal ranks over deltas, which lets a single trained model serve any target process without retraining. On two page-fault-heavy workloads, Overseer reduces runtime by roughly 35% on Hilbert-curve traversal and by roughly an order of magnitude on dense matrix multiplication, with corresponding reductions in major-fault counts.
Source:https://arxiv.org/abs/2611.23857PreviousA Fast, Programmable GPU-to-CPU Invocation Layer for GPU-Initiated CommunicationNextLocality-Aware Scheduling for Stream Processing Applications in Serverless Environments
Related posts
蒸馏 Lora RHLF 都是什么意思
0dev.to Machine Learning

Teaching an offline plant doctor to spot rust
0dev.to Machine Learning
Is Your Model Good Enough? Precision vs Recall
0dev.to Machine Learning
How to Trim Audio for a Starlit Night Video — Free, in Your Browser
0dev.to Tutorial
How to Write Numbers in Words on Birth Certificates and Identity Documents
0dev.to Tutorial
How to get an engineering internship
0dev.to Career