General
Coded Computing for Dynamic System via Cartesian Products
arXiv math.IT0 views
arXiv:2609.39373v3 Announce Type: replace Abstract: Coded distributed computing (CDC) mitigates the Shuffle communication bottleneck through coded multicast, but existing schemes with predetermined worker populations do not directly adapt to worker arrivals and disconnections. To address these dynamics, we propose a dynamic CDC scheme that preserves surviving workers' caches and Reduce assignments while exploiting the storage brought by arriving clusters. The model accommodates general MapReduce tasks under a placement that is partly fixed and partly new. The scheme uses Cartesian products of cluster-wise placement delivery arrays (PDAs) for file placement. A delivery-aware greedy algorithm reassigns abandoned Reduce functions, and a Communication Array allows workers with no Reduce function to serve as coded transmitters. For arbitrary feasible disconnections, the scheme's exact communication load is derived. A file-wise converse under one-shot communication and uncoded placement shows that, in the absence of disconnections, the scheme lies within a factor of two of the lower bound under these assumptions when new clusters arrive, and within a factor of four otherwise.
Source:https://arxiv.org/abs/2609.39373PreviousFourier Ratio and Restricted Isometry via Entropic DescentNextFully Parallelized BP Decoding for Quantum LDPC Codes Can Outperform BP-OSD
Related posts
Adventurer returns home to Hull after 28-year walk from South America
0Hacker News New
Vending machine has terms and conditions you must accept before using [video]
0Hacker News New
Tomorrow Corporation Tech Demo [video]
0Hacker News New
Does Social Status Run in Families?
0Hacker News New
Show HN: Svoxx – A multilingual freelance marketplace with social features
0Hacker News New
433MHz TUI scanner: using a FT232H connected to a CC1101
0Hacker News New