AI & ML
Data-Efficient Scaling-Law Discovery for Recommendation Systems via Coupled Hyperparameter Scaling
arXiv cs.IR0 views
arXiv:2611.05643v1 Announce Type: cross Abstract: Large-scale ranking and recommendation models of Web platforms benefit from increased compute much as large language models do, and their scaling behavior is broadly power-law in form. Yet ranking models have heterogeneous architectures which makes their scaling law less straightforward than that of LLMs. We address how to discover the scaling law of an arbitrary ranking model efficiently. We introduce a scaling layer, which groups primitive architecture parameters into semantically coherent groups and defines how they co-vary, inducing a mapping from a low-dimensional space of hyper-hyperparameters into the full architecture space. On top of it, Axia fits scaling-informed surrogates, selects configurations by a posterior-based acquisition criterion, and returns a Pareto frontier from which per-model operating points are validated -- replacing exhaustive sweeps with a small number of informative runs. A fleet-level evaluation protocol, computed on a fixed representative model set under matched trial budgets, makes refinements to either component measurable. Our contribution is an automated system that learns model-specific complexity-quality relationships and gives uncertainty-aware guidance for allocating compute across a heterogeneous model ecosystem. Across 34 model iterations in two development cycles on Meta's ads ranking and retrieval system, the workflow yielded a mean 0.66% offline normalized-entropy improvement and 0.36% cumulative online lift.
Source:https://arxiv.org/abs/2611.05643PreviousRAGCompass: Generalizable Retriever Routing via RerankingNextCombining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps
Related posts
RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer
0arXiv cs.RO
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
0arXiv cs.RO
Future Representation Distillation for Imagination-free World Action Models
0arXiv cs.RO
When Robots Outweigh Objects: How Inertia Mismatch Shapes Robot Policy Learning
0arXiv cs.RO
Learning to Live: A Step Toward Lifelong Embodied Intelligence
0arXiv cs.RO
Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection
0arXiv cs.RO