AI & ML
Prediction with Foundation Models under Deployment Budgets
arXiv stat.ML0 views
arXiv:2611.12466v2 Announce Type: replace Abstract: Foundation models can supply predictions for a downstream task that draw on knowledge from extensive pretraining, but they differ in task-specific accuracy and query cost. We develop a framework that improves prediction for the task under a budget on the average query cost per input, using training data to learn which models to query and how to combine their outputs with features available without querying. The first method queries the same models for every input; the second lets them vary across inputs and uses Q-learning to decide which model to query next and when to stop. For the first method, we show that several individually inaccurate outputs can jointly outperform the best single one. It attains the minimax rate when the regression function depends on the outputs only through models within the budget. Otherwise, any method within the budget can be forced to a slower rate, which the first method attains. For the second method, we show when varying the queried models across inputs strictly improves on querying the same models for every input, and bound its prediction risk and average cost in finite samples. In simulations and a multimodal laptop price application, both methods outperform existing methods.
Source:https://arxiv.org/abs/2611.12466PreviousAgnostic Smoothed Online Regression with Adversarial ResponsesNextActive Learning For Contextual Linear Optimization: A Margin-Based Approach
Related posts
One red light, four stalls
0dev.to
Testing Political Alignment in Chinese AI Models: What Developers Need to Know
0dev.to
LLM Inference Optimization Interview Questions and Answers
0dev.to
How to Close a Deal That Keeps Stalling: A Mutual Action Plan Template and Closing Techniques for Founder-Led Sales
0dev.to

Roast My Dev Desktop: Zero Minimalism, Maximum Chaos
0dev.to
랩트 모네로 붕괴: 익숙한 신뢰 배신 이야기
0dev.to