AI & ML
Investigating Composite Modeling in Multi-Objective Bayesian Optimization for Scientific Design
arXiv stat.ML0 views
arXiv:2611.13565v1 Announce Type: cross Abstract: Scientific design often requires balancing competing objectives that are expensive to evaluate through experiments or simulations. Multi-objective Bayesian optimization (MOBO) addresses this challenge by using probabilistic models to guide the selection of promising designs. In many applications, tunable inputs map to observable intermediate responses, which are then combined through known functions to compute the final objectives. Prior work on Bayesian optimization of composite functions shows that learning from these intermediate responses, which we call Composite modeling, can substantially improve sampling efficiency in single-objective optimization, compared to methods that condition only on black-box observations of the objective function. The benefits of Composite modeling in MOBO, however, remain understudied. In this work, we study the benefits of Composite modeling in MOBO and investigate the factors driving variation in its gains. We first establish single-objective conditions under which intermediate observations provide no additional predictive information beyond objective values, where composite and black box methods use the same warped Gaussian process prior. Controlled numerical experiments with versions of four MOBO methods across eight synthetic and application-inspired scientific-design benchmarks examine how these conditions relate to optimization gains in the multi-objective setting, where the black box approach models the objective functions with a standard multi-output Gaussian process. Both investigations support the claim that composite modeling tends to help more when the function mapping intermediate responses to final objectives is non-bijective and non-affine.
Source:https://arxiv.org/abs/2611.13565PreviousClosing the BF16-FP16 Convergence Speed Gap in RL Post-Training with Stochastic RoundingNextFirst-order asymptotic expansions for spectral convergence of normalized graph Laplacians constructed from samples on manifolds
Related posts

Increased AI usage is making younger workers more afraid of saying 'I don't know'
0TechRadar

Adobe wants to make laboriously switching apps a thing of the past — starting with a two-way partnership with Google
0TechRadar

OpenClaw is creating a new privileged access problem for security teams
0TechRadar

Adobe Firefly is becoming more of a hub for routine work — but does that mean you'll use Photoshop and Premiere less?
0TechRadar

LattePanda Mu Ultra review
0TechRadar

AI data center buildout triggers fiber optic cable shortage, squeezing Ukrainian drone operations
0Tom's Hardware