Diversified Sampling for Batched Bayesian Optimization with Determinantal Point Processes
Elvis Nava, Mojm{'\i}r Mutn{'y}, Andreas Krause, Diversified Sampling for Batched Bayesian Optimization with Determinantal Point Processes.”, 2022. Proceedings of the 25th International Conference on Artificial Intelligence and Statistics (AISTATS)
Abstract: In this work we introduced DPP-BBO, a natural and easily applicable framework for enhancing batch diversity in BBO algorithms which works in more settings than previous diversification strategies: it is directly applicable to the continuous domain case, when due to approximation and non-standard models we are unable to compute hallucinations or confidence intervals (as in the Cox process example), or more generally when used in combination with any randomized BBO sampling scheme or arbitrary diversity kernel. Moreover, for DPP-TS we show improved theoretical guarantees and strong practical performance on simple regret.