Long Talk: BORE — Bayesian Optimization by Density-Ratio Estimation
The 38th International Conference on Machine Learning (ICML 2021), virtual.
Invited Talk: BORE — Bayesian Optimization by Density-Ratio Estimation
ELLIS AutoML Seminars (virtual).
A Primer on Pólya-gamma Random Variables - Part III: Local Variational Methods
We swap Gibbs sampling for mean-field variational inference in the Pólya-Gamma augmented model and watch the classical Jaakkola-Jordan bound on the logistic sigmoid fall out, EM …
BORE: Bayesian Optimization by Density-Ratio Estimation
We reformulate the computation of the acquisition function in Bayesian optimization (BO) as a probabilistic classification problem, providing advantages in scalability, …
A Primer on Pólya-gamma Random Variables - Part II: Bayesian Logistic Regression
We use one weird trick — Pólya-Gamma augmentation — to make exact inference in Bayesian logistic regression tractable.
A Primer on Pólya-gamma Random Variables - Part I: Basic Relationships
We collect the identities that make the Pólya-Gamma augmentation tick: the logistic sigmoid in terms of the hyperbolic cosine, the hyperbolic cosine as a Pólya-Gamma Laplace …
An Illustrated Guide to the Knowledge Gradient Acquisition Function
We give a short illustrated reference guide to the Knowledge Gradient acquisition function with an implementation from scratch in TensorFlow Probability.
Contributed Talk: BORE — Bayesian Optimization by Density-Ratio Estimation
NeurIPS 2020 4th Workshop on Meta-Learning (virtual).
Bayesian Optimization by Density Ratio Estimation