Information Theory

Density Ratio Estimation for KL Divergence Minimization between Implicit Distributions featured image

Density Ratio Estimation for KL Divergence Minimization between Implicit Distributions

We show how to approximate the KL divergence (in fact, any f-divergence) between implicit distributions using density ratio estimation by probabilistic classification.

avatar
Louis Tiao