-divergence is a method for comparing the similarity between two distributions. Formally,

for certain convex functions that satisfy . If and are the same distribution, then .

The most common form for is

which gives us โœ‚๏ธ KL Divergence,