-divergence is a method for comparing the similarity between two distributions. Formally, for certain convex functions that satisfy . If and are the same distribution, then . The most common form for is which gives us โ๏ธ KL Divergence,