🪭 F-Divergence

-divergence is a method for comparing the similarity between two distributions. Formally,

for certain convex functions that satisfy . If and are the same distribution, then .

The most common form for is

which gives us ✂️ KL Divergence,