๐Ÿฟ Kernel Density Estimation

Machine Learning / Inference

Kernel density estimation constructs an estimate of a distribution given only samples . We essentially make a smoothed-out histogram of the samples using a kernel. Formally, our estimate

where is a bandwidth parameter that controls how smooth our estimate is. For our estimate to be a valid, the function chosen as our kernel must satisfy the following:

  1. Normalization: .
  2. Symmetry: .

Content by William Liang, written in Obsidian.
Thank you to all the educators who made these notes possible.