โฐ Dynamic Bayesian Network

Machine Learning / PGM

Dynamic bayesian networks are a specific type of ๐Ÿšจ Bayesian Networks that captures the change of a distribution over time. We can do this by first discretizing time into individual time steps, then assert the following two assumptions:

  1. Markov: .
  2. Time-invariance: for all .

Intuitively, the former says that the future only depends on the present, not the past, and the latter says that no matter what time we're at, the future depends the same way on the present.

Then, to capture this distribution, we employ a ground bayes net for the initial distribution and a template transition model to represent how the distribution changes at each time step. These two models uniquely define our distribution over time.

This model structure is fairly broad, but a common specific variant is the โ˜‚๏ธ Hidden Markov Model, which uses multiple state transitions between each time step and separates latent (unobserved) and observable variables.

Content by William Liang, written in Obsidian.
Thank you to all the educators who made these notes possible.