Warning
Sorry, this note is under construction. Feel free to take a look at what I’ve got so far, and please come back later!
Info
Deep belief networks were one of the first deep learning successes, beating kernelized SVMs on the MNIST dataset and demonstrating that deep architectures can be successful too.
Deep belief networks are generative models structured as a layer of visible units and layers of latent variables. Connections go between neighboring layers; the deepest two are undirected, and the others and directed toward the visible layer, as shown below.
For