Helmholtz machine

From Wikipedia, the free encyclopedia

Helmholtz machines are neural networks used by Geoff Hinton which learn the hidden structure of a set of data by being trained to create a generative model which can produce the original set of data. The hope is that by learning economical representations of the data, the underlying structure of the generative model should reasonably approximate the hidden structure of the data set. This is an unsupervised learning algorithm.

The networks are characterized by bottom-up and top-down (reentrant) connections between layers of stochastic elements. The "Wake-Sleep" algorithm is an unsupervised learning rule which has been suggested as a means to train the Helmholtz machine.

Helmholtz machines may also be used in applications requiring a supervised learning algorithm (e.g. character recognition, or position-invariant recognition of an object within a field).