Figure 2.3: Some possible variational distributions. (a) A densely connected layered belief network. Observed input and output nodes are grey, while latent nodes are white. (b) Mean field theory assumes a fully factorised distribution over latent nodes. (c) In the mixed mean field approach there is an additional latent variable governing component selection shown in dark grey. (d) The Markov chain Q-distribution.