We evaluate the ability of the popular Field-of-Experts (FoE) to model structure in images. As a test case we focus on modeling synthetic and natural textures. We find that even for modeling single textures, the FoE provides insufficient flexibility to learn good generative models it does not perform any better than the much simpler Gaussian FoE. We propose an extended version of the FoE (allowing for bimodal
potentials) and demonstrate that this novel formulation, when trained with a better approximation of the likelihood gradient, gives rise to a more powerful generative model of specific visual structure that produces significantly better results for the texture task.
Joint work with Nicolas Heess, Geoff Hinton
BACK
