Derivative observations in Gaussian Process models of dynamic systems

Ercan Solak, Department of Electrical and Electronic Engineering, Strathclyde University, Glasgow, Scotland
Rod Murray-Smith, Department of Computing Science, University of Glasgow, Scotland
Bill E. Leithead, Hamilton Institute, National University of Ireland, Maynooth, Ireland
Doug Leith, Hamilton Institute, National University of Ireland, Maynooth, Ireland
Carl Edward Rasmussen, Gatsby Computational Neuroscience Unit, UCL

Gaussian processes provide an approach to nonparametric modelling which allows a straightforward combination of function and deriative observations in an empirical model.This is of particular importance in identification of nonlinear dynamic systems from experimental data. It allows us to combine derivative information,and associated uncertainty with normal function observations into the learning and inference process. This derivative information can be in the form of priors specified by an expert oridentified from perturbation data close to equilibrium. It allows a seamless fusion of multiple local linear models in a consistent manner, inferring consistent models and ensuring that integrability constraints are met. It improves dramatically the computational efficienc of Gaussian process models for dynamic system identification, by summarising large quantities of near-equilibrium data by a handful of linearisations, reducing the training set size -- traditionally problem for Gaussian process models.

Accepted by NIPS*02.

Available as ps.