Gaussian processes
August 6, 2016 — June 23, 2021
“Gaussian Processes” are stochastic processes/fields with jointly Gaussian distributions over all finite sets of observation locations. The most familiar of these to finance and physics people is the Gauss-Markov process, a.k.a. the Wiener process, but there are many others. These processes are convenient due to certain useful properties of the multivariate Gaussian distribution e.g. being uniquely specified by first and second moments, nice behaviour under various linear operations, kernel tricks…. Especially famous applications include Gaussian process regression and spatial statistics. Check out Ti’s Interactive visualization for some examples.
Gaussian processes are, specifically, probabilistic distributions over random functions
We typically work with a mean-zero process, in which case for every finite set
1 Simulation/generation
See GP simulation.
2 Derivatives and integrals
2.1 Integral of a Gaussian process
2.2 Derivative of a Gaussian process
TBD.
For now, see these blog posts:
- Spatial derivatives of Gaussian process models
- Derivatives and Gaussian Processes – CDT Data Science Blog
I am using results from Adler (2010), Adler and Taylor (2007). See also pathwise GPs for some useful results here.
3 Exceedance probabilities
(Adler 2010; Adler and Taylor 2007; Chung 2020; Taylor 2009)