Learning Gaussian processes which map functions to functions

In which I discover how to learn operators via GPs. I suspect a lot of things break; What is a usable gaussian distribution over a mapping between functions?

It might be handy here to revisit the notation for Bayesian nonparametrics, since we don’t get the same kind of setup as when the distributions in question are finitely parameterised. TBC

Universal Kriging

Does universal kriging fit in this notebook? (Menafoglio, Secchi, and Rosa 2013) In this setting our observations are function-valued and we wish to spatially interpolate them. TBC. Keyword: Hilbert-Kriging. See Júlio Hoffimann’s Hilbert-Kriging lecture.

Hilbert-space valued GPs



Bakka, Haakon, Håvard Rue, Geir-Arne Fuglstad, Andrea Riebler, David Bolin, Janine Illian, Elias Krainski, Daniel Simpson, and Finn Lindgren. 2018. Spatial Modeling with R-INLA: A Review.” WIREs Computational Statistics 10 (6): e1443.
Bolin, David. 2016. Models and Methods for Random Fields in Spatial Statistics with Computational Efficiency from Markov Properties.
Brault, Romain, Florence d’Alché-Buc, and Markus Heinonen. 2016. Random Fourier Features for Operator-Valued Kernels.” In Proceedings of The 8th Asian Conference on Machine Learning, 110–25.
Brault, Romain, Néhémy Lim, and Florence d’Alché-Buc. n.d. Scaling up Vector Autoregressive Models With Operator-Valued Random Fourier Features.
Brouard, Céline, Marie Szafranski, and Florence D’Alché-Buc. 2016. “Input Output Kernel Regression: Supervised and Semi-Supervised Structured Output Prediction with Operator-Valued Kernels.” The Journal of Machine Learning Research 17 (1): 6105–52.
Davison, Andrew J., and Joseph Ortiz. 2019. FutureMapping 2: Gaussian Belief Propagation for Spatial AI.” arXiv:1910.14139 [Cs], October.
Dutordoir, Vincent, Alan Saul, Zoubin Ghahramani, and Fergus Simpson. 2022. Neural Diffusion Processes.” arXiv.
Gahungu, Paterne, Christopher W. Lanyon, Mauricio A. Álvarez, Engineer Bainomugisha, Michael Thomas Smith, and Richard David Wilkinson. 2022. Adjoint-Aided Inference of Gaussian Process Driven Differential Equations.” In.
Heinonen, Markus, and Florence d’Alché-Buc. 2014. Learning Nonparametric Differential Equations with Operator-Valued Kernels and Gradient Matching.” arXiv:1411.5172 [Cs, Stat], November.
Hennig, Philipp, Michael A. Osborne, and Mark Girolami. 2015. Probabilistic Numerics and Uncertainty in Computations.” Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 471 (2179): 20150142.
Hildeman, Anders, David Bolin, and Igor Rychlik. 2019. Joint Spatial Modeling of Significant Wave Height and Wave Period Using the SPDE Approach.” arXiv:1906.00286 [Stat], June.
Hu, Xiangping, and Ingelin Steinsland. 2016. Spatial Modeling with System of Stochastic Partial Differential Equations.” WIREs Computational Statistics 8 (2): 112–25.
Kadri, Hachem, Emmanuel Duflos, Philippe Preux, Stéphane Canu, Alain Rakotomamonjy, and Julien Audiffren. 2016. Operator-Valued Kernels for Learning from Functional Response Data.” The Journal of Machine Learning Research 17 (1): 613–66.
Kadri, Hachem, Alain Rakotomamonjy, Philippe Preux, and Francis Bach. 2012. Multiple Operator-Valued Kernel Learning.” Advances in Neural Information Processing Systems 25: 2429–37.
Lian, Heng. 2007. Nonlinear Functional Models for Functional Responses in Reproducing Kernel Hilbert Spaces.” Canadian Journal of Statistics 35 (4): 597–606.
Lim, Néhémy, Florence d’Alché-Buc, Cédric Auliac, and George Michailidis. 2015. Operator-Valued Kernel-Based Vector Autoregressive Models for Network Inference.” Machine Learning 99 (3): 489–513.
Long, Da, Zheng Wang, Aditi Krishnapriyan, Robert Kirby, Shandian Zhe, and Michael Mahoney. 2022. AutoIP: A United Framework to Integrate Physics into Gaussian Processes.” arXiv.
Menafoglio, Alessandra, Piercesare Secchi, and Matilde Dalla Rosa. 2013. A Universal Kriging Predictor for Spatially Dependent Functional Data of a Hilbert Space.” Electronic Journal of Statistics 7 (none): 2209–40.
Minh, Hà Quang. 2022. Finite Sample Approximations of Exact and Entropic Wasserstein Distances Between Covariance Operators and Gaussian Processes.” SIAM/ASA Journal on Uncertainty Quantification, February, 96–124.
Phillips, Angus, Thomas Seror, Michael John Hutchinson, Valentin De Bortoli, Arnaud Doucet, and Emile Mathieu. 2022. Spectral Diffusion Processes.” In.
Saha, Akash, and Palaniappan Balamurugan. 2020. Learning with Operator-Valued Kernels in Reproducing Kernel Krein Spaces.” In Advances in Neural Information Processing Systems. Vol. 33.
Zammit-Mangion, Andrew, and Noel Cressie. 2021. FRK: An R Package for Spatial and Spatio-Temporal Prediction with Large Datasets.” Journal of Statistical Software 98 (May): 1–48.
Zhang, Haizhang, Yuesheng Xu, and Qinghui Zhang. 2012. “Refinement of Operator-Valued Reproducing Kernels.” The Journal of Machine Learning Research 13 (1): 91–136.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.