Bayes functional regression
December 3, 2019 — May 25, 2023
functional analysis
Gaussian
generative
Hilbert space
kernel tricks
nonparametric
regression
spatial
stochastic processes
time series
Junction for various Bayesian methods where the estimands are functions over some continuous argument space.
1 Gaussian process regression
2 On manifolds
I would like to read Terenin on GPs on Manifolds, who also makes a suggestive connection to SDEs, which is the filtering GPs trick again.
3 By variational inference
🏗
4 Neural processes
See neural processes.
5 Non-Gaussian
6 Generic nonparametrics
See Bayes nonparametrics.
7 References
Alexanderian. 2021. “Optimal Experimental Design for Infinite-Dimensional Bayesian Inverse Problems Governed by PDEs: A Review.” arXiv:2005.12998 [Math].
Bostan, Kamilov, Nilchian, et al. 2013. “Sparse Stochastic Processes and Discretization of Linear Inverse Problems.” IEEE Transactions on Image Processing.
Bui-Thanh, Ghattas, Martin, et al. 2013. “A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems Part I: The Linearized Case, with Application to Global Seismic Inversion.” SIAM Journal on Scientific Computing.
Dashti, Harris, and Stuart. 2011. “Besov Priors for Bayesian Inverse Problems.”
Dashti, and Stuart. 2015. “The Bayesian Approach To Inverse Problems.” arXiv:1302.6989 [Math].
Dubrule. 2018. “Kriging, Splines, Conditional Simulation, Bayesian Inversion and Ensemble Kalman Filtering.” In Handbook of Mathematical Geosciences: Fifty Years of IAMG.
Grigorievskiy, Lawrence, and Särkkä. 2017. “Parallelizable Sparse Inverse Formulation Gaussian Processes (SpInGP).” In arXiv:1610.08035 [Stat].
Jo, Son, Hwang, et al. 2020. “Deep Neural Network Approach to Forward-Inverse Problems.” Networks & Heterogeneous Media.
Knapik, van der Vaart, and van Zanten. 2011. “Bayesian Inverse Problems with Gaussian Priors.” The Annals of Statistics.
Knoblauch, Jewson, and Damoulas. 2019. “Generalized Variational Inference: Three Arguments for Deriving New Posteriors.”
Lasanen, and Roininen. 2005. “Statistical Inversion with Green’s Priors.” In Proceedings of the 5th International Conference on Inverse Problems in Engineering: Theory and Practice, Cambridge, UK.
Lassas, and Siltanen. 2004. “Can One Use Total Variation Prior for Edge-Preserving Bayesian Inversion?” Inverse Problems.
Lee, Ji, Li, et al. 2023. “Conditional Functional Graphical Models.” Journal of the American Statistical Association.
Liu, Yeo, and Lu. 2020. “Statistical Modeling for Spatio-Temporal Data From Stochastic Convection-Diffusion Processes.” Journal of the American Statistical Association.
Louizos, Shi, Schutte, et al. 2019. “The Functional Neural Process.” In Advances in Neural Information Processing Systems.
Magnani, Krämer, Eschenhagen, et al. 2022. “Approximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEs.”
Mosegaard, and Tarantola. 2002. “Probabilistic Approach to Inverse Problems.” In International Geophysics. International Handbook of Earthquake and Engineering Seismology, Part A.
Perdikaris, and Karniadakis. 2016. “Model inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond.” Journal of the Royal Society, Interface.
Petra, Martin, Stadler, et al. 2014. “A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems, Part II: Stochastic Newton MCMC with Application to Ice Sheet Flow Inverse Problems.” SIAM Journal on Scientific Computing.
Phillips, Seror, Hutchinson, et al. 2022. “Spectral Diffusion Processes.” In.
Pielok, Bischl, and Rügamer. 2023. “Approximate Bayesian Inference with Stein Functional Variational Gradient Descent.” In.
Pikkarainen. 2006. “State Estimation Approach to Nonstationary Inverse Problems: Discretization Error and Filtering Problem.” Inverse Problems.
Pinski, Simpson, Stuart, et al. 2015. “Kullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces.” SIAM Journal on Mathematical Analysis.
Rudner, Chen, Teh, et al. 2022. “Tractable Function-Space Variational Inference in Bayesian Neural Networks.” In.
Sigrist, Künsch, and Stahel. 2015. “Spate : An R Package for Spatio-Temporal Modeling with a Stochastic Advection-Diffusion Process.” Application/pdf. Journal of Statistical Software.
Singh, Yoon, Son, et al. 2019. “Sequential Neural Processes.” arXiv:1906.10264 [Cs, Stat].
Song, Shen, Xing, et al. 2022. “Solving Inverse Problems in Medical Imaging with Score-Based Generative Models.” In.
Song, Sohl-Dickstein, Kingma, et al. 2022. “Score-Based Generative Modeling Through Stochastic Differential Equations.” In.
Sun, Zhang, Shi, et al. 2019. “Functional Variational Bayesian Neural Networks.” In.
Tran, Rossi, Milios, et al. 2022. “All You Need Is a Good Functional Prior for Bayesian Deep Learning.” Journal of Machine Learning Research.
Unser, M. 2015. “Sampling and (Sparse) Stochastic Processes: A Tale of Splines and Innovation.” In 2015 International Conference on Sampling Theory and Applications (SampTA).
Unser, Michael A., and Tafti. 2014. An Introduction to Sparse Stochastic Processes.
Unser, M., Tafti, Amini, et al. 2014. “A Unified Formulation of Gaussian Vs Sparse Stochastic Processes - Part II: Discrete-Domain Theory.” IEEE Transactions on Information Theory.
Unser, M., Tafti, and Sun. 2014. “A Unified Formulation of Gaussian Vs Sparse Stochastic Processes—Part I: Continuous-Domain Theory.” IEEE Transactions on Information Theory.
Valentine, and Sambridge. 2020a. “Gaussian Process Models—I. A Framework for Probabilistic Continuous Inverse Theory.” Geophysical Journal International.
———. 2020b. “Gaussian Process Models—II. Lessons for Discrete Inversion.” Geophysical Journal International.
Wang, Ren, Zhu, et al. 2018. “Function Space Particle Optimization for Bayesian Neural Networks.” In.
Watson, Lin, Klink, et al. 2020. “Neural Linear Models with Functional Gaussian Process Priors.” In.
Yang, Meng, and Karniadakis. 2021. “B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data.” Journal of Computational Physics.
Yang, Zhang, and Karniadakis. 2020. “Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations.” SIAM Journal on Scientific Computing.
Zammit-Mangion, Bertolacci, Fisher, et al. 2021. “WOMBAT v1.0: A fully Bayesian global flux-inversion framework.” Geoscientific Model Development Discussions.
Zhang, Guo, and Karniadakis. 2020. “Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks.” SIAM Journal on Scientific Computing.