Bayes functional regression

December 3, 2019 β€” May 25, 2023

Figure 1

Junction for various bayesian methods where the estimands are functions over some sintunuous argument space.

1 Gaussian process regression

See Gaussian process regression.

2 On manifolds

I would like to read Terenin on GPs on Manifolds who also makes a suggestive connection to SDEs, which is the filtering GPs trick again.

3 By variational inference


4 Neural processes

See neural processes.

5 Non-Gaussian

See Stochastic process regression.

6 Generic nonparametrics

See Bayes nonparametrics.

7 References

Alexanderian. 2021. β€œOptimal Experimental Design for Infinite-Dimensional Bayesian Inverse Problems Governed by PDEs: A Review.” arXiv:2005.12998 [Math].
Bostan, Kamilov, Nilchian, et al. 2013. β€œSparse Stochastic Processes and Discretization of Linear Inverse Problems.” IEEE Transactions on Image Processing.
Bui-Thanh, Ghattas, Martin, et al. 2013. β€œA Computational Framework for Infinite-Dimensional Bayesian Inverse Problems Part I: The Linearized Case, with Application to Global Seismic Inversion.” SIAM Journal on Scientific Computing.
Dashti, Harris, and Stuart. 2011. β€œBesov Priors for Bayesian Inverse Problems.”
Dashti, and Stuart. 2015. β€œThe Bayesian Approach To Inverse Problems.” arXiv:1302.6989 [Math].
Dubrule. 2018. β€œKriging, Splines, Conditional Simulation, Bayesian Inversion and Ensemble Kalman Filtering.” In Handbook of Mathematical Geosciences: Fifty Years of IAMG.
Grigorievskiy, Lawrence, and SΓ€rkkΓ€. 2017. β€œParallelizable Sparse Inverse Formulation Gaussian Processes (SpInGP).” In arXiv:1610.08035 [Stat].
Jo, Son, Hwang, et al. 2020. β€œDeep Neural Network Approach to Forward-Inverse Problems.” Networks & Heterogeneous Media.
Knapik, van der Vaart, and van Zanten. 2011. β€œBayesian Inverse Problems with Gaussian Priors.” The Annals of Statistics.
Lasanen, and Roininen. 2005. β€œStatistical Inversion with Green’s Priors.” In Proceedings of the 5th International Conference on Inverse Problems in Engineering: Theory and Practice, Cambridge, UK.
Lassas, and Siltanen. 2004. β€œCan One Use Total Variation Prior for Edge-Preserving Bayesian Inversion?” Inverse Problems.
Lee, Ji, Li, et al. 2023. β€œConditional Functional Graphical Models.” Journal of the American Statistical Association.
Liu, Yeo, and Lu. 2020. β€œStatistical Modeling for Spatio-Temporal Data From Stochastic Convection-Diffusion Processes.” Journal of the American Statistical Association.
Louizos, Shi, Schutte, et al. 2019. β€œThe Functional Neural Process.” In Advances in Neural Information Processing Systems.
Magnani, KrΓ€mer, Eschenhagen, et al. 2022. β€œApproximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEs.”
Mosegaard, and Tarantola. 2002. β€œProbabilistic Approach to Inverse Problems.” In International Geophysics.
Perdikaris, and Karniadakis. 2016. β€œModel inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond.” Journal of the Royal Society, Interface.
Petra, Martin, Stadler, et al. 2014. β€œA Computational Framework for Infinite-Dimensional Bayesian Inverse Problems, Part II: Stochastic Newton MCMC with Application to Ice Sheet Flow Inverse Problems.” SIAM Journal on Scientific Computing.
Phillips, Seror, Hutchinson, et al. 2022. β€œSpectral Diffusion Processes.” In.
Pielok, Bischl, and RΓΌgamer. 2023. β€œApproximate Bayesian Inference with Stein Functional Variational Gradient Descent.” In.
Pikkarainen. 2006. β€œState Estimation Approach to Nonstationary Inverse Problems: Discretization Error and Filtering Problem.” Inverse Problems.
Pinski, Simpson, Stuart, et al. 2015. β€œKullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces.” SIAM Journal on Mathematical Analysis.
Sigrist, KΓΌnsch, and Stahel. 2015. β€œSpate : An R Package for Spatio-Temporal Modeling with a Stochastic Advection-Diffusion Process.” Application/pdf. Journal of Statistical Software.
Singh, Yoon, Son, et al. 2019. β€œSequential Neural Processes.” arXiv:1906.10264 [Cs, Stat].
Song, Shen, Xing, et al. 2022. β€œSolving Inverse Problems in Medical Imaging with Score-Based Generative Models.” In.
Song, Sohl-Dickstein, Kingma, et al. 2022. β€œScore-Based Generative Modeling Through Stochastic Differential Equations.” In.
Sun, Zhang, Shi, et al. 2019. β€œFunctional Variational Bayesian Neural Networks.” In.
Tran, Rossi, Milios, et al. 2022. β€œAll You Need Is a Good Functional Prior for Bayesian Deep Learning.” Journal of Machine Learning Research.
Unser, M. 2015. β€œSampling and (Sparse) Stochastic Processes: A Tale of Splines and Innovation.” In 2015 International Conference on Sampling Theory and Applications (SampTA).
Unser, Michael A., and Tafti. 2014. An Introduction to Sparse Stochastic Processes.
Unser, M., Tafti, Amini, et al. 2014. β€œA Unified Formulation of Gaussian Vs Sparse Stochastic Processes - Part II: Discrete-Domain Theory.” IEEE Transactions on Information Theory.
Unser, M., Tafti, and Sun. 2014. β€œA Unified Formulation of Gaussian Vs Sparse Stochastic Processesβ€”Part I: Continuous-Domain Theory.” IEEE Transactions on Information Theory.
Valentine, and Sambridge. 2020a. β€œGaussian Process Modelsβ€”I. A Framework for Probabilistic Continuous Inverse Theory.” Geophysical Journal International.
β€”β€”β€”. 2020b. β€œGaussian Process Modelsβ€”II. Lessons for Discrete Inversion.” Geophysical Journal International.
Wang, Ren, Zhu, et al. 2018. β€œFunction Space Particle Optimization for Bayesian Neural Networks.” In.
Watson, Lin, Klink, et al. 2020. β€œNeural Linear Models with Functional Gaussian Process Priors.” In.
Yang, Meng, and Karniadakis. 2021. β€œB-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data.” Journal of Computational Physics.
Yang, Zhang, and Karniadakis. 2020. β€œPhysics-Informed Generative Adversarial Networks for Stochastic Differential Equations.” SIAM Journal on Scientific Computing.
Zammit-Mangion, Bertolacci, Fisher, et al. 2021. β€œWOMBAT v1.0: A fully Bayesian global flux-inversion framework.” Geoscientific Model Development Discussions.
Zhang, Guo, and Karniadakis. 2020. β€œLearning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks.” SIAM Journal on Scientific Computing.