Spatial processes and statistics thereof

July 29, 2011 — January 28, 2022

data sets
Hilbert space
Figure 1

Statistics on fields with index sets of more than one dimension of support and, frequently, an implicit 2-norm. Sometimes they are also time-indexed. Especially, for processes on a continuous index set with continuous state and undirected interaction. Sometimes over fancy manifolds, although often you can get away with plain old euclidean space, unless you are doing spatial statistics over the entire planet, which turns out to be curved. Lattice models are frequently considered spatial statistics, but more arbitrary graph structures usually get filed under undirected graphical models/random fields. For spatial point processes I will make a new notebook. Often we mean some kind of Gaussian process regression to handle spatial statistics, although the use of these tool in the ML and spatial literatures is weirdly disjoint. There are many other random fields we might also wish to infer that relate to spatial index sets, and these can be taxonomised as I notice their existence. There are lots of interesting problem with statistics on such fields. Consider the illustrative problem of declustering.

I’m curious about how spatial statistics generalise to high-dimensional fields such as fitness landscapes, loss functions, and embedding of network processes in space…

1 Kriging

Figure 2

The spatial statistics name for Gaussian process regression. Many complications arise in the spatial context as seen in, e.g. Bayesian inverse problems. Various cunning tricks are needed to make spatial GPs practical

A recent Fixed Rank Kriging paper summarised some approaches(Zammit-Mangion and Cressie 2021)

Fixed rank kriging (FRK) is a spatial/spatio-temporal modeling and prediction framework that is scaleable, works well with large datasets, and can deal easily with data that have different spatial supports. FRK hinges on the use of a spatial random effects (SRE) model, in which a spatially correlated mean-zero random process is decomposed using a linear combination of spatial basis functions with random coefficients plus a term that captures the random process’ fine-scale variation. Dimensionality reduction through a relatively small number of basis functions ensures computationally efficient prediction, while the reconstructed spatial process is, in general, non-stationary. The SRE model has a spatial covariance function that is always nonnegative-definite and, because any (possibly non-orthogonal) basis functions can be used, it can be constructed so as to approximate standard families of covariance functions (Kang and Cressie 2011). For a detailed treatment of FRK, see Cressie and Johannesson (2008);Cressie, Shi, and Kang (2010);Nychka et al. (2015).[…]

A few variants of FRK have been developed to date, and the one that comes closest to the present software is LatticeKrig (Nychka et al. 2015). LatticeKrig implements what we call a LatticeKrig (LTK) model, which is made up of Wendland basis functions (that have compact support) decompos- ing a spatially correlated process. LatticeKrig models use a Markov assumption to construct a precision matrix to describe the dependence between the coefficients of these basis functions. This, in turn, results in efficient computations and the potential use of a large number (> 10,000) of basis functions. LatticeKrig models do not cater for what we term fine-scale-process variation and, instead, the finest scale of the process is limited to the finest resolution of the basis functions used. The package INLA (Lindgren and Rue 2015) is a general-purpose package for model fitting and prediction. One advantage of INLA is that it contains functionality for fitting Gaussian processes that have covariance functions from the Matérn class (see Lindgren and Rue (2015), for details on the software interface) by approximating a stochastic partial differential equation (SPDE) using a Gaussian Markov random field (GMRF). Specifically, the process is decomposed using basis functions that are triangular ‘tent’ functions, and the coefficients of these basis functions are normally distributed with a sparse precision matrix. Thus, these models, which we term SPDE-GMRF models, share many of the features of LatticeKrig models. A key advantage of INLA over LatticeKrig is that once the spatial or spatio-temporal model is constructed, one has access to all the approximate-inference machinery and likelihood models available within the package.

Kang and Cressie (2011) develop Bayesian FRK; they keep the spatial basis functions fixed and put a prior distribution on K. The predictive-process approach of Banerjee et al. (2008) can also be seen as a type of Bayesian FRK, where the basis functions are constructed from the postulated covariance function of the spatial random effects and hence depend on parameters (see Katzfuss and Hammerling (2017), for an equivalence argument). An R package that implements predictive processes is spBayes (Finley, Banerjee, and Gelfand 2015; Finley, Banerjee, and Carlin 2007). It allows for multivariate spatial or spatio-temporal processes, and Bayesian inference is carried out using Markov chain Monte Carlo (MCMC), thus allowing for a variety of likelihood models.

Spatial processes are unlikely to be truly Gaussian; we often justify the approximation with a Gaussian process by Laplace approximation.

2 Spatial point processes

Figure 3

A particular sub-case combining point processes with spatial statistics, now with its own notebook

3 Tools

All recommendations made to me and passed on here are offered unreviewed and unendorsed.

3.1 R

Spatial statistics in R is diverse enough to need its own notebook. Check there.

3.2 Python

Spatial statistics in Python is diverse enough to need its own notebook. Check there.

3.3 QGIS

QGIS is a free and open-source cross-platform desktop geographic information system (GIS) application that supports viewing, editing, and analysis of geospatial data.[3]

Notably it support embedded python. It seems to be a GIS system, in that it places geography first and statistics second.

4 References

Abrahamsen. 1997. A Review of Gaussian Random Fields and Correlation Functions.”
Anselin. 1995. Local Indicators of Spatial Association - LISA.” Geographical Analysis.
Anselin, Cohen, Cook, et al. 2000. Spatial Analyses of Crime.”
Baddeley, Adrian, Rubak, and Turner. 2016. Spatial Point Patterns: Methodology and Applications with R. Champan & Hall/CRC Interdisciplinary Statistics Series.
Baddeley, A., Turner, Møller, et al. 2005. Residual Analysis for Spatial Point Processes (with Discussion).” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Banerjee, Gelfand, Finley, et al. 2008. Gaussian Predictive Process Models for Large Spatial Data Sets.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Besag. 1974. Spatial Interaction and the Statistical Analysis of Lattice Systems.” Journal of the Royal Statistical Society. Series B (Methodological).
———. 1986. On the Statistical Analysis of Dirty Pictures.” Journal of the Royal Statistical Society. Series B (Methodological).
Bolin. 2016. Models and Methods for Random Fields in Spatial Statistics with Computational Efficiency from Markov Properties.
Brémaud, Massoulié, and Ridolfi. 2005. Power Spectra of Random Spike Fields and Related Processes.” Advances in Applied Probability.
Cressie. 1990. The Origins of Kriging.” Mathematical Geology.
———. 2015. Statistics for Spatial Data.
Cressie, and Johannesson. 2008. Fixed Rank Kriging for Very Large Spatial Data Sets.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Cressie, Sainsbury-Dale, and Zammit-Mangion. 2022. Basis-Function Models in Spatial Statistics.” Annual Review of Statistics and Its Application.
Cressie, Shi, and Kang. 2010. Fixed Rank Filtering for Spatio-Temporal Data.” Journal of Computational and Graphical Statistics.
Cressie, and Wikle. 2011. Statistics for Spatio-Temporal Data. Wiley Series in Probability and Statistics 2.0.
Davison, and Ortiz. 2019. FutureMapping 2: Gaussian Belief Propagation for Spatial AI.” arXiv:1910.14139 [Cs].
Diggle, and Ribeiro. 2007. Model-Based Geostatistics. Springer Series in Statistics.
Donoho, and Johnstone. 1994. Ideal Spatial Adaptation by Wavelet Shrinkage.” Biometrika.
Finley, Banerjee, and Carlin. 2007. spBayes: An R Package for Univariate and Multivariate Hierarchical Point-Referenced Spatial Models.” Journal of Statistical Software.
Finley, Banerjee, and Gelfand. 2015. spBayes for Large Univariate and Multivariate Point-Referenced Spatio-Temporal Data Models.” Journal of Statistical Software.
Fuentes. 2006. Testing for Separability of Spatial–Temporal Covariance Functions.” Journal of Statistical Planning and Inference.
Haran. 2011. Gaussian Random Field Models for Spatial Data.” In Handbook of Markov Chain Monte Carlo.
Huang, and Ogata. 1999. Improvements of the Maximum Pseudo-Likelihood Estimators in Various Spatial Statistical Models.” Journal of Computational and Graphical Statistics.
Kang, and Cressie. 2011. Bayesian Inference for the Spatial Random Effects Model.” Journal of the American Statistical Association.
Kang, Liu, and Cressie. 2009. Statistical Analysis of Small-Area Data Based on Independence, Spatial, Non-Hierarchical, and Hierarchical Models.” Computational Statistics & Data Analysis.
Katzfuss, and Hammerling. 2017. Parallel Inference for Massive Distributed Spatial Data Using Low-Rank Models.” Statistics and Computing.
Lindgren, and Rue. 2015. Bayesian Spatial Modelling with R-INLA.” Journal of Statistical Software.
Liu, Ray, and Hooker. 2014. Functional Principal Components Analysis of Spatially Correlated Data.” arXiv:1411.4681 [Math, Stat].
Lovelace, Nowosad, and Münchow. 2019. Geocomputation with R.
Mackay. 1995. Probable Networks and Plausible Predictions — a Review of Practical Bayesian Methods for Supervised Neural Networks.” Network: Computation in Neural Systems.
Mardia, and Marshall. 1984. Maximum Likelihood Estimation of Models for Residual Covariance in Spatial Regression.” Biometrika.
Mohler. 2013. Modeling and Estimation of Multi-Source Clustering in Crime and Security Data.” The Annals of Applied Statistics.
Møller, and Torrisi. 2007. The Pair Correlation Function of Spatial Hawkes Processes.” Statistics & Probability Letters.
Nguyen, Cressie, and Braverman. 2012. Spatial Statistical Data Fusion for Remote Sensing Applications.” Journal of the American Statistical Association.
Nguyen, Katzfuss, Cressie, et al. 2014. Spatio-Temporal Data Fusion for Very Large Remote Sensing Datasets.” Technometrics.
Nowak, and Litvinenko. 2013. Kriging and Spatial Design Accelerated by Orders of Magnitude: Combining Low-Rank Covariance Approximations with FFT-Techniques.” Mathematical Geosciences.
Nychka, Bandyopadhyay, Hammerling, et al. 2015. A Multiresolution Gaussian Process Model for the Analysis of Large Spatial Datasets.” Journal of Computational and Graphical Statistics.
Patterson, Levin, Staver, et al. 2020. Probabilistic Foundations of Spatial Mean-Field Models in Ecology and Applications.” SIAM Journal on Applied Dynamical Systems.
Pewsey, and García-Portugués. 2020. Recent Advances in Directional Statistics.” arXiv:2005.06889 [Stat].
Pollard. 2004. “Hammersley-Clifford Theorem for Markov Random Fields.”
Possolo. 1986. Estimation of Binary Markov Random Fields.” Department of StatisticsPreprints, University of Washington, Seattle.
Rey, and Anselin. 2010. PySAL: A Python Library of Spatial Analytical Methods.” In Handbook of Applied Spatial Analysis.
Richardson, and Domingos. 2006. Markov Logic Networks.” Machine Learning.
Ripley, B. D. 1977. Modelling Spatial Patterns.” Journal of the Royal Statistical Society. Series B (Methodological).
———. 1981. Spatial Statistics.
Ripley, Brian D. 1988. Statistical inference for spatial processes.
Rosenberg, and Anderson. 2011. PASSaGE: Pattern Analysis, Spatial Statistics and Geographic Exegesis. Version 2: PASSaGE.” Methods in Ecology and Evolution.
Saichev, and Sornette. 2006. Power Law Distribution of Seismic Rates: Theory and Data.” The European Physical Journal B.
Saparin, Gowin, Kurths, et al. 1998. Quantification of Cancellous Bone Structure Using Symbolic Dynamics and Measures of Complexity.” Physical Review E.
Sidén. 2020. Scalable Bayesian Spatial Analysis with Gaussian Markov Random Fields. Linköping Studies in Statistics.
Stein, Michael L. 2005. Space-Time Covariance Functions.” Journal of the American Statistical Association.
Stein, Michael L. 2008. A Modeling Approach for Large Spatial Datasets.” Journal of the Korean Statistical Society.
Stein, Michael L., Chi, and Welty. 2004. Approximating Likelihoods for Large Spatial Data Sets.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Sun, and Stein. 2016. Statistically and Computationally Efficient Estimating Equations for Large Spatial Datasets.” Journal of Computational and Graphical Statistics.
Whittle. 1954. “On Stationary Processes in the Plane.” Biometrika.
Zammit-Mangion, and Cressie. 2021. FRK: An R Package for Spatial and Spatio-Temporal Prediction with Large Datasets.” Journal of Statistical Software.
Zammit-Mangion, Ng, Vu, et al. 2021. Deep Compositional Spatial Models.” Journal of the American Statistical Association.
Zammit-Mangion, and Rougier. 2019. Multi-Scale Process Modelling and Distributed Computation for Spatial Data.”