Spatial point process and their statistics

August 17, 2016 — December 4, 2019

spatial
statistics
statmech

The intersection of point processes and spatial processes. Popular in, e.g., earthquake modelling.

The references here are (Daley and Vere-Jones 2003, 2008; Møller and Waagepetersen 2003), especially the latter.

A non-exhaustive taxonomy of ones of interest to me FOLLOWS

1 Gibbs point processes

Processes where the points themselves notionally interact.

Processes with undirected interactions and no time index. Such processes without an arrow of time arise naturally, say, where you observe only snapshots of the dynamics, (where you captured those koalas that one time you got fieldwork funding) aggregates of the dynamics (as with classical statmech) or where whatever dynamics that gave rise to the process were too slow to be considered as anything but static on the time-scale you can model (locations of trees).

This is fiddly because with only undirected interactions, inference for these processes is painful, because you have to, “regress everything against everything else” Gibbs ensemble-style, which is slow and boring, which is the general problem with Markov random fields.

It is, however, an interesting introduction to statistical mechanics. In the Gibbs interaction process example (Daley and Vere-Jones 2003 Example 5.3c) they explain to probabilists what physicists mean by “grand canonical ensembles” in under two pages, which is something I have not seen a physicist do yet. (Daley and Vere-Jones 2008 Ch 15) gives an overarching view of the tools of this trade such as Papangelou intensities and pseudolikelihoods as does (Møller and Waagepetersen 2007) with some other connections to physics.

2 Determinantal point processes

Determinantal point processes are a tractable special case of Gibbs point processes. They have their own notebook.

3 Cox processes

A.k.a. doubly stochastic point processes. Processes where the latent Poisson intensity is not dependent upon interactions between the points but around some latent field which is itself stochastic.

Typically this is a latent gaussian field transformed by some link function into a positive Poisson intensity, generalized linear models-style. I am sure other models are possible but I have not seen them.

3.1 Log Gaussian point process

Cox process using the classic exponential link function.

4 Permanental point processes

Permanental point processes assume a squared gaussian latent intensity, supposedly?

5 Spatio-temporal point processes

Some of the problems with Gibbs point processes seem to me artificial. Everything we witness is the result of dynamics occurring in time, or we’d still be at the big bang. So any non-causal Markov random field we sample is presumably sampled from a causal process, which means that the interactions are directed over time. Indeed, e.g., Markov Chain Monte Carlo sampling makes it easier to sample from weird random fields by constructing a miniature physics with an artificial time arrow to sample from possible configurations of random processes. Intuitively this makes sense. Particles, at least in classical physics, don’t teleport themselves into a particular configuration with a probability inversely proportional to the exponential of some potential energy field; rather they have a particular trajectory that got them there. However, maybe the time-wise dynamics are even more complex and we wish to average over all possible such configurations or something. Welcome to statistical mechanics!

Anyway, practicalities.

6 Statistical theory

Adrian Baddeley’s course notes for spatial statistics using R are online.

6.1 Unconditional intensity estimation via pseudolikelihood

(van Lieshout 2011) discusses two major intensity estimators — KDEs and Delaunay tessellation-based local estimates. (Møller and Waagepetersen 2007) discuss intensity estimation questions generally. (Rathbun and Cressie 1994) gives inhomogeneous Poisson asymptotics.

From (Adrian Baddeley and Turner 2000):

Originally Besag (Besag 1977, 1975) defined the pseudolikelihood of a finite set of random variables \(X_1, \dots, X_n\) as the product of the conditional likelihoods of each \(X_i\) given the other variables \(\{X_j, j \neq i\}\). This was extended ([(Besag 1977, 1975); Besag et al., 1982) to point processes, for which it can be viewed as an infinite product of infinitesimal conditional probabilities.

6.2 Model estimation via GLM

Berman and Turner show how to use quadrature and generalised linear models to fit models without a form for the integrated influence kernel (which I don’t care about) using a linear model (which I do).

From the spatstat documentation:

Models are currently fitted by the method of maximum pseudolikelihood, using a computational device developed by Berman and Turner (Berman and Turner 1992) which we adapted to pseudolikelihoods in (Adrian Baddeley and Turner 2000). […] it has the virtue that we can implement it in software with great generality. […] Disadvantages of maximum pseudolikelihood (MPL) include its small-sample bias and inefficiency (Jensen and Møller 1991; Besag 1975; Jensen and Künsch 1994) relative to maximum likelihood estimators (MLE).

7 Implementations of methods

Hmm.

spatstat?

Presumably other spatial statistical software?

8 References

Anselin, Cohen, Cook, et al. 2000. Spatial Analyses of Crime.”
Baddeley, Adrian. 2007. Spatial Point Processes and Their Applications.” In Stochastic Geometry. Lecture Notes in Mathematics 1892.
Baddeley, Adrian, Gregori, Mateu, et al. 2006. Case Studies in Spatial Point Process Modeling.
Baddeley, Adrian, and Møller. 1989. Nearest-Neighbour Markov Point Processes and Random Sets.” International Statistical Review / Revue Internationale de Statistique.
Baddeley, Adrian, Møller, and Pakes. 2008. Properties of Residuals for Spatial Point Processes.” Annals of the Institute of Statistical Mathematics.
Baddeley, Adrian J, Møller, and Waagepetersen. 2000. Non- and Semi-Parametric Estimation of Interaction in Inhomogeneous Point Patterns.” Statistica Neerlandica.
Baddeley, Adrian, Rubak, and Turner. 2016. Spatial Point Patterns: Methodology and Applications with R. Champan & Hall/CRC Interdisciplinary Statistics Series.
Baddeley, Adrian, and Turner. 2000. Practical Maximum Pseudolikelihood for Spatial Point Patterns.” Australian & New Zealand Journal of Statistics.
———. 2006. Modelling Spatial Point Patterns in R.” In Case Studies in Spatial Point Process Modeling. Lecture Notes in Statistics 185.
Baddeley, A., Turner, Møller, et al. 2005. Residual Analysis for Spatial Point Processes (with Discussion).” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Baddeley, A. J., and Van Lieshout. 1995. Area-Interaction Point Processes.” Annals of the Institute of Statistical Mathematics.
Banerjee, Carlin, and Gelfand. 2014. Hierarchical Modeling and Analysis for Spatial Data.
Berman, and Diggle. 1989. Estimating Weighted Integrals of the Second-Order Intensity of a Spatial Point Process.” Journal of the Royal Statistical Society. Series B (Methodological).
Berman, and Turner. 1992. Approximating Point Process Likelihoods with GLIM.” Journal of the Royal Statistical Society. Series C (Applied Statistics).
Besag. 1975. Statistical Analysis of Non-Lattice Data.” Journal of the Royal Statistical Society. Series D (The Statistician).
———. 1977. Efficiency of Pseudolikelihood Estimation for Simple Gaussian Fields.” Biometrika.
Bordenave, and Torrisi. 2007. Large Deviations of Poisson Cluster Processes.” Stochastic Models.
Cronie, and van Lieshout. 2016. Bandwidth Selection for Kernel Estimators of the Spatial Intensity Function.” arXiv:1611.10221 [Stat].
Cucala. 2008. Intensity Estimation for Spatial Point Processes Observed with Noise.” Scandinavian Journal of Statistics.
Daley, and Vere-Jones. 2003. An introduction to the theory of point processes.
———. 2008. An Introduction to the Theory of Point Processes. Probability and Its Applications.
Gelfand, and Banerjee. 2010. Multivariate Spatial Process Models.” In Handbook of Spatial Statistics.
Geyer, and Møller. 1994. Simulation Procedures and Likelihood Inference for Spatial Point Processes.” Scandinavian Journal of Statistics.
Häggström, van Lieshout, and Møller. 1999. Characterization Results and Markov Chain Monte Carlo Algorithms Including Exact Simulation for Some Spatial Point Processes.” Bernoulli.
Huang, and Ogata. 1999. Improvements of the Maximum Pseudo-Likelihood Estimators in Various Spatial Statistical Models.” Journal of Computational and Graphical Statistics.
Jensen, and Künsch. 1994. On Asymptotic Normality of Pseudo Likelihood Estimates for Pairwise Interaction Processes.” Annals of the Institute of Statistical Mathematics.
Jensen, and Møller. 1991. Pseudolikelihood for Exponential Family Models of Spatial Point Processes.” The Annals of Applied Probability.
Kroese, and Botev. 2013. Spatial Process Generation.” arXiv:1308.0399 [Stat].
Lavancier, Møller, and Rubak. 2015. Determinantal Point Process Models and Statistical Inference.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Liu, and Vanhatalo. 2020. Bayesian Model Based Spatiotemporal Survey Designs and Partially Observed Log Gaussian Cox Process.” Spatial Statistics.
Marzen, and Crutchfield. 2020. Inference, Prediction, and Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes.” arXiv:2005.03750 [Cond-Mat, Physics:nlin, Stat].
McCullagh, and Møller. 2006. The Permanental Process.” Advances in Applied Probability.
Møller, and Berthelsen. 2012. Transforming Spatial Point Processes into Poisson Processes Using Random Superposition.” Advances in Applied Probability.
Møller, and Waagepetersen. 2003. Statistical Inference and Simulation for Spatial Point Processes.
———. 2007. Modern Statistics for Spatial Point Processes.” Scandinavian Journal of Statistics.
Møller, and Waagepetersen. 2017. Some Recent Developments in Statistics for Spatial Point Patterns.” Annual Review of Statistics and Its Application.
Rathbun. 1996. Asymptotic Properties of the Maximum Likelihood Estimator for Spatio-Temporal Point Processes.” Journal of Statistical Planning and Inference.
Rathbun, and Cressie. 1994. Asymptotic Properties of Estimators for the Parameters of Spatial Inhomogeneous Poisson Point Processes.” Advances in Applied Probability.
Ripley, and Kelly. 1977. Markov Point Processes.” Journal of the London Mathematical Society.
Schoenberg, Frederic. 1999. Transforming Spatial Point Processes into Poisson Processes.” Stochastic Processes and Their Applications.
Schoenberg, Frederic Paik. 2004. Testing Separability in Spatial-Temporal Marked Point Processes.” Biometrics.
———. 2005. Consistent Parametric Estimation of the Intensity of a Spatial–Temporal Point Process.” Journal of Statistical Planning and Inference.
Unser, and Tafti. 2014. An Introduction to Sparse Stochastic Processes.
van Lieshout. 2011. On Estimation of the Intensity Function of a Point Process.” Methodology and Computing in Applied Probability.