# Probabilistic graphical models over continuous index sets

Placeholder for my notes on probabilistic graphical models over a continuum, i.e. with possibly-uncountably many nodes in the graph; or put another way, where the random field has an uncountable index set (but some kind of structure — a metric space, say.)

There is much formalising to be done, which I do not propose to attempt right now. Here’s a concrete example. Consider Gaussian process whose covariance kerne $$K$$ is continuous and of bounded support. Let it be over index space $$\mathcal{T}:=\mathbb{R}^n$$ for the sake of argument. It implicitly defines an undirected graphical model where for any given observation index $$t_0\in\mathcal{T}$$, the value $$x_0$$ is influenced by the values of the field at $$\operatorname{supp}\{K(\cdot, t_0)\}$$; (or a really a continuum of different strengths of influence depending on the magnitude of the kernel).

Does this kind of factoring buy us anything? Does the standard finite dimensional distribution argument get us anywhere in this setting if we can introduce some conditional independence?

I suspect that is sufficiently general to cover this, but TBH I haven’t read it for long enough that I can’t remember. is probably an example of what I mean; they construct a continuous index directed graphical model for point process fields, based on limiting cases of a discrete field, which seems like the obvious method of attack.

tackle this by considering SDE influence via limits of discretizations of SDEs which is, now I think of it, an intuitive way to approach this problem.

## References

Bishop, Christopher M. 2006. Pattern Recognition and Machine Learning. Information Science and Statistics. New York: Springer.
Blom, Tineke, Stephan Bongers, and Joris M. Mooij. 2020. In Uncertainty in Artificial Intelligence, 585–94. PMLR.
Bongers, Stephan, and Joris M. Mooij. 2018. arXiv:1803.08784 [Cs, Stat], March.
Eichler, Michael, Rainer Dahlhaus, and Johannes Dueck. 2016. Journal of Time Series Analysis, January, n/a–.
Hansen, Niels, and Alexander Sokol. 2014. Electronic Journal of Probability 19.
Lauritzen, Steffen L. 1996. Graphical Models. Oxford Statistical Science Series. Clarendon Press.
Mogensen, Søren Wengel, Daniel Malinsky, and Niels Richard Hansen. 2018. In Uai2018, 17.
Rubenstein, Paul K., Stephan Bongers, Bernhard Schölkopf, and Joris M. Mooij. 2018. In Uncertainty in Artificial Intelligence.
Schulam, Peter, and Suchi Saria. 2017. In Proceedings of the 31st International Conference on Neural Information Processing Systems, 1696–706. NIPS’17. Red Hook, NY, USA: Curran Associates Inc.

### No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.