(Barber 2012):

Placeholder for my notes on probabilistic graphical models.
In general graphical models are a particular type of way of handling
multivariate data based on working out *what* is
conditionally independent of *what else*.

Thematically, this is scattered across graphical models in inference, learning graphs from data, learning causation from data plus graphs, quantum graphical models because it all looks a bit different with noncommutative probability.

See also diagramming graphical models.

## Directed graphs

Graphs of conditional, directed independence are a convenient formalism for many models. These are also called Bayes nets (not to be confused with Bayesian inference.)

## Undirected, a.k.a. Markov graphs

a.k.a Markov random fields, Markov random networks. (other types?)

## Factor graphs

A unifying formalism for the directed and undirected graphical models. I have not really used these. See factor graphs.

## Implementations

Pedagogically useful, although probably not industrial-grade, David Barber’s discrete graphical model code (Julia) can do queries over graphical models.

## References

*Bayesian Reasoning and Machine Learning*. Cambridge ; New York: Cambridge University Press. http://www.cs.ucl.ac.uk/staff/d.barber/brml/.

*Pattern Recognition and Machine Learning*. Information Science and Statistics. New York: Springer.

*AI Magazine*12 (4): 50.

*Journal of the Royal Statistical Society. Series B (Methodological)*41 (1): 1–31. http://people.csail.mit.edu/tdanford/discovering-causal-graphs-papers/dawid-79.pdf.

*The Annals of Statistics*8 (3): 598–617. https://doi.org/10.1214/aos/1176345011.

*Learning in Graphical Models*. Cambridge, Mass.: MIT Press.

*Probabilistic Graphical Models : Principles and Techniques*. Cambridge, MA: MIT Press.

*Graphical Models*. Clarendon Press.

*Machine Learning: A Probabilistic Perspective*. 1 edition. Adaptive Computation and Machine Learning Series. Cambridge, MA: MIT Press.

*Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference*. Rev. 2. print., 12. [Dr.]. The Morgan Kaufmann Series in Representation and Reasoning. San Francisco, Calif: Kaufmann.

*Causality: Models, Reasoning and Inference*. Cambridge University Press.

*Kybernetika*25 (7): 33–44. http://dml.cz/bitstream/handle/10338.dmlcz/125413/Kybernetika_25-1989-7_6.pdf.

*Electronic Journal of Statistics*14 (2): 2773–97. https://doi.org/10.1214/20-EJS1730.