A Monte Carlo algorithm which updates a population of samples with a nested update. The easiest entry point is IMO to think about random-sample generalisation of state filter models via importance sampling. These are classically considered cousins to the linear Gaussian Kalman filter, applicable to more challenging models at the cost of using Monte Carlo approximations.

This has nothing to do with filters for particulate matter as seen in respirators.

There is too much confusing and unhelpful terminology here, and I am only at the fringe of this field so I will not attempt to typologize.
Let us clear up the main stumbling block though: somehow the theoretical basis field has coalesced under the banner of *interacting particle systems* which is an awful unsearchable name which could mean anything, and indeed does in other disciplines.
Wikipedia disambiguates this problem with the gritty and also abstruse Mean Field Particle Methods.
In practical applications we talk about *particle filters*, or *sequential Monte Carlo*, or *bootstrap filters*, or *iterated importance sampling* and these all mean confusingly similar things.

## Introductions

- Pierre Jacob’s Particle methods for statistics reading list
- The lineage and reasoning is well explained by Cappe, Godsill, and Moulines (2007).
- Chopin and Papaspiliopoulos (2020)

Easy to explain with an example such as this particle filter in scala.

## Feynman-Kac formulae

See Feynman-Kac.

## System Identification in

Do not know the parameters governing the system dynamics and need to learn those too? See System identification with particle fitlers.

## Particle flow

Introduced to me by my colleague Adrian Bishop Profile.

Bunch and Godsill (2014); Daum, Huang, and Noushin (2010); Daum and Huang (2010); Daum and Huang (2009); Daum and Huang (2008); Daum and Huang (2013)

## Non-Gaussian evolution

### Jump process

I am interested in jump-process SMC (to be defined). For those I should apparently consult Graham and Méléard (1997);Grünbaum (1971);Méléard (1996);Shiga and Tanaka (1985).

### On weird graphs

Christian Andersson Naesseth, Lindsten, and Schön (2014)

## Rao-Blackwellized particle filter

Particles which represent marginalised densities (Murphy 2012, 23.6).

## Tooling

Some MCMC toolkits incorporate SMC too.

- particles is a python library for teaching DIY particle filtering, to accompany the book Chopin and Papaspiliopoulos (2020).
- Johansen’s page, with C++ software
- Dirk Eddelbuettel’s lab created RCppSMC for R integration of the Johansen stuff. Documentation is not great — it only consists of black-box toy problems without any hint of how you would construct, e.g. a likelihood function, so I can’t evaluate how easy this would be to use, as opp plain C++.
- most probabilistic programming languages include a particle filter example.

## References

*Bernoulli*19 (4): 1122–49.

*Handbook of Econometrics*, edited by Robert F. Engle and Daniel L. McFadden, 4:2247–94. Elsevier.

*Journal of the Royal Statistical Society: Series B (Statistical Methodology)*72 (3): 269–342.

*IEEE Transactions on Signal Processing*50 (2): 174–88.

*The Annals of Applied Statistics*3 (1): 319–48.

*Proceedings of the IEEE*95 (5): 899–924.

*Statistics and Computing*22 (3): 795–808.

*The Annals of Applied Probability*26 (6): 3319–80.

*Econometric Theory*28 (01): 130–78.

*An Introduction to Sequential Monte Carlo*. Springer Series in Statistics. Springer International Publishing.

*arXiv:2102.07850 [Cs, Stat]*, June.

*Bernoulli*20 (4): 1879–929.

*Markov Processes and Related Fields*5 (3): 293–318.

*Signal and Data Processing of Small Targets 2008*, 6969:414–25. SPIE.

*Signal and Data Processing of Small Targets 2009*, 7445:315–23. SPIE.

*Signal and Data Processing of Small Targets 2010*, 7698:209–20. SPIE.

*Signal Processing, Sensor Fusion, and Target Recognition XXII*, 8745:226–38. SPIE.

*Signal Processing, Sensor Fusion, and Target Recognition XIX*, 7697:92–110. SPIE.

*Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications*. 2004 edition. Latheronwheel, Caithness: Springer.

*The Annals of Applied Probability*20 (2): 593–639.

*Journal of the Royal Statistical Society: Series B (Statistical Methodology)*68 (3): 411–36.

*Statistics and Computing*22 (5): 1009–20.

*On the Concentration Properties of Interacting Particle Processes*. Vol. 3. Now Publishers.

*Stochastic Hybrid Systems*, pp 277–323. Lecture Notes in Control and Information Science, Volume 337. Berlin, Heidelberg: Springer.

*Séminaire de Probabilités XXXIV*, 1–145. Lecture Notes in Mathematics 1729. Springer.

*Sequential Monte Carlo Methods in Practice*, edited by Arnaud Doucet, Nando de Freitas, and Neil Gordon, 3–14. Statistics for Engineering and Information Science. Springer New York.

*Sequential Monte Carlo Methods in Practice*. New York, NY: Springer New York.

*Statistics and Computing*10 (3): 197–208.

*arXiv:1304.5768 [Stat]*, April.

*Handbook of Nonlinear Filtering*, 12:656–704.

*Bayesian Analysis*11 (2): 325–52.

*Journal of Statistical Software*40 (8).

*Data Assimilation - The Ensemble Kalman Filter*. Berlin; Heidelberg: Springer.

*Annual Review of Statistics and Its Application*5 (1): 421–49.

*SIAM Journal on Applied Dynamical Systems*19 (1): 412–41.

*Mathematics of Control, Signals and Systems*13 (1): 63–93.

*The Annals of Probability*25 (1): 115–32.

*Archive for Rational Mechanics and Analysis*42 (5): 323–45.

*Advances in Neural Information Processing Systems 28*, edited by C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, 2629–37. Curran Associates, Inc.

*Review of Financial Studies*18 (1): 37–84.

*IEEE Transactions on Signal Processing*56 (4): 1337–48.

*The Annals of Statistics*39 (3): 1776–1802.

*Journal of Statistical Software*30 (6).

*Proceedings of the 6th International Workshop on Rare Event Simulation*, 256–67.

*arXiv:1805.11122 [Cs, Stat]*, May.

*Statistical Science*30 (3): 328–51.

*Journal of Statistical Physics*162 (5): 1244–66.

*The American Statistician*70 (4): 350–57.

*Computer Vision – ACCV 2007*, edited by Yasushi Yagi, Sing Bing Kang, In So Kweon, and Hongbin Zha, 555–64. Lecture Notes in Computer Science 4843. Springer Berlin Heidelberg.

*The Annals of Statistics*33 (5): 1983–2021.

*Bernoulli*19 (4): 1391–1403.

*Proceedings of The 25th International Conference on Artificial Intelligence and Statistics*, 875–95. PMLR.

*arXiv:1509.00394 [Stat]*, June.

*Discrete & Continuous Dynamical Systems - A*34 (4): 1533.

*Advances In Neural Information Processing Systems*.

*arXiv Preprint arXiv:1705.09279*.

*arXiv:0901.3725 [Physics]*, January.

*Journal of Econometrics*, Semiparametric methods in econometrics, 141 (1): 44–64.

*Probabilistic Models for Nonlinear Partial Differential Equations: Lectures Given at the 1st Session of the Centro Internazionale Matematico Estivo (C.I.M.E.) Held in Montecatini Terme, Italy, May 22–30, 1995*, edited by Carl Graham, Thomas G. Kurtz, Sylvie Méléard, Philip E. Protter, Mario Pulvirenti, Denis Talay, Denis Talay, and Luciano Tubaro, 1627:42–95. Lecture Notes in Mathematics. Berlin, Heidelberg: Springer.

*Machine learning: a probabilistic perspective*. 1 edition. Adaptive computation and machine learning series. Cambridge, MA: MIT Press.

*arXiv:1903.04797 [Cs, Stat]*, March.

*Advances in Neural Information Processing Systems*. Vol. 27. Curran Associates, Inc.

*Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004*, 2:1744–1748 Vol.2.

*Acta Numerica*28 (May): 635–711.

*arXiv:1408.4908 [Cs, Math, q-Bio, Stat]*, August.

*Biometrika*88 (3): 603–21.

*Journal of Time Series Analysis*4 (3): 185–207.

*Simulation and the Monte Carlo Method*. 3 edition. Wiley series in probability and statistics. Hoboken, New Jersey: Wiley.

*Fast Sequential Monte Carlo Methods for Counting and Optimization*. Wiley Series in Probability and Statistics. Hoboken, New Jersey: Wiley.

*Physical Review E*91 (5).

*Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete*69 (3): 439–59.

*Proceedings of the National Academy of Sciences*104 (6): 1760–65.

*Proceedings of the National Academy of Sciences*106 (39): 16889–89.

*IEEE Transactions on Automatic Control*66 (7): 3052–67.

*Statistics and Computing*, November, 1–18.

*arXiv:2007.02692 [q-Fin]*, July.

## No comments yet. Why not leave one?