# Langevin dynamcs MCMC

Randomly exploring the posterior space.

## Continuous time

See log concave distributions for a family of distributions where this works especially well because implcit (more nearly continuous-time exact) solutions are available Hodgkinson, Salomone, and Roosta (2019).

Left-field, Max Raginsky, Sampling Using Diffusion Processes, from Langevin to Schrödinger:

the Langevin process gives only approximate samples from $$\mu$$. I would like to discuss an alternative approach that uses diffusion processes to obtain exact samples in finite time. This approach is based on ideas that appeared in two papers from the 1930s by Erwin Schrödinger in the context of physics, and is now referred to as the Schrödinger bridge problem.

## Annealed

TBC Jolicoeur-Martineau et al. (2022);Song and Ermon (2020a);Song and Ermon (2020b).

## Incoming

Holden Lee, Andrej Risteski introduce the connection between log-concavity and convex optimisation.

$x_{t+\eta} = x_t - \eta \nabla f(x_t) + \sqrt{2\eta}\xi_t,\quad \xi_t\sim N(0,I).$

## References

Brosse, Nicolas, Éric Moulines, and Alain Durmus. 2018. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, 8278–88. NIPS’18. Red Hook, NY, USA: Curran Associates Inc.
Dalalyan, Arnak S. 2017. arXiv:1704.04752 [Math, Stat], April.
Durmus, Alain, and Eric Moulines. 2016. arXiv:1605.01559 [Math, Stat], May.
Garbuno-Inigo, Alfredo, Franca Hoffmann, Wuchen Li, and Andrew M. Stuart. 2020. SIAM Journal on Applied Dynamical Systems 19 (1): 412–41.
Ge, Rong, Holden Lee, and Andrej Risteski. 2020. arXiv:1812.00793 [Cs, Math, Stat], September.
Girolami, Mark, and Ben Calderhead. 2011. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 73 (2): 123–214.
Grenander, Ulf, and Michael I. Miller. 1994. Journal of the Royal Statistical Society: Series B (Methodological) 56 (4): 549–81.
Hodgkinson, Liam, Robert Salomone, and Fred Roosta. 2019. arXiv:1903.12322 [Cs, Stat], March.
Jolicoeur-Martineau, Alexia, Rémi Piché-Taillefer, Ioannis Mitliagkas, and Remi Tachet des Combes. 2022. In.
Norton, Richard A., and Colin Fox. 2016. arXiv:1610.00781 [Math, Stat], October.
Parisi, G. 1981. Nuclear Physics B 180 (3): 378–84.
Rásonyi, Miklós, and Kinga Tikosi. 2022. Statistics & Probability Letters 182 (March): 109321.
Shang, Xiaocheng, Zhanxing Zhu, Benedict Leimkuhler, and Amos J Storkey. 2015. In Advances in Neural Information Processing Systems. Vol. 28. NIPS’15. Curran Associates, Inc.
Song, Yang, and Stefano Ermon. 2020a. In Advances In Neural Information Processing Systems. arXiv.
———. 2020b. In Advances In Neural Information Processing Systems. arXiv.
Welling, Max, and Yee Whye Teh. 2011. In Proceedings of the 28th International Conference on International Conference on Machine Learning, 681–88. ICML’11. Madison, WI, USA: Omnipress.
Xifara, T., C. Sherlock, S. Livingstone, S. Byrne, and M. Girolami. 2014. Statistics & Probability Letters 91 (Supplement C): 14–19.
Zhang, Jianyi, Ruiyi Zhang, Lawrence Carin, and Changyou Chen. 2020. In International Conference on Artificial Intelligence and Statistics, 1877–87. PMLR.

### No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.