Stochastic differential equations

September 19, 2019 — June 22, 2021

Figure 1

By analogy with differential equations, which use vanilla calculus to define deterministic dynamics, we can define stochastic differential equations, which use stochastic calculus to define random dynamics.

SDEs are time-indexed, causal stochastic processes which notionally integrate an ordinary differential equation over some driving noise. SPDEs are to SDEs as PDEs are to ODEs.

Useful in state filters, optimal control, financial mathematics etc.

Usually we talk about differential equations, but the broader and I think more common class of ODEs is naturally defined through integral equations rather than differential equations, in the sense that the driving noise process is an integrator. When you differentiate the noise process, it leads, AFAICT to Malliavin calculus, or something? I am not sure about that theory.

Useful tools: infinitesimal generators, martingales, Dale Robert’s cheat sheet, Itô-Taylor expansions

Warning: beware the terminology problem that some references take SDEs to be synonymous with Itô processes, whose driving noise is Brownian. Some writers, when they really want to be clear that they are not assuming Brownian motion, but some SDEs driven by Lévy noise, use the term sparse stochastic processes.

1 Pathwise solutions

Figure 2

Random ODEs is the highly ambiguous phrasing of Bongers and Mooij (2018) when referring to a certain class of referring to smooth SDEs; better might be “noise-driven ODEs”. In practice this is useful for the kind of smooth systems I encounter often.

AFAICT we can consider these in the context of Wong-Zakai approximation in classical SDE context, wrt Stratonovich integrals. However, the cleanest introduction I have is in the context of rough paths so let’s look at it in that context instead. For a classical setting, see (Teye 2010; Wedig 1984).

2 Infinite dimensional

See SPDEs.

3 Incoming

4 References

Adler. 2010. The Geometry of Random Fields.
Adler, and Taylor. 2007. Random Fields and Geometry. Springer Monographs in Mathematics 115.
Allen, Allen, Arciniega, et al. 2008. Construction of Equivalent Stochastic Differential Equation Models.” Stochastic Analysis and Applications.
Applebaum, and Riedle. 2010. Cylindrical Levy Processes in Banach Spaces.” Proceedings of the London Mathematical Society.
Arfken, Weber, and Harris. 2013. Mathematical Methods for Physicists: A Comprehensive Guide.
Ariffin, and Rosli. 2017. Stochastic Taylor Expansion of Derivative-Free Method for Stochastic Differential Equations.” Malaysian Journal of Fundamental and Applied Sciences.
Arnold, and Kliemann. 1983. Qualitative Theory of Stochastic Systems.” In Probabilistic Analysis and Related Topics.
Bain, and Crisan. 2008. Fundamentals of Stochastic Filtering.
Baudoin. 2014. Diffusion Processes and Stochastic Calculus. EMS Textbooks in Mathematics.
Baudoin, and Vatamanelu. n.d. Stochastic Calculus.”
Bertoin, Yor, and others. 2001. On Subordinators, Self-Similar Markov Processes and Some Factorizations of the Exponential Variable.” Electron. Comm. Probab.
Bion-Nadal, and Talay. 2019. On a Wasserstein-Type Distance Between Solutions to Stochastic Differential Equations.” The Annals of Applied Probability.
Bongers, and Mooij. 2018. From Random Differential Equations to Structural Causal Models: The Stochastic Case.” arXiv:1803.08784 [Cs, Stat].
Bosq. 2002. Estimation of Mean and Covariance Operator of Autoregressive Processes in Banach Spaces.” Statistical Inference for Stochastic Processes.
Bruti-Liberati, and Platen. 2007. Strong Approximations of Stochastic Differential Equations with Jumps.” Journal of Computational and Applied Mathematics, Special issue on evolutionary problems,.
Coulaud, and Richard. 2018. A Consistent Framework for a Statistical Analysis of Surfaces Based on Generalized Stochastic Processes.”
Curtain, and Falb. 1971. Stochastic Differential Equations in Hilbert Space.” Journal of Differential Equations.
Davis, Guo, and Wu. 2009. Impulse Control of Multidimensional Jump Diffusions.” arXiv:0912.3297 [Math].
Eguchi, and Uehara. n.d. Schwartz-Type Model Selection for Ergodic Stochastic Differential Equation Models.” Scandinavian Journal of Statistics.
Goldys, and Peszat. 2021. On Linear Stochastic Flows.”
Hanson. 2007. Stochastic Processes and Control for Jump-Diffusions.” SSRN Scholarly Paper ID 1023497.
Hassler. 2016. Stochastic Processes and Calculus. Springer Texts in Business and Economics.
Hodgkinson, Roosta, and Mahoney. 2021. “Stochastic Continuous Normalizing Flows: Training SDEs as ODEs.” Uncertainty in Artificial Intelligence.
Holden, Øksendal, Ubøe, et al. 1996. Stochastic Partial Differential Equations.
Inchiosa, and Bulsara. 1996. Signal Detection Statistics of Stochastic Resonators.” Physical Review E.
Jacod, and Shiryaev. 1987. The General Theory of Stochastic Processes, Semimartingales and Stochastic Integrals.” In Limit Theorems for Stochastic Processes. Grundlehren Der Mathematischen Wissenschaften.
Kallenberg. 2002. Foundations of Modern Probability. Probability and Its Applications.
Karatzas, and Ruf. 2016. Pathwise Solvability of Stochastic Integral Equations with Generalized Drift and Non-Smooth Dispersion Functions.” Annales de l’Institut Henri Poincaré, Probabilités Et Statistiques.
Karczewska. 2007. Convolution Type Stochastic Volterra Equations.” arXiv:0712.4357 [Math].
Kelly. 2016. Rough Path Recursions and Diffusion Approximations.” The Annals of Applied Probability.
Kelly, and Melbourne. 2014a. Smooth Approximation of Stochastic Differential Equations.”
———. 2014b. Deterministic Homogenization for Fast-Slow Systems with Chaotic Noise.”
Klebaner. 1999. Introduction to Stochastic Calculus With Applications.
Kloeden, P. E., and Platen. 1991. Stratonovich and Ito Stochastic Taylor Expansions.” Mathematische Nachrichten.
Kloeden, Peter E., and Platen. 1992. Stochastic Taylor Expansions.” In Numerical Solution of Stochastic Differential Equations. Applications of Mathematics.
———. 2010. Numerical Solution of Stochastic Differential Equations.
Kloeden, P. E., Platen, and Wright. 1992. The Approximation of Multiple Stochastic Integrals.” Stochastic Analysis and Applications.
Korzeniowski. 1989. On Diffusions That Cannot Escape from a Convex Set.” Statistics & Probability Letters.
Kotelenez. 2007. Stochastic Ordinary and Stochastic Partial Differential Equations: Transition From Microscopic to Macroscopic Equations.
Kushner, and DiMasi. 1978. Approximations for Functionals and Optimal Control Problems on Jump Diffusion Processes.” Journal of Mathematical Analysis and Applications.
Lindgren, Rue, and Lindström. 2011. An Explicit Link Between Gaussian Fields and Gaussian Markov Random Fields: The Stochastic Partial Differential Equation Approach.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Liu, Yeo, and Lu. 2020. Statistical Modeling for Spatio-Temporal Data From Stochastic Convection-Diffusion Processes.” Journal of the American Statistical Association.
Loerincz, Gingl, and Kiss. 1996. A Stochastic Resonator Is Able to Greatly Improve Signal-to-Noise Ratio.” Physics Letters A.
Ma, Chen, and Fox. 2015. A Complete Recipe for Stochastic Gradient MCMC.” In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2. NIPS’15.
Mamporia. 2017. Stochastic Differential Equations in a Banach Space Driven by the Cylindrical Wiener Process.” Transactions of A. Razmadze Mathematical Institute.
Matheron. 1973. The Intrinsic Random Functions and Their Applications.” Advances in Applied Probability.
Meidan. 1980. On the Connection Between Ordinary and Generalized Stochastic Processes.” Journal of Mathematical Analysis and Applications.
Mikosch. 2004. Non-Life Insurance Mathematics: An Introduction With Stochastic Processes.
Mikosch, and Norvaiša. 2000. Stochastic Integral Equations Without Probability.” Bernoulli.
Miller, Glennie, and Seaton. 2020. Understanding the Stochastic Partial Differential Equation Approach to Smoothing.” Journal of Agricultural, Biological and Environmental Statistics.
Mohammed, and Scheutzow. 1997. Lyapunov Exponents of Linear Stochastic Functional-Differential Equations. II. Examples and Case Studies.” The Annals of Probability.
Øksendal. 1985. Stochastic Differential Equations: An Introduction With Applications.
Papanicolaou. 2019. Introduction to Stochastic Differential Equations (SDEs) for Finance.” arXiv:1504.05309 [Math, q-Fin].
Papapantoleon, and Siopacha. 2010. Strong Taylor Approximation of Stochastic Differential Equations and Application to the Lévy LIBOR Model.” arXiv:0906.5581 [Math, q-Fin].
Papaspiliopoulos, Pokern, Roberts, et al. 2012. Nonparametric Estimation of Diffusions: A Differential Equations Approach.” Biometrika.
Pavliotis. 2014. Stochastic Processes and Applications: Diffusion Processes, the Fokker-Planck and Langevin Equations. Texts in Applied Mathematics.
Privault. n.d. Notes on Stochastic Finance.
Protter. 2005. Stochastic Integration and Differential Equations.
Pugachev, and Sinit︠s︡yn. 2001. Stochastic systems: theory and applications.
Rackauckas. 2019. Neural Jump SDEs (Jump Diffusions) and Neural PDEs.” The Winnower.
Rackauckas, Ma, Dixit, et al. 2018. A Comparison of Automatic Differentiation and Continuous Sensitivity Analysis for Derivatives of Differential Equation Solutions.” arXiv:1812.01892 [Cs].
Rackauckas, Ma, Martensen, et al. 2020. Universal Differential Equations for Scientific Machine Learning.” arXiv.org.
Revuz, and Yor. 2004. Continuous Martingales and Brownian Motion.
Risken. 1996. The Fokker-Planck Equation: Methods of Solution and Applications. Springer Series in Synergetics, v. 18.
Rogers, and Williams. 1987. Diffusions, Markov Processes and Martingales 2.
Rogers, and Williams. 2000. Diffusions, Markov Processes, and Martingales. Cambridge Mathematical Library.
Rößler. 2004. Stochastic Taylor Expansions for the Expectation of Functionals of Diffusion Processes.” Stochastic Analysis and Applications.
Rubenstein, Bongers, Schölkopf, et al. 2018. From Deterministic ODEs to Dynamic Structural Causal Models.” In Uncertainty in Artificial Intelligence.
Särkkä, and Solin. 2019. Applied Stochastic Differential Equations. Institute of Mathematical Statistics Textbooks 10.
Schoutens. 2000. Stochastic Processes and Orthogonal Polynomials. Lecture Notes in Statistics.
Schoutens, Leuven, and Studer. 2001. Stochastic Taylor Expansions for Poisson Processes and Applications Towards Risk Management.”
Sigrist, Künsch, and Stahel. 2015. Stochastic Partial Differential Equation Based Modelling of Large Space-Time Data Sets.” Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Şimşekli, Sener, Deligiannidis, et al. 2020. Hausdorff Dimension, Stochastic Differential Equations, and Generalization in Neural Networks.” CoRR.
Solin. 2016. Stochastic Differential Equation Methods for Spatio-Temporal Gaussian Process Regression.”
Sussmann. 1978. On the Gap Between Deterministic and Stochastic Ordinary Differential Equations.” The Annals of Probability.
Szehr, Azzimonti, and Azzimonti. 2020. An Exact Kernel Framework for Spatio-Temporal Dynamics.” arXiv:2011.06848 [Math, Stat].
Tautu. 2014. Stochastic Spatial Processes.
Teye. 2010. “Stochastic Invariance via Wong-Zakai Theorem.”
Twardowska. 1996. “Wong-Zakai Approximations for Stochastic Differential Equations.” Acta Applicandae Mathematica.
van Kampen. 1976. Stochastic Differential Equations.” Physics Reports.
Wedig. 1984. A Critical Review of Methods in Stochastic Structural Dynamics.” Nuclear Engineering and Design.
Wolpert, and Brown. 2021. Markov Infinitely-Divisible Stationary Time-Reversible Integer-Valued Processes.” arXiv:2105.14591 [Math].
Xiu. 2010. Numerical Methods for Stochastic Computations: A Spectral Method Approach.
Yaglom. 1987. Correlation Theory of Stationary and Related Random Functions. Volume II: Supplementary Notes and References. Springer Series in Statistics.
Zozor, and Amblard. 2003. Stochastic Resonance in Locally Optimal Detectors.” IEEE Transactions on Signal Processing.