Notebooks

## Stochastic Differential Equations

30 May 2014 06:47

Non-stochastic differential equations are models of dynamical systems where the state evolves continuously in time. If they are autonomous, then the state's future values depend only on the present state; if they are non-autonomous, it is allowed to depend on an exogeneous "driving" term as well. (This may not be the standard way of putting it, but I think it's both correct and more illuminating than the more analytical viewpoints, and anyway is the line taken by V. I. Arnol'd in his book on differential equations.) Stochastic differential equations (SDEs) are, conceptually, ones where the the exogeneous driving term is a stochatic process. --- While "differential equation", unmodified, covers both ordinary differential equations, containing only time derivatives, and partial differential equations, containing both time and space derivatives, "stochastic differential equation", unmodified, refers only to the ordinary case. Stochastic partial differential equations are just what you'd think.

The solution of an SDE is, itself, a stochastic process. Heuristically, the easiest way to think of how this works is via Euler's method for solving differential equations, which is itself about the simplest possible numerical approximation scheme for an ODE. (This line of thought was apparently introduced by Bernstein in the 1920s.) To solve dx/dt = f(x), with initial condition x(0) = y, Euler's method instructs us to pick a small increment of time h, and then say that x(t+h) = x(t) + hf(x), using straight-line interpolation between the points 0, h, 2h, 3h,... Under suitable conditions on vector field f, as h shrinks, the function we obtain in this way actually converges on the correct solution. To accomodate a stochastic term on the right-hand side, say dx/dt = f(x) + E(t), where E(t) is random noise, we approximate x(t+h) - x(t) by hf(x) + E(t+h) - E(t). Then, once again, we let the time-increment shrink to zero. Doing this with full generality requires a theory of the integrals of stochastic processes, which is made especially difficult by the fact that many of the stochastic forces one would most naturally want to use, such as white noise, are ones which don't fit very naturally into differential equations! The necessary theory of stochastic integrals was developed in the 1940s by M. Loeve, K. Ito, and R. Stratonovich (all building on earlier work by, among others, N. Wiener); the theory of SDEs more strictly by Ito and Stratonovich, in slightly different forms.

Most of what one encounters, in applications, as the theory of SDEs assumes that the driving noise is in fact white, i.e., Gaussian and uncorrelated over time. On the one hand, this is less of a restriction than it might seem, because many other natural sorts of noise process can be represented as stochastic integrals of white noise. On the other hand, the same mathematical structure can be used directly to define stochastic integrals and stochastic DEs driven by a far broader class of stochastic processes; on this topic Kallenberg is a very good introduction.

Recommended, more introductory:
• Geoffrey Grimmett and David Stirzaker, Probability and Random Processes [The last chapter of the 3rd edition has a good, if rather heuristic, first-glimpse look at SDEs. I can't recall if it appeared in earlier editions or not.]
• Josef Honerkamp, Stochastic Dynamical Systems
• Joel Keizer, Statistical Thermodynamics of Nonequilibrium Processes [Describes SDEs, in the Ito framework, from a heuristic viewpoint, motivated by, precisely, the need to model non-equilibrium thermodynamic processes; goes on to use them in many interesting physical applications.]
• Andrzej Lasota and Michael C. Mackey, Chaos, Fractals and Noise: Stochastic Aspects of Dynamics [The later chapters give a solid introduction to SDEs, starting from the Euler-Bernstein approach, but to my mind somewhat slighting the quite real advantages of the Ito calculus for more advanced problems]
• Robert S. Liptser, Lectures on Stochastic Processes [See especially lecture 10, on white noise, and lecture 12, on Ito integrals.]
• Bernt Oksendal, Stochastic Differential Equations [First-rate introductory textbook, loaded with examples and intuition-building.]
• David R. Brillinger, "The 2005 Neyman Lecture: Dynamic Indeterminism in Science", Statistical Science 23 (2008): 48--64, arxiv:0808.0620 [With discussions and response]
• David R. Brillinger, Brent S. Stewart, Charles L. Littnan, "Three months journeying of a Hawaiian monk seal", pp. 246--264 of Deborah Nolan and Terry Speed (eds.), Probability and Statistics: Essays in Honor of David A. Freedman (2008), arxiv:0805.3019 [A pretty application]
• I. I. Gikhman and A. V. Skorokhod, Introduction to the Theory of Random Processes [Excellent long chapter on stochastic integrals and SDEs; these authors went on to publish several more books on SDEs, but I confess I have not read them.]
• Olav Kallenberg, Foundations of Modern Probability [Builds up the theory of stochastic integrals and stochastic differential equations from scratch, ending with a very general framework which makes it clear just which parts of the original approach, tied to the Wiener process, were necessary and which were accidental. However, Kallenberg's book is intended as a comprehensive textbook on probability theory, from measure theory through large deviations. This means that it is both mathematically demanding, and that he takes a "spiral" approach, revisitng this topic, like many others, repeatedly through the text. There are, however, abundant cross-references.]
• Robert S. Liptser and Albert N. Shiryaev, Statistics of Random Processes [Vol. I gives a very detailed account of the classical, Wiener-process theory and its uses in optimal filtering; vol. II considers numerous applications in statistics and signal-processing, as well as some generalizations and extensions.]
• Michel Loeve, Probability Theory [Gives a very elegant account of Loeve's contributions to the theory of stochastic integrals]
• L. C. G. Rogers and D. Williams, Diffusions, Markov Processes, and Martingales [See especially Vol. II, Ito Calculus.]
• Lakhdar Aggoun and Robert Elliott, Measure Theory and Filtering: Introduction with Applications
• David Applebaum, Lévy Processes and Stochastic Calculus [Blurb]
• Yuri Bakhtin and Jonathan C. Mattingly, "Stationary Solutions of Stochastic Differential Equation with Memory and Stochastic Partial Differential Equations", math.PR/0509166
• Viorel Barbu, Philippe Blanchard, Giuseppe Da Prato, Michael Röckner, "Self-organized criticality via stochastic partial differential equations", arxiv:0811.2093
• Jose Bento, Morteza Ibrahimi and Andrea Montanari
• "Learning Networks of Stochastic Differential Equations", NIPS 23 (2010), arxiv:1011.0415
• "Information Theoretic Limits on Learning Stochastic Differential Equations", arxiv:1103.1689
• François Bolley, Ivan Gentil, Arnaud Guillin, "Convergence to equilibrium in Wasserstein distance for Fokker-Planck equations", Journal of Functional Analysis 263 (2012): 2430--2457, arxiv:1110.3606
• Nicolas Bouleau and Dominique Lépngle, Numerical Methods for Stochastic Process
• A. A. Budini and M.O. Caceres, "Functional characterization of generalized Langevin equations", cond-mat/0402311 [Abstract: "We present an exact functional formalism to deal with linear Langevin equations with arbitrary memory kernels and driven by any noise structure characterized through its characteristic functional..."]
• Carson C. Chow, Michael A. Buice, "Path Integral Methods for Stochastic Differential Equations", arxiv:1009.5966
• Emmanuelle Clément, Arturo Kohatsu-Higa, Damien Lamberton, "A duality approach for the weak approximation of stochastic differential equations", math.PR/0610178 = Annals of Applied Probability 16 (2006): 1124--1154 ["a new methodology to prove weak approximation results for general stochastic differential equations. Instead of using a partial differential equation approach as is usually done for diffusions, the approach considered here uses the properties of the linear equation satisfied by the error process"]
• Jacky Cresson and Sébastien Darses, "Stochastic embedding of dynamical systems", math.PR/0509713
• Daan Crommelin, "Estimation of Space-Dependent Diffusions and Potential Landscapes from Non-equilibrium Data", Journal of Statistical Physics 149 (2012): 220--233
• A. M. Davie, "Uniqueness of solutions of stochastic differential equations", arxiv:0709.4147
• Peter Friz and Nicolas B. Victoir, Multidimensional Stochastic Processes as Rough Paths: Theory and Applications
• Jorge Garcia, "A Large Deviation Principle for Stochastic Integrals", Journal of Theoretical Probability 21 (2008): 476--501
• Leszek Gawarecki and Vidyadhar Mandrekar, Stochastic Differential Equations in Infinite Dimensions, with Applications to Stochastic Partial Differential Equations
• Shota Gugushvili, Peter Spreij, "Parametric inference for stochastic differential equations: a smooth and match approach", arxiv:1111.1120
• Martin Hairer, "Exponential Mixing Properties of Stochastic PDEs Through Asymptotic Coupling," math.PR/0109115
• David Hochberg, Carmen Molina-Paris, Juan Pérez-Mercader and Matt Visser, "Effective Action for Stochastic Partial Differential Equations," cond-mat/9904215
• Helge Holden, Stochastic Partial Differential Equations: A Modeling, White Noise Functional Approach
• Yoshifusa Ito and Izumi Kubo, "Calculus on Gaussian and Poisson White Noises", Nagoya Mathematical Journal 111 (1988): 41--84 [Full text PDF]
• Gopinath Kallianpur and Jie Xiong, Stochastic Differential Equations in Infinite Dimensional Spaces [Now free online]
• Hye-Won Kang, Thomas G. Kurtz, Lea Popovic, "Central limit theorems and diffusion approximations for multiscale Markov chain models", arxiv:1208.3783
• Ioannis Kontoyiannis, Sean P. Meyn, "Approximating a Diffusion by a Hidden Markov Model", arxiv:0906.0259
• Peter Kotelenez, Stochastic Ordinary and Stochastic Partial Differential Equations: Transition from Microscopic to Macroscopic Equations [blurb]
• Peter M. Kotelenez and Thomas G. Kurtz, "Macroscopic limits for stochastic partial differential equations of McKean-Vlasov type", Probability Theory and Related Fields 146 (2010): 189--222
• H. Kunita, Stochastic Flows and Stochastic Differential Equations [blurb]
• S. V. Lototsky and B. L. Rozovskii
• "Wiener Chaos Solutions of Linear Stochastic Evolution Equations", math.PR/0504558
• "Stochastic Differential Equations: A Wiener Chaos Approach", math.PR/0504559
• Yutao Ma, Ran Wang, Liming Wu, "Moderate Deviation Principle for dynamical systems with small random perturbation", arxiv:1107.3432
• Jonathan C. Mattingly, Andrew M. Stuart, M.V. Tretyakov, "Convergence of Numerical Time-Averaging and Stationary Measures via Poisson Equations", arxiv:0908.4450
• Anatolii V. Mokshin, Renat M. Yulmetyev, and Peter Hänggi, "Simple Measure of Memory for Dynamical Processes Described by a Generalized Langevin Equation", Physical Review Letters 95 (2005): 200601
• Esteban Moro and Henri Schurz, "Non-negativity preserving numerical algorithms for stochastic differential equations", math.NA/0509724
• Jun Ohkubo, "Nonparametric model reconstruction for stochastic differential equations from discretely observed time-series data", Physical Review E 84 (2011): 066702
• Cyril Odasso, "Exponential mixing for stochastic PDEs: the non-additive case", Probability Theory and Related Fields 140 (2008): 41--82
• Fabien Panloup, "Recursive computation of the invariant measure of a stochastic differential equation driven by a L\'{e}vy process", math.PR/0509712
• S. Peszat and J. Zabczyk, Stochastic Partial Differential Equations with Lévy Noise: An evolution Equation approach [blurb]
• Philip Protter, Stochastic Integration and Differential Equations
• A. J. Roberts, "Normal form transforms separate slow and fast modes in stochastic dynamical systems", math.DS/0701623
• Arne Traulsen, Jens Christian Claussen, Christoph Hauert, "Stochastic differential equations for evolutionary dynamics with demographic noise and mutations", arxiv:1203.3367
• Ramon van Handel, "Almost Global Stochastic Stability", math.PR/0411311 ["We develop a method to prove almost global stability of stochastic differential equations in the sense that almost every intial point ... is asymptotically attracted to the origin with unit probability."]
• Wei Wang and Jinqiao Duan, "Invariant manifold reduction and bifurcation for stochastic partial differential equations", math.DS/0607050
• Wei Wang, A. J. Roberts and Jinqiao Duan, "Large deviations for slow-fast stochastic partial differential equations", arxiv:1001.4826 ["the rate function is exactly that of the averaged equation plus the fluctuating deviation which is a stochastic partial differential equation with small Gaussian perturbation"]

Notebooks:     Hosted, but not endorsed, by the Center for the Study of Complex Systems