Classical dynamical systems are usually written as deterministic differential equations, ; once the initial condition is given, the future trajectory is, in principle, uniquely determined. But real systems are often subject to continuous, unpredictable random perturbations, and putting such a perturbation directly into a continuous-time dynamical system gives a stochastic differential equation (SDE).
1. From ODE to SDE
1.1 From deterministic ODEs to stochastic dynamical systems
The simplest idea is: the change over the next small interval = a deterministic trend + a random perturbation. In continuous time this is usually written , where is called the drift, controls the strength of the diffusion, and is Brownian motion.
1.2 Drift and diffusion
represents the system’s average direction of evolution in the absence of random noise: in , means the process drifts upward overall, and means it drifts downward. represents the random perturbation; because the scale of a Brownian increment is , an entirely different order of magnitude from an ordinary differential , cannot simply be treated as a “small change” in the ordinary derivative sense.
2. Itô Calculus
2.1 Why ordinary calculus isn’t enough
Brownian motion is almost nowhere differentiable, so cannot be treated as an ordinary function, which is why a new integration theory had to be developed — the most classic being the Itô integral and the Stratonovich integral — giving rise to stochastic calculus.
2.2 Itô’s formula
The chain rule of ordinary calculus is , but in Itô calculus, because leaves behind a contribution of order , an extra second-order term appears: the typical one-dimensional form of Itô’s formula is . This extra term may look like a mere correction, but it is the most central difference between stochastic calculus and ordinary calculus — Section 3.2 uses it directly to derive the analytic solution of an important model.
3. Two Classic Models, Worked Out
3.1 The Ornstein–Uhlenbeck process: mean reversion in concrete numbers
The classic SDE (with ) describes mean reversion: when , the drift pulls it downward, and when , it pushes it upward. This equation has an analytic solution: and , and as the variance approaches the stationary value . Taking , , , , the expected value after one year () is — already pulled noticeably from the initial 10 toward the mean of 5; the variance is , very close to the long-run stationary variance . The OU process is widely used for velocity models in physics, financial interest rates, and various noise processes that need to be “pulled back after deviating from the mean.”
3.2 Geometric Brownian motion: deriving the analytic solution with Itô’s formula
The classic financial-mathematics model is called geometric Brownian motion (GBM): the size of the random perturbation is proportional to the current value , making it suitable for describing positive, multiplicative random growth, and it is the foundation of the Black–Scholes model. Applying Itô’s formula to : with and , substituting gives — this extra term is exactly the direct consequence of the second-order correction term from Section 2.2; applying the ordinary chain rule directly would miss it. Integrating gives the analytic solution , so . Taking , , , : the median of is , but the expected value is — the median and the expected value are not equal, a direct consequence of the lognormal distribution’s right skew. In practice the two are often conflated: mistaking the “typical scenario” (the median) for the “average return” (the expectation) systematically underestimates the long-run average growth rate.
4. Distributional Evolution and Conceptual Connections
4.1 The Fokker–Planck equation
An SDE describes how a sample path moves randomly; the same random system can also be described from the perspective of “how does the probability density evolve,” which gives the Fokker–Planck equation. A stochastic dynamical system therefore has two complementary views: the SDE looks at a single random trajectory, while the Fokker–Planck equation looks at how the entire probability distribution evolves over time.
4.2 How SDEs relate to earlier concepts
At this point, everything from earlier in the series converges: Brownian motion supplies continuous random noise, the Markov property describes state evolution, martingales supply the conditional-expectation toolkit, Gaussian processes supply an important class of stochastic processes, and stationarity and ergodicity describe long-run statistical properties — an SDE essentially puts all of these concepts into one continuous-time dynamical system, making it the confluence point of the entire series.
5. Summary
The core form of a stochastic differential equation is , which can be understood as deterministic dynamics plus a continuous random perturbation. The Ornstein–Uhlenbeck process showed how mean reversion can be worked out concretely with an analytic solution, while geometric Brownian motion showed how the second-order correction term in Itô’s formula directly determines that the “median” and the “expected value” — two quantities that look similar but are in fact systematically different — diverge. From here, the natural next steps are the fuller machinery of stochastic calculus, the Fokker–Planck equation, stochastic control, and more general diffusion processes.