Itô calculus for the rest of us
One of the areas of my research is stochastic differential equations (SDE). I posted about it several times before. One of the things students and collaborators keep asking me about SDEs is the weird stochastic Itô Calculus. Itô Calculus is different from what you learn in 101 calculus. In particular, the chain rule is not longer valid. Let me explain it with an example. Suppose you have the following equation
where is the Wiener stochastic process: it is a process in which and with Gaussian independent increments , where are Gaussian random numbers with mean and variance . This equation is the simplest SDE and its solution is (obviously),
But there is a different way to look at SDEs. Since they describe the trayectory of subject to we can instead ask ourselves what is the probability to find that in average, i.e. after many different runs of . Let’s call that probability which is known to satisfy the Fokker-Planck equation
which is the simple diffusion equation. The following figure shows the relationship between and . While is a simple trayectory (for a given realization), is the probability to find over all possible realizations of .
The relationship between and is more general than for the example used here. In general, if we have the SDE
in the Itô sense, then is the solution of
The term is usually know as the drift and is the diffusion term.
Once the relationship between the Fokker-Planck equation and its SDE is given, it is very easy to understand Itô Calculus. For example, given the above SDE , what is the SDE that will satisfy ?
Instead of using Itô’s lemma, we will use the Fokker Planck equation and traditional calculus. Thus . We also have that or . Putting all these things together we get
and with a little bit of algebra we get
which, according to the general relationship between Fokker-Planck equation and SDE, corresponds to the following SDE
as the Itô’s lemma says. Obviously, this way to get the Itô lemma is painful in general, so you’d better use it directly on the SDE instead of the method shown here which goes through the Fokker-Planck equation. However, it is interesting to see that you can recover it from the Fokker-Planck equation.