Last time we proved a version of Noether’s theorem for stochastic mechanics. Now I want to compare that to the more familiar quantum version.
But to do this, I need to say more about the analogy between stochastic mechanics and quantum mechanics. And whenever I try, I get pulled toward explaining some technical issues involving analysis: whether sums converge, whether derivatives exist, and so on. I’ve been trying to avoid such stuff—not because I dislike it, but because I’m afraid you might. But the more I put off discussing these issues, the more they fester and make me unhappy. In fact, that’s why it’s taken so long for me to write this post!
So, this time I will gently explore some of these issues. But don’t be scared: I’ll mainly talk about some simple big ideas. Next time I’ll discuss Noether’s theorem. I hope that by getting the technicalities out of my system, I’ll feel okay about hand-waving whenever I want.
And if you’re an expert on analysis, maybe you can help me with a question.
Stochastic mechanics versus quantum mechanics
First, we need to recall the analogy we began sketching in Part 5, and push it a bit further. The idea is that stochastic mechanics differs from quantum mechanics in two big ways:
• First, instead of complex amplitudes, stochastic mechanics uses nonnegative real probabilities. The complex numbers form a ring; the nonnegative real numbers form a mere rig, which is a ‘ring without negatives’. Rigs are much neglected in the typical math curriculum, but unjustly so: they’re almost as good as rings in many ways, and there are lots of important examples, like the natural numbers and the nonnegative real numbers, . For probability theory, we should learn to love rigs.
But there are, alas, situations where we need to subtract probabilities, even when the answer comes out negative: namely when we’re taking the time derivative of a probability. So sometimes we need instead of just .
• Second, while in quantum mechanics a state is described using a ‘wavefunction’, meaning a complex-valued function obeying
in stochastic mechanics it’s described using a ‘probability distribution’, meaning a nonnegative real function obeying
So, let’s try our best to present the theories in close analogy, while respecting these two differences.
We’ll start with a set whose points are states that a system can be in. Last time I assumed was a finite set, but this post is so mathematical I might as well let my hair down and assume it’s a measure space. A measure space lets you do integrals, but a finite set is a special case, and then these integrals are just sums. So, I’ll write things like
and mean the integral of the function over the measure space , but if is a finite set this just means
Now, I’ve already defined the word ‘state’, but both quantum and stochastic mechanics need a more general concept of state. Let’s call these ‘quantum states’ and ‘stochastic states’:
• In quantum mechanics, the system has an amplitude of being in any state . These amplitudes are complex numbers with
We call obeying this equation a quantum state.
• In stochastic mechanics, the system has a probability of being in any state . These probabilities are nonnegative real numbers with
We call obeying this equation a stochastic state.
In quantum mechanics we often use this abbreviation:
so that a quantum state has
Similarly, we could introduce this notation in stochastic mechanics:
so that a stochastic state has
But this notation is a bit risky, since angle brackets of this sort often stand for expectation values of observables. So, I’ve been writing , and I’ll keep on doing this.
In quantum mechanics, is well-defined whenever both and live in the vector space
In stochastic mechanics, is well-defined whenever lives in the vector space
You’ll notice I wrote rather than here. That’s because in some calculations we’ll need functions that take negative values, even though our stochastic states are nonnegative.
A state is a way our system can be. An observable is something we can measure about our system. They fit together: we can measure an observable when our system is in some state. If we repeat this we may get different answers, but there’s a nice formula for average or ‘expected’ answer.
• In quantum mechanics, an observable is a self-adjoint operator on . The expected value of in the state is
Here I’m assuming that we can apply to and get a new vector . This is automatically true when is a finite set, but in general we need to be more careful.
• In stochastic mechanics, an observable is a real-valued function on . The expected value of in the state is
Here we’re using the fact that we can multiply and and get a new vector , at least if is bounded. Again, this is automatic if is a finite set, but not otherwise.
Besides states and observables, we need ‘symmetries’, which are transformations that map states to states. We use these to describe how our system changes when we wait a while, for example.
• In quantum mechanics, an isometry is a linear map such that
for all . If is an isometry and is a quantum state, then is again a quantum state.
• In stochastic mechanics, a stochastic operator is a linear map such that
for all . If is stochastic and is a stochastic state, then is again a stochastic state.
In quantum mechanics we are mainly interested in invertible isometries, which are called unitary operators. There are lots of these, and their inverses are always isometries. There are, however, very few stochastic operators whose inverses are stochastic:
Puzzle 1. Suppose is a finite set. Show that every isometry is invertible, and its inverse is again an isometry.
Puzzle 2. Suppose is a finite set. Which stochastic operators have stochastic inverses?
This is why we usually think of time evolution as being reversible quantum mechanics, but not in stochastic mechanics! In quantum mechanics we often describe time evolution using a ’1-parameter group’, while in stochastic mechanics we describe it using a 1-parameter semigroup… meaning that we can run time forwards, but not backwards.
But let’s see how this works in detail!
Time evolution in quantum mechanics
In quantum mechanics there’s a beautiful relation between observables and symmetries, which goes like this. Suppose that for each time we want a unitary operator that describes time evolution. Then it makes a lot of sense to demand that these operators form a 1-parameter group:
Definition. A collection of linear operators U(t) () on some vector space forms a 1-parameter group if
for all .
Note that these conditions force all the operators to be invertible.
Now suppose our vector space is a Hilbert space, like Then we call a 1-parameter group a 1-parameter unitary group if the operators involved are all unitary.
It turns out that 1-parameter unitary groups are either continuous in a certain way, or so pathological that you can’t even prove they exist without the axiom of choice! So, we always focus on the continuous case:
Definition. A 1-parameter unitary group is strongly continuous if depends continuously on for all in this sense:
Then we get a classic result proved by Marshall Stone back in the early 1930s. You may not know him, but he was so influential at the University of Chicago during this period that it’s often called the “Stone Age”. And here’s one reason why:
Stone’s Theorem. There is a one-to-one correspondence between strongly continuous 1-parameter unitary groups on a Hilbert space and self-adjoint operators on that Hilbert space, given as follows. Given a strongly continuous 1-parameter unitary group we can always write
for a unique self-adjoint operator . Conversely, any self-adjoint operator determines a strongly continuous 1-parameter group this way. For all vectors for which is well-defined, we have
Moreover, for any of these vectors, if we set
When describes the evolution of a system in time, is is called the Hamiltonian, and it has the physical meaning of ‘energy’. The equation I just wrote down is then called Schrödinger’s equation.
So, simply put, in quantum mechanics we have a correspondence between observables and nice one-parameter groups of symmetries. Not surprisingly, our favorite observable, energy, corresponds to our favorite symmetry: time evolution!
However, if you were paying attention, you noticed that I carefully avoided explaining how we define I didn’t even say what a self-adjoint operator is. This is where the technicalities come in: they arise when is unbounded, and not defined on all vectors in our Hilbert space.
Luckily, these technicalities evaporate for finite-dimensional Hilbert spaces, such as for a finite set Then we get:
Stone’s Theorem (Baby Version). Suppose we are given a finite-dimensional Hilbert space. In this case, a linear operator on this space is self-adjoint iff it’s defined on the whole space and
for all vectors . Given a strongly continuous 1-parameter unitary group we can always write
for a unique self-adjoint operator where
with the sum converging for all Conversely, any self-adjoint operator on our space determines a strongly continuous 1-parameter group this way. For all vectors in our space we then have
and if we set
Time evolution in stochastic mechanics
We’ve seen that in quantum mechanics, time evolution is usually described by a 1-parameter group of operators that comes from an observable: the Hamiltonian. Stochastic mechanics is different!
First, since stochastic operators aren’t usually invertible, we typically describe time evolution by a mere ‘semigroup’:
Definition. A collection of linear operators () on some vector space forms a 1-parameter semigroup if
for all .
Now suppose this vector space is for some measure space . We want to focus on the case where the operators are stochastic and depend continuously on in the same sense we discussed earlier.
Definition. A 1-parameter strongly continuous semigroup of stochastic operators is called a Markov semigroup.
What’s the analogue of Stone’s theorem for Markov semigroups? I don’t know a fully satisfactory answer! If you know, please tell me.
Later I’ll say what I do know—I’m not completely clueless—but for now let’s look at the ‘baby’ case where is a finite set. Then the story is neat and complete:
Theorem. Suppose we are given a finite set . In this case, a linear operator on is infinitesimal stochastic iff it’s defined on the whole space,
for all , and the matrix of in terms of the obvious basis obeys
for all . Given a Markov semigroup on , we can always write
for a unique infinitesimal stochastic operator , where
with the sum converging for all Conversely, any infinitesimal stochastic operator on our space determines a Markov semigroup this way. For all we then have
and if we set
we have the master equation:
In short, time evolution in stochastic mechanics is a lot like time evolution in quantum mechanics, except it’s typically not invertible, and the Hamiltonian is typically not an observable.
Why not? Because we defined an observable to be a function . We can think of this as giving an operator on , namely the operator of multiplication by . That’s a nice trick, which we used to good effect last time. However, at least when is a finite set, this operator will be diagonal in the obvious basis consisting of functions that equal 1 at one point of and zero elsewhere. So, it can only be infinitesimal stochastic if it’s zero!
Puzzle 3. If is a finite set, show that any operator on that’s both diagonal and infinitesimal stochastic must be zero.
The Hille–Yosida theorem
I’ve now told you everything you really need to know… but not everything I want to say. What happens when is not a finite set? What are Markov semigroups like then? I can’t abide letting this question go unresolved! Unfortunately I only know a partial answer.
We can get a certain distance using the Hille-Yosida theorem, which is much more general.
Examples include Hilbert spaces like for any measure space, but also other spaces like for any measure space!
Definition. If is a Banach space, a 1-parameter semigroup of operators is called a contraction semigroup if it’s strongly continuous and
for all and all .
Examples include strongly continuous 1-parameter unitary groups, but also Markov semigroups!
Puzzle 4. Show any Markov semigroup is a contraction semigroup.
The Hille–Yosida theorem generalizes Stone’s theorem to contraction semigroups. In my misspent youth, I spent a lot of time carrying around Yosida’s book Functional Analysis. Furthermore, Einar Hille was the advisor of my thesis advisor, Irving Segal. Segal generalized the Hille–Yosida theorem to nonlinear operators, and I used this generalization a lot back when I studied nonlinear partial differential equations. So, I feel compelled to tell you this theorem:
Hille-Yosida Theorem. Given a contraction semigroup we can always write
for some densely defined operator such that has an inverse and
for all and . Conversely, any such operator determines a strongly continuous 1-parameter group. For all vectors for which is well-defined, we have
Moreover, for any of these vectors, if we set
If you like, you can take the stuff at the end of this theorem to be what we mean by saying . When , we say that generates the semigroup .
But now suppose . Besides the conditions in the Hille–Yosida theorem, what extra conditions on are necessary and sufficient for it to generate a Markov semigroup? In other words, what’s a definition of ‘infinitesimal stochastic operator’ that’s suitable not only when is a finite set, but an arbitrary measure space?
I asked this question on Mathoverflow a few months ago, and so far the answers have not been completely satisfactory.
Some people mentioned the Hille–Yosida theorem, which is surely a step in the right direction, but not the full answer.
Others discussed the special case when extends to a bounded self-adjoint operator on When is a finite set, this special case happens precisely when the matrix is symmetric: the probability of hopping from to equals the probability of hopping from to . This is a fascinating special case, not least because when is both infinitesimal stochastic and self-adjoint, we can use it as a Hamiltonian for both stochastic mechanics and quantum mechanics! Someday I want to discuss this. However, it’s just a special case.
After grabbing people by the collar and insisting that I wanted to know the answer to the question I actually asked—not some vaguely similar question—the best answer seems to be Martin Gisser’s reference to this book:
• Zhi-Ming Ma and Michael Röckner, Introduction to the Theory of (Non-Symmetric) Dirichlet Forms, Springer, Berlin, 1992.
This book provides a very nice self-contained proof of the Hille-Yosida theorem. On the other hand, it does not answer my question in general, but only when the skew-symmetric part of is dominated (in a certain sense) by the symmetric part.
So, I’m stuck on this front, but that needn’t bring the whole project to a halt. We’ll just sidestep this question.
For a good well-rounded introduction to Markov semigroups and what they’re good for, try:
• Ryszard Rudnicki, Katarzyna Pichór and Marta Tyran-Kamínska, Markov semigroups and their applications.