Fans of the network theory series might like to look at this paper:

• John Baez, Quantum techniques for reaction networks.

and I would certainly appreciate comments and corrections.

This paper tackles a basic question we never got around to discussing: how the *probabilistic* description of a system where bunches of things randomly interact and turn into other bunches of things can reduce to a *deterministic* description in the limit where there are lots of things!

Mathematically, such systems are given by ‘stochastic Petri nets’, or if you prefer, ‘stochastic reaction networks’. These are just two equivalent pictures of the same thing. For example, we could describe some chemical reactions using this Petri net:

but chemists would use this reaction network:

_{2}→ CO

_{2}

CO

_{2}+ NaOH → NaHCO

_{3}

NaHCO

_{3}+ HCl → H

_{2}O + NaCl + CO

_{2}

Making either of them ‘stochastic’ merely means that we specify a ‘rate constant’ for each reaction, saying how probable it is.

For any such system we get a ‘master equation’ describing how the probability of having any number of things of each kind changes with time. In the class I taught on this last quarter, the students and I figured out how to derive from this an equation saying how the *expected* number of things of each kind changes with time. Later I figured out a much slicker argument… but either way, we get this result:

**Theorem.** For any stochastic reaction network and any stochastic state evolving in time according to the master equation, then

assuming the derivative exists.

Of course this will make no sense yet if you haven’t been following the network theory series! But I explain all the notation in the paper, so don’t be scared. The main point is that is a vector listing the expected number of things of each kind at time The equation above says how this changes with time… but it closely resembles the ‘rate equation’, which describes the evolution of chemical systems in a *deterministic* way.

And indeed, the next big theorem says that the master equation actually *implies* the rate equation when the probability of having various numbers of things of each kind is given by a product of independent Poisson distributions. In this case is what people in quantum physics call a ‘coherent state’. So:

**Theorem.** Given any stochastic reaction network, let

be a mixed state evolving in time according to the master equation. If is a coherent state when then obeys the rate equation when

In most cases, this only applies exactly at one moment of time: later will cease to be a coherent state. Then we must resort to the previous theorem to see how the expected number of things of each kind changes with time.

But sometimes our state will stay coherent forever! For one case where this happens, see the companion paper, which I blogged about a little while ago:

• John Baez and Brendan Fong, Quantum techniques for studying equilibrium in reaction networks.

We wrote this first, but logically it comes *after* the one I just finished now!

All this material will get folded into the book I’m writing with Jacob Biamonte. There are just a few remaining loose ends that need to be tied up.

Typo in paper: Hydronium is H3O+ not H2O+

Yikes—thanks!

Another: “HIV Virus” on page 2 = “Human Immunodeficiency Virus Virus”

Okay, thanks—I fixed that now. There’s a big joke in this section of the paper, which is that this model of HIV involves 3 species,

Healthy cells,Infected cells andVirions. So I want to use the phrase HIV somewhere. I think it’s better now.Grammar nit:

If the subject is plural (which sounds a little better to me), the verb should be too.

“Greek letters names” -> “Greek-letter names”

Thanks for catching these errors! I hope you like the math when you get to that part.

So you don’t have to redo the work Brendan did, here is his list of corrections:

I’ve made all of Brendan and Blake’s suggested corrections, and a new improved version can be found at the same place, namely here.

I hope I’ll get a chance to go over the equations in a systematic way soon; this week is a mess of writing and lecturing obligations.

Good luck! If and when you read more, please upload a new version at the usual place, because I keep fixing typos and making other small improvements.

Few more nits:

p3: we make the follow/i/ng definition

p3: that the rate at which a reaction/s/ occurs

p4: the concentration of each input species i of tau/,/ raised to

p4: Definition 4. The rate equation for a reaction network (S;K;/R/;s;t) with rate constants r : /R/ (R should be T?)

p5: Our notation here follows that used /that used/ in quantum

p7: in def of Nm, is Nm well defined because the Ni commute?

Thanks for the extra corrections! I’ve fixed all those things now. You and Blake are now in the acknowledgements.

Yes, what I once called the set R of ‘reactions’ should now always be the set T of ‘transitions’… though in this paper I call them ‘reactions'; the name ‘transitions’ comes from Petri net theory. And yes, the number operators all commute, since annihilation and creation operators with different indices commute. I should mention that.

There’s an interesting connection between the creation/annihilation operator formalism and the representation theory of SU(2), which goes back to Schwinger. I haven’t made use of it myself, but it might be useful in cases where the number of molecules per site is limited; or, perhaps, where the key quantity is the difference between the sizes of two populations.

Schwinger’s idea was to relate the angular momentum Lie algebra to the algebra of two independent harmonic oscillators. If the oscillator algebras are given in the normal way by

and

and if we define the operators

then it follows that

and

This is just the algebra we use when manipulating angular momentum eigenstates.

In other words, instead of labeling an angular momentum eigenket by the eigenvalues of and , we can label it by the eigenvalues of the number operators and . The correspondence is

Sakurai and Napolitano’s book covers this in the quantum-mechanical context in section 3.9. The different normalization conventions we use in quantum and in stochastic mechanics turn out not to matter.

Analogues of the Schwinger oscillator construction can apparently be done for other Lie algebras, too;

e.g.,using six independent oscillators for SU(3).Hmm. Maybe the “Schwinger boson” construction could be used to give a groupoidification of SU(2)?

Yes, I did something on that once and was going to have a grad student work on it, but they got distracted. I think you could use this to better understand Penrose’s spin networks, which are all about representations of SU(2) on the one hand, and the combinatorics of graph colorings (and thus groupoidification) on the other hand. Someone should do that! The ultimate dream was to groupoidify loop quantum gravity…

When it comes to algebra, I think that by now most of the interesting categorified representation theory has been worked out using the Khovanov approach to categorification, which generalizes groupoidification. I don’t think the Jordan–Schwinger stuff has been categorified yet, but it could be and should be.

The relation between groupoidification and Khovanov-style categorification is not as well-known as it should be. It was nicely worked out by Jeff Morton and Jamie Vicary. They showed how Khovanov’s ‘categorified Heisenberg algebra’ could be described by taking my groupoidification of the algebra of annihilation and creation operators and hitting it with a functor that takes

groupoidsto their categories of representations (which can also be seen as categories of representations of certainalgebras) andspans of groupoidsto certain functors between these categories (which can also be seen as coming from certainbimodulesof algebras). So, groupoids and spans of groupoids give Khovanov’s algebras and bimodules.But crucially, Jeff and Jamie take groupoidification one step further by looking at

spans of spans of groupoids, which correspond tomorphisms of bimodules. And this lets them get a nice purely combinatorial explanation of the interesting new stuff in Khovanov’s categorified Heisenberg algebra—the relations that are the ‘next layer of structure’ after the canonical commutation relations:For an easy intro, see my n-Café article.

Anyway, since there’s by now a huge mob of smart people working on categorified Lie algebras and quantum groups, I want to steer clear of that stuff. A bit more interesting would be to find applications of these in the stochastic setting, as you point out. We could look at a population moving around on a lattice where each lattice site can have just 0 or 1 individuals, say, and try to write down a stochastic Hamiltonian for this population using the Jordan–Schwinger formalism, and study that. If you’re interested, let me know!

Over on the pure math side, someone should look at spans of spans of spans of groupoids, and see the

nextlayer of relations after the canonical commutation relations and Khovanov’s relations. And on the physics side, it would be interesting to understand what the heck all these higher relationsmean for physics. But I haven’t been able to get anyone interested in these questions.Blake wrote:

By the way, for some fun, Google “categorified Jordan-Schwinger”.

One of the things I’ve been juggling this past semester has been working out what happens in spatially-extended reactions where there is a limit to the number of reactant molecules at each location. For example, we can conceive of a square lattice of cells, where inside each cell the Brusselator dynamics are taking place, and in addition, molecules can pass between neighbouring cells. Limiting the carrying capacity per cell causes anomalous cross-diffusion terms to appear in the mean-field rate equations. One can plow through the van Kampen expansion and deduce that the terms are there, but I expect there’s a more direct way to see it.

I think there’s a lot of fancy math which would become more meaningful to me if we could port it into the stochastic-mechanics context. For example, can the Hopf-algebraic approach to renormalization say anything useful about RG calculations for reaction-diffusion phenomena?

(Look at the mess which starts in section 3 of Janssen and Taeuber (2004) if you need to understand my motivations here.)

Those renormalization group calculations for reaction-diffusion phenomena look really impressive and intimidating!

As far as I know, the only people who use the Hopf-algebraic approach to renormalization to

do renormalization, as opposed to prove things about renormalization, are the mad scientists who compute all Feynman diagrams up to 5 loops (say), and need to be very careful about subtleties like overlapping divergences. The Hopf-algebraic approach deals with these subtleties in a very systematic way and keeps you from going insane (though unfortunately too late, since you have to be insane to want to do these calculations in the first place).I could be wrong here; I’m not an expert on this stuff. It looks like Janssen and Taeuber are going up to 2 loops, which is complicated enough to be a bit of a nightmare, but probably not complicated enough to require one to

automatethe process of going through all Feynman diagrams and systematically keep track of overlapping divergences.I’d really like to find some subject we could work on together, but this hard-core field theory stuff is too removed from my current interests to want to work on it. I’m trying to focus on ‘networks’ and avoid issues that show up when you try to take some continuum limit. I used to think about field theory, but I’ve got a new schtick now.

The idea of using a Jordan–Schwinger representation to describe systems where each cell has a maximum carrying capacity—that’s more something I can see myself doing.

John Baez wrote:

I can appreciate that. Certainly, the network theory area is interesting—and I know a few people around my city who

areinto continuum limits, so on the days when I feel like going in that direction, I still have knowledgeable folks to talk with. :-)I’m trying to keep myself as focused as possible these days. It’s a skill I’ve never really learned: either I had immediate deadlines which locked me in to particular projects, or I wasn’t interacting with other people who were always coming up with their own crazy ideas, or I just plain didn’t know enough to be able to

startanything.So, to make things as concrete as possible:

First, as I said, I’m working on the spatial stochastic Brusselator, which has interesting finite-carrying-capacity behaviours. There may be something interesting in looking at this in a Jordan–Schwinger way, perhaps as a multi-cell discrete system.

Second, I’m in the midst of revising arXiv:1110.3845 [nlin.CG]. This paper plots a lot of curves which we found by numerical simulations. I’d like to get analytical predictions for as many of those curves as possible. This is what’s been pushing me into stochastic field theory. In addition, approximation methods which people already use for the kinds of models we studied can be expressed in network-theory language. So, there are both field-theoretic and Petri-net-theoretic things to do for the model I’d really like to understand.

Here’s something that might be concrete enough to become a paper yet abstract enough to keep me happy.

The Jordan–Schwinger trick might give a systematic way to reinterpret very general stochastic systems resembling stochastic Petri nets, but having limits on the number of particles of various species, as ordinary stochastic Petri nets. This might allow the instant application of theorems about stochastic Petri nets (or chemical reaction networks) to these other systems.

Here’s a nice intuitive way to think about the Jordan–Schwinger trick in the stochastic situation. Say we have a kind of particle—I need a name for it, so I’ll call it a

klingon—for which there can’t be more than particles of this kind. We can’t force that constraint directly in the stochastic Petri net framework. But we can do it using this trick. We make up a stochastic Petri nettwospecies of particles, 1 and 2, which we think of as ‘existent’ and ‘nonexistent’ klingons.We use the operator to simulate the creation of a klingon: in reality, it converts a ‘nonexistent’ klingon into an ‘existent one. Similarly, we use to simulate the annihilation of a klingon: in reality, it converts an ‘existent’ one into an ‘existent’ one. In reality, the total number of klingons, existent and nonexistent:

is conserved by both these processes:

So, if we start out with a state in the sector

processes built using the operators and will keep us in this sector. So, the total number of

existentklingons, measured by the operator can never exceedOf course this is just another way to describe the raising and lowering operators for the -dimensional representation of in terms of ordinary annihilation and creation operators. But I think it brings the idea down to earth a bit, and suggests how we can use stochastic Petri nets to study processes where different kinds of particles have different upper limits on their total particle number.

Typo:

I like this idea. We might have to make it one level more involved in order to connect with the models people like to study. In the stochastic Brusselator model, one has

that is, the sum total of type-X molecules, type-Y molecules

and available empty slotswithin each cell is the same number for all cells.In your terminology, this is like saying that the dynamics conserve the total number of smooth klingons, bumpy klingons and nonexistent klingons.

Blake wrote:

That’s even more fun! And not just because I like Klingons. It’s because now we’re getting into the Jordan–Schwinger representation of !

If you look at all the triples of natural numbers obeying

you’ll get a finite set of dots arranged in a triangular pattern. If you take you get Gell–Mann’s famous weight diagram for up, down and strange quarks:

If you take you get his famous weight diagram for the ‘baryon decuplet’:

You can see that up, down and strange quarks are the three species that take the place of smooth, bumpy and nonexistent klingons.

In general you can do this for any and you’ll get the weight diagram for an irreducible representation of This is the symmetrized th tensor power of its fundamental representation on It’s symmetrized because we’re dealing with identical particles here. Its dimension is always a triangle number.

We get the Jordan–Schwinger representation by looking at linear combinations of operators that annihilate one kind of particle and then create another:

There are 9 of these. There’s a special operator that’s a linear combination of these:

and this is the total number operator: it takes value on the space we’re talking about. It commutes with all the rest. So, we get an 8-dimensional space of

otheroperators, and this is the Lie algebra(Actually we get an 8-dimensional

complexspace, which is the complexification of Physicists are often a bit relaxed about this distinction, but we should be clear about it.)All this stuff works with more than 3 kinds of particles, too.

Looking fun yet?

We are really getting into the groupoidified Jordan–Schwinger idea here. We’re seeing a relation between -colored sets and representations of , which is typical of groupoidification: combinatorics on the one hand, linear algebra on the other.

Another idea which might strike the right balance between concreteness and abstraction concerns the relations among

different Petri-net descriptionsof thesame system.This is territory in between spatial and nonspatial modeling, where we incorporate information more detailed than overall averages or total population sizes, while still coarse-graining away many details which we hope won’t matter. For example, instead of considering only the total numbers ofSusceptible,Infected andRecovered individuals, we can keep track of how many adjacent pairs of each possible combination of types there are. Both levels of description can have stochastic-Petri-net descriptions, but the species and transitions are different.I left a note for myself about this here:

It would be interesting to have some general results about, say, when coarse-graining a stochastic Petri net makes an equilibrium unviable, or makes a new equilibrium appear.

Blake wrote:

That sounds interesting but a bit tough. Since I’m pretty good at abstract nonsense, I’d be tempted to start out by building some general infrastructure: namely, working out the correction notion(s) of

morphismbetween stochastic Petri nets, and figuring out how the rate equations and master equations are related, when we have two stochastic Petri nets related by a morphism.Since a Petri net is a free symmetric monoidal category, one obvious notion of morphism, which you mentioned, is a symmetric monoidal functor. (If we want to intimidate people, we can note that a category of ‘free’ gadgets and the obvious morphisms between them is a Kleisli category. Knowing this can even be useful for things other than intimidation.)

A stochastic Petri net is a free symmetric monoidal category equipped with a symmetric monoidal functor to the multiplicative monoid , viewed as a symmetric monoidal category. This again suggests an obvious notion of morphism between stochastic Petri nets, at least to us category geeks.

But the interesting part is whether these morphisms give rise to some sort of map sending solutions of the master equation of one stochastic Petri net to solutions of the other. This would probably be ‘too perfect’ for anyone interested in realistic coarse-grainings… but I suspect that if you follow the tao of mathematics, it will quickly lead you to consider these ‘perfect’ coarse-grainings.

I think the case has been looked at, after a fashion. See N. Stollenwerk and M. Aguiar’s “The SIRI stochastic model with creation and annihilation operators” [arXiv:0806.4565]. They cook up a lattice model where each site can be in one of three states (Susceptible, Infected or Recovered), and to write a time-evolution operator, they bring in the Gell-Mann matrices. I think this is pretty much a special case of what we were saying. That is, their model has for each site

as indeed they say at the beginning of section 3.1.

Cool! I think the problems start with and the precise coefficients of operators like You see, if we have such an operator that annihilates a ‘nonexistent’ particle and creates an ‘existent’ one, its matrix entries will depend on the number of nonexistent particles, since there are

different possibilities for which nonexistent particle is destroyed. This is okay if there are a number of ‘empty spots’ and we want to keep track of which one is filled by a new particle. But in other situations, we may not get the answer we want.The second Google hit for me at the moment is some blog page saying, “I don’t think the

Jordan–Schwingerstuff has beencategorifiedyet, but it could be and should be.”And the first one is my grant proposal where I say:

I got that grant, and my grad students groupoidified Hecke and Hall algebras (which are q-deformed universal enveloping algebras of Lie algebras), but they never got around to Jordan–Schwinger!

By the way, I used to really love this Jordan–Schwinger stuff, so thanks for reminding me about it.

The reason the Jordan–Schwinger stuff works for the groups SU(n) is that these groups are contained in symplectic groups. The Jordan–Schwinger idea applies to any symplectic group, and that’s where the idea really lives (in my opinion).

The symplectic group Sp(2n) is the group of symmetries of a 2n-dimensional symplectic vector space. Equivalently, it’s the group of symmetries of the algebra generated by n creation and n annihilation operators. These operators span a 2n-dimensional symplectic vector space, say . The symplectic group Sp(2n) acts on this vector space. So, the Lie algebra acts on as well.

And here’s the fun part: for each element , there’s a quadratic expression in the annihilation and creation operators such that

where at right I’m using the commutator bracket in the algebra generated by annihilation and creation operators. In physics lingo, is a way of ‘quantizing’ the infinitesimal symmetry .

How do you define I forget but I think it’s something dumb like this. Since is a linear transformation of it’s an element of But a symplectic vector space is canonically isomorphic with its dual so we get an element of . But is the space spanned by annihilation and creation operators, so is the space of all bilinear expressions in annihilation and creation operators.

In case this is relevant. See section 7.

http://arxiv.org/abs/cond-mat/0612198

Thanks, that’s great. Blake Stacey: look!

In definitions 1 and 2, shouldn’t a graph be specified as and ?

is a pretty standard shorthand for saying we have two functions and that both map to It’s just faster than writing and .

It’s just like we often say when we have two real numbers and , instead of saying (which would confuse everyone) or (which is sometimes good, but only when we want to make the reader think about as a point in the plane).

In the section on the Master equation:

– should be corrected.

Thanks! I’m really glad you’re reading this paper; it presents some of the same material as the ‘course’, but more quickly, and it also does some new things. Please get a copy of the latest version when you read this, because I keep updating it. Yesterday I added a more detailed explanation of the ‘Fock space’, and in a minute I’ll probably rename it the ‘stochastic Fock space’ to distinguish it from the usual quantum one.

I think the proof of theorem 5 is funky — the last line includes , which I think should be , and otherwise the first and last lines are the same.

Blecch! You’re obviously the first person to read this proof… and that includes the author.

Thanks a million! It’s fixed now.

At the end of the proof of Theorem 5,

1.typo: You write, …..n be expressed as an convergent infinite linear combination of these monomials….- an -> a

2. Does the convergence of each coefficient mean that each coefficient is a finite number?

3. What does this sentence mean?,- .. The annihilation and creation operators, and indeed all the operators discussed in this paper, are continuous in this topology..

In the proof of Theorem 8,

4.typo: -> .

5. You write that the rate equation for would then follow from the master equation for if we had for every multi-index m. Isn’t this being true only for the source complexes, sufficient?

6. Can you elaborate on this? : ..However, it should hold approximately in a suitable limit of large numbers. ..

Lemma 12:

7. typo: -> .

Thanks for catching those typos.

Yes is the space of formal power series in the variables

where the coefficients are real numbers, which of course are finite.We’re giving this space the topology where a sequence of formal power series converges to a formal power series iff all the coefficients converge:

for ever multi-index (Here is the coefficient of in the formal power series ; I need to use superscripts to indicate a sequence of formal power series since I’m using a subscript to indicate a coefficient.)

All these operators are maps from to itself. I’m asserting that they’re all continuous in the topology I just described.

Yes.

Making this precise would be easy for me, but it would take a few pages. That’s why I didn’t make that sentence precise, and that’s why I won’t do it now. I’ll leave it as a puzzle:

Suppose we are given and Find conditions saying that is close to which guarantee that if is a solution of the master equation obeying these conditions at some time then

stays within a distance of a solution of the rate equation for This could be a short paper. This is sort of standard analysis stuff.

I finally got around to reading paper. I think I found a couple more minor typos:

In the proof of Lemma 12, I think should be .

In the penultimate sentence, “…as show by…” should be “…as shown by…”

Hope that helps.

Oops. I see Arjun caught the typo in lemma 12. It must not have been fixed on the version I read.

Actually I somehow missed Arjun’s correction of that typo—he’s been posting lots of comments, and I’m having trouble keeping up with them all. (He’s working with me here at the Centre for Quantum Technologies now.) So, thanks a lot for posting your comment!

The version on the arXiv is now a bit out of date. The latest version, with all known corrections made, is on my website. But I’ll eventually update the arXiv version.