The Kuramoto–Sivashinsky Equation (Part 1)

I love this movie showing a solution of the Kuramoto–Sivashinsky equation, made by Thien An. If you haven’t seen her great math images on Twitter, check them out!

I hadn’t known about this equation, and it looked completely crazy to me at first. But it turns out to be important, because it’s one of the simplest \partial differential equations that exhibits chaotic behavior.

As the image scrolls to the left, you’re seeing how a real-valued function h(t,x) of two real variables changes with the passage of time. The vertical direction is ‘space’, x, while the horizontal direction is time, t.

Near the end of this post I’ll make some conjectures about the Kuramoto–Sivashinsky equation. The first one is very simple: as time passes, stripes appear and merge, but they never disappear or split.

The behavior of these stripes makes the Kuramoto–Sivashinsky equation an excellent playground for thinking about how differential equations can describe ‘things’ with some individuality, even though their solutions are just smooth functions. But to test my conjectures, I could really use help from people who are good at numerical computation or creating mathematical images!

First let me review some known stuff. You can skip this and go straight to the conjectures if you want, but some terms might not make sense.

Review

For starters, note that these stripes seem to appear out of nowhere. That’s because this system is chaotic: small ripples get amplified. This is especially true of ripples with a certain wavelength: roughly 2 \sqrt{2} \pi, as we’ll see later.

And yet while solutions of the Kuramoto–Sivanshinsky equation are chaotic, they have a certain repetitive character. That is, they don’t do completely novel things; they seem to keep doing the same general sort of thing. The world this equation describes has an arrow of time, but it’s ultimately rather boring compared to ours.

The reason is that all smooth solutions of the Kuramoto–Sivanshinsky equation quickly approach a certain finite-dimensional manifold of solutions, called an ‘inertial manifold’. The dynamics on the inertial manifold is chaotic. And sitting inside it is a set called an ‘attractor’, which all solutions approach. This attractor is probably a fractal. This attractor describes the complete repertoire of what you’ll see solutions do if you wait a long time.

Some mathematicians have put a lot of work into proving these things, but let’s see how much we can understand without doing anything too hard.

Written out with a bit less jargon, the Kuramoto–Sivashinky equation says

\displaystyle{ \frac{\partial h}{\partial t} = - \frac{\partial^2 h}{\partial x^2} - \frac{\partial^4 h}{\partial x^4} - \frac{1}{2}\left( \frac{\partial h}{\partial x}\right)^2 }

or in more compressed notation,

h_t = -h_{xx} - h_{xxxx} - \frac{1}{2} (h_x)^2

To understand it, first remember the heat equation:

h_t = h_{xx}

This describes how heat spreads out. That is: if h(t,x) is the temperature of an iron rod at position x at time t, the heat equation describes how this temperature function flattens out as time passes and heat spreads.

But the Kuramoto–Sivashinsky equation more closely resembles the time-reversed heat equation

h_t = -h_{xx}

This equation describes how, running a movie of a hot iron rod backward, heat tends to bunch up rather than smear out! Small regions of different temperature, either hotter or colder than their surroundings, will tend to amplify.

This accounts for the chaotic behavior of the Kuramoto–Sivashinsky equation: small stripes emerge as if out of thin air and then grow larger. But what keeps these stripes from growing uncontrollably?

The next term in the equation helps. If we have

h_t = -h_{xx} - h_{xxxx}

then very sharp spikes in h(t,x) tend to get damped out exponentially.

To see this, it helps to bring in a bit more muscle: Fourier series. We can easily solve the heat equation if our iron rod is the interval [0,2\pi] and we demand that its temperature is the same at both ends:

h(t,0) = h(t,2\pi)

This lets us write the temperature function h(t,x) in terms of the functions e^{ikx} like this:

\displaystyle{ h(t,x) = \sum_{k = -\infty}^\infty \hat{h}_k(t) e^{ikx} }

for some functions \hat{h}_k(t). Then the heat equation gives

\displaystyle{ \frac{d}{d t} \hat{h}_k(t) = -k^2 \hat{h}_k(t) }

and we can easily solve these equations and get

\displaystyle{ \hat{h}_k(t) = e^{-k^2 t} \hat{h}_k(0) }

and thus

\displaystyle{ h(t,x) = \sum_{k = -\infty}^\infty \hat{h}_k(0) e^{-k^2 t} e^{ikx} }

So, each function \hat{h}_k(t) decays exponentially as time goes on, and the so-called ‘high-frequency modes’, \hat{h}_k(t) with |k| big, get damped really fast due to that e^{-k^2 t} factor. This is why heat smears out as time goes on.

If we solve the time-reversed heat equation the same way we get

\displaystyle{ h(t,x) = \sum_{k = -\infty}^\infty \hat{h}_k(0) e^{k^2 t} e^{ikx} }

so now high-frequency modes get exponentially amplified. The time-reversed heat equation is a very unstable: if you change the initial data a little bit by adding a small amount of some high-frequency function, it will make an enormous difference as time goes by.

What keeps things from going completely out of control? The next term in the equation helps:

h_t = -h_{xx} - h_{xxxx}

This is still linear so we can still solve it using Fourier series. Now we get

\displaystyle{ h(t,x) = \sum_{k = -\infty}^\infty \hat{h}_k(0) e^{(k^2-k^4) t} e^{ikx} }

Since k^2 - k^4 \le 0, none of the modes \hat{h}_k(t) grows exponentially. In fact, all the modes decay exponentially except for three: k = -1,0,1. These will be constant in time. So, any solution will approach a constant as time goes on!

We can make the story more interesting if we don’t require our rod to have length 2\pi. Say it has length L. We can write periodic functions on the interval [0,L] as linear combinations of functions e^{ikx} where now the frequencies k aren’t integers: instead

k = 2\pi n/L

for integers n. The longer our rod, the lower these frequencies k can be. The rest of the math works almost the same: we get

\displaystyle{ h(t,x) = \sum_{n = -\infty}^\infty \hat{h}_k(0) e^{(k^2-k^4) t} e^{ikx} }

but we have to remember k = 2\pi n/L. The modes with k^2 - k^4 > 0 will grow exponentially, while the rest will decay exponentially or stay constant. Note that k^2 - k^4 > 0 only for 0 <|k| < 1. So, modes with these frequencies grow exponentially. Modes with |k| > 1 decay exponentially.

If L < 2\pi, all the frequencies k are integers times 2\pi/L, which is bigger than 1, so no modes grow exponentially—and indeed all solutions approach a constant! But as you look at longer and longer rods, you get more and more modes that grow exponentially. The number of these will be roughly proportional to L, though they will ‘pop into existence’ at certain specific values of L.

Which exponentially growing modes grow the fastest? These are the ones that make k^2 - k^4 as large as possible, so they happen near where

\displaystyle{ \frac{d}{dk} (k^2 - k^4) = 0 }

namely k = 1/\sqrt{2}. The wavelength of a mode is 2\pi/k, so these fastest-growing modes have wavelength close to 2\sqrt{2} \pi.

In short, our equation has a certain length scale where the instability is most pronounced: temperature waves with about this wavelength grow fastest.

All this is very easy to work out in as much detail as we want, because our equation so far is linear. The full-fledged Kuramoto–Sivashinsky equation

h_t = -h_{xx} - h_{xxxx} - \frac{1}{2} (h_x)^2

is a lot harder. And yet some features of the linear version remain, which is why it was worth spending time on that version.

For example, I believe the stripes we see in the movie above have width roughly 2 \sqrt{2} \pi. Stripes of roughly this width tend to get amplified. Why don’t they keep on growing taller forever? Apparently the nonlinear term -(h_x)^2 prevents it. But this is not obvious. Indeed, it’s conjectured that if you solve the Kuramoto–Sivashinsky equation starting with a bounded smooth function h(0,x), the solution will remain bounded by a constant. But this has not been proved—or at least it was not proved as of 2000, when this very nice article was written:

• Encyclopedia of Mathematics, Kuramoto–Sivashinsky equation.

The inertial manifold

The most fascinating fact about the Kuramoto–Sivashinsky equation is that for any fixed length L, it has a finite-dimensional manifold M of solutions such that every solution approaches one of these, exponentially fast! So, while this equation really describes an infinite-dimensional dynamical system, as t \to \infty its solutions move closer and closer to the solutions of some finite-dimensional dynamical system. This finite-dimensional system contains all the information about the patterns we’re seeing in Thien An’s movie.

As I mentioned, the manifold M is called an ‘inertial manifold’. This is a general concept in dynamical systems theory:

• Wikipedia, Inertial manifold.

To make these ideas precise we need to choose a notion of distance between two solutions at a given time. A good choice uses the L^2 norm for periodic functions on [0,L]:

\displaystyle{ \|f\| = \sqrt{\int_0^L |f(x)|^2 \, dx} }

Functions on [0,L] with finite L^2 norm form a Hilbert space called L^2[0,L]. If we start with any function h(0,-) in this Hilbert space we get a solution h(t,x) of the Kuramoto–Sivashinsky equation such that the function h(t,-) is in this Hilbert space at all later times t. Furthermore, this function is smooth, even analytic, for all later times:

• P. Collet, J.-P. Eckmann, H. Epstein and J. Stubbe, Analyticity for the Kuramoto–Sivashinsky equation, Physica D 67 (1993), 321–326.

This smoothing property is well-known for the heat equation, but it’s much less obvious here!

This work also shows that the Kuramoto–Sivashinsky equation defines a dynamical system on the Hilbert space L^2[0,L]. And based on earlier work by other mathematicians, Temam and Wang have heroically shown that this Hilbert space contains an inertial manifold of dimension bounded by some constant times L^{1.64} (\ln L)^{0.2}.

• Roger Temam and Xiao Ming Wang, Estimates on the lowest dimension of inertial manifolds for the Kuramoto-Sivashinsky equation in the general case, Differential and Integral Equations 7 (1994), 1095–1108.

I conjecture that in reality its dimension grows roughly linearly with L. Why? We’ve just seen this is true for the linearized version of the Kuramoto–Sivashinsky equation: all modes with frequency |k| > 1 get damped exponentially, but since there’s one mode for each integer n, and k = 2\pi n/L, these modes correspond to integers n with |n| \le L /2\pi. So, there are \lfloor L/\pi \rfloor of these modes. In short, for the linearized Kuramoto–Sivashinsky equation the inertial manifold has dimension about L/\pi.

This evidence is rather weak, since it completely ignores the nonlinearity of the Kuramoto–Sivashinsky equation. I would not be shocked if the dimension of the inertial manifold grew at some other rate than linearly with L.

Sitting inside the inertial manifold is an attractor, the smallest set that all solutions approach. This is probably a fractal, since that’s true of many chaotic systems. So besides trying to estimate the dimension of the inertial manifold, which is an integer we should try to estimate the dimension of this attractor, which may not be an integer!

There have been some nice numerical experiments studying solutions of the Kuramoto–Sivashinsky equation for various values of L, seeing how they get more complicated as L increases. For small L, every solution approaches a constant, just as in the linearized version. For larger L we get periodic solutions, and as L continues to increase we get period doubling and finally chaos—a typical behavior for dynamical systems. But that’s just the start. For details, read this:

• Demetrios T. Papageorgiou and Yiorgos S. Smyrlis, The route to chaos for the Kuramoto–Sivashinsky equation, Theoretical and Computational Fluid Dynamics 3 (1991), 15–42.

I’ll warn you that they use a slightly different formalism. Instead of changing the length L, they keep it equal to 2\pi and change the equation, like this:

h_t = -h_{xx} - v h_{xxxx} - \frac{1}{2} (h_x)^2

for some number v they call the ‘viscosity’. It’s just a different way of describing the same business, so if I had more energy I could figure out the relation between L and v and tell you at which length L chaos first kicks in. But I won’t now. Instead, I want to make some conjectures.

Conjectures

There should be some fairly well-defined notion of a ‘stripe’ for the Kuramoto–Sivashinsky equations: you can see the stripes form and merge here, and if we can define them, we can count them and say precisely when they’re born and when they merge:

For now I will define a ‘stripe’ as follows. At any time, a solution of the Kuramoto–Sivashinsky gives a periodic function h on the interval [0,L]. We can think of this as a function on the circle. A stripe will be a maximal closed subinterval of the circle on which h \ge c. This definition depends on a constant c > 0, and it’s up to you to pick a value of the constant that makes my conjectures true—or at least, almost true!

So, here are the conjectures:

First, I conjecture that if L is large enough, almost every non-negative solution in the inertial manifold has a finite number of stripes at any time t, and that while they can appear and merge as we increase t, they can never split or disappear.

(Here ‘almost every’ is in the usual sense of measure theory. There are certainly solutions of the Kuramoto–Sivashinsky equation that don’t have stripes that appear and merge, like constant solutions. These solutions may lie on the inertial manifold, but I’m claiming they are rare.)

I also conjecture that the time-averaged number of stripes is asymptotically proportional to L as L \to \infty for almost every nonnegative solution on the inertial manifold. The constant of proportionality shouldn’t depend on the solution we pick, except for solutions in some set of measure zero. It will, however, depend on our precise definition of ‘stripe’, e.g. our choice of the constant c.

I also conjecture that there’s a well-defined time average of the rate at which new stripes form, which is also asymptotically proportional to L and independent of which solution we pick, except for solutions in a set of measure zero.

I also conjecture that this rate equals the time-averaged rate at which stripes merge, while the time-averaged rate at which stripes disappear or split is zero.

These conjectures are rather bold, but of course there are various fallback positions if they fail.

How can we test these conjectures? It’s hard to explicitly describe solutions that are actually on the inertial manifold, but by definition, any solution keeps getting closer to the inertial manifold at an exponential rate. Thus, it should behave similarly to solutions that are on the inertial manifold, after we wait long enough. So, I’ll conjecture that the above properties hold not only for almost every solution on the inertial manifold, but for typical solutions that start near the inertial manifold… as long as we wait long enough when doing our time averages.

If you feel like working on this, here are some things I’d really like:

• Images like Thien An’s but with various choices of L. To create these, maybe start with

h(0,x) = \sin \frac{x}{2L} + \textrm{a small amount of noise}

and run it for long enough to ‘settle down’—that is, get near the inertial manifold.

• A time-averaged count of the average number of stripes for various choices of L. I’m conjecturing that this is asymptotically proportional to L for large L.

• Time-averaged counts of the rates at which stripes are born, merge, split, and die—again for various choices of L. I’m conjecturing that the first two are asymptotically proportional to L for large L and that they’re equal. I’m conjecturing that the last two are zero, or tiny.

If someone gets into this, maybe we could submit a short paper to Experimental Mathematics. I’ve been browsing papers on the Kuramoto–Sivashinsky equations, and I haven’t yet seen anything that gets into as much detail on what solutions look like as I’m trying to do here.

The arrow of time

One more thing. I forgot to emphasize that the dynamical system on the Hilbert space L^2[0,L] is not reversible: we can evolve a solution forwards in time and it will stay in this Hilbert space, but not backwards in time. This is very well-known for the heat equation; the point is that solutions get smoother as we run them forward, but when we run them backward they typically get more wild and eventually their L^2 norm blows up.

What makes this especially interesting is that the dynamical system on the inertial manifold probably is reversible. As long as this manifold is compact, it must be: any smooth vector field on a compact manifold M generates a ‘flow’ that you can run forward or backward in time.

And yet, even if this flow is reversible, as I suspect it is, it doesn’t resemble its time-reversed version! It has an ‘arrow of time’ built in, since bumps are born and merge much more often than they merge and split.

So, if my guesses are right, the inertial manifold for the Kuramoto–Sivashinsky equation describes a deterministic universe where time evolution is reversible—and yet the future doesn’t look like the past, because the dynamics carry the imprint of the irreversible dynamics of the Kuramoto–Sivashinsky equation on the larger Hilbert space of all solutions.

A warning

If you want to help me, the following may be useful. I believe the stripes are ‘bumps’, that is, regions where u > c for some positive constant c. That would make them easy to define. I was shocked when Steve Huntsman did some calculations and produced a picture showing a solution where L = 128:

Here the stripes are not mere bumps: they are regions where, as we increase x, the solution first becomes large and negative and then becomes large and positive!

After massive confusion I realized that Steve was using some MATLAB code adapted from this website:

• Mathab Lak, Test case for PDEs: Kuramoto–Sivashinksy, Crank-Nicolson/Adams-Bashforth (CNAB2) timestepping.

and this code solves a different version of the Kuramoto–Sivashinksy equations, the so-called derivative form:

u_t = -u_{xx} - u_{xxxx} - uu_x

If h satisfies the integral form of the Kuramoto–Sivashinksy equation, which is the one I’ve been talking about all along:

h_t = -h_{xx} - h_{xxxx} - \frac{1}{2} (h_x)^2

then its derivative

u = h_x

satisfies the derivative form.

So, the two equations are related, but you have to be careful because some of their properties are quite different! For the integral form, the cross-section of a typical stripe looks very roughly like this:

but for the derivative form it looks more like this:

You can grab Steve Huntsman’s MATLAB code here, but beware: this program solves the derivative form! Many of Steve’s pictures in comments to this blog—indeed, all of them so far—show solutions of the derivative form. In particular, the phenomenon he discovered of stripes tending to move at a constant nonzero velocity seems to be special to the derivative form of the Kuramoto–Sivashinsky equation. I’ll say more about this next time.

This entry was posted on Sunday, October 17th, 2021 at 6:47 pm and is filed under mathematics, physics. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

33 Responses to The Kuramoto–Sivashinsky Equation (Part 1)

  1. Ken Abbott says:
    17 October, 2021 at 7:04 pm

    Amazing. But what happens if we convert this to a difference equation? Might better show the chaotic property? http://www.math-math.com/2018/02/the-calculus-that-got-ignored.html

    Reply
    • John Baez says:
      17 October, 2021 at 7:25 pm

      I don’t see why it would be any ‘better’, but when you numerically solve this differential equation, e.g. using the Euler method or Runge–Kutta, you’re implicitly turning it into a difference equation. And by the way, the fact that the original equation is chaotic means that your numerical solution will be unstable: small errors will blow up. You just have to live with that and hope that if you do a decent job, they won’t affect the ‘overall character’ of the solutions (e.g. the properties I’m conjecturing).

      Reply
      • Christopher Upshaw says:
        20 October, 2021 at 1:41 am

        I wonder how much of the behavior you could replicate with a three value function, i.e by describing things at the level of “things” and ignoring the smooth foundation. Like if all you know about a point is if it’s blue yellow or green (low high middle) can you predict the future? I kind think you should be able to recover the continuous function.

        And then of course the the other question is how many computational pixels do you need per bump? 2 5 10 1?

        Reply
        • John Baez says:
          21 October, 2021 at 12:05 am

          Good questions! I bet there are quite simple cellular automaton models that display behavior similar to the Kuramoto–Sivashinsky equation. Does someone here know them?

        • Steve Huntsman says:
          21 October, 2021 at 12:28 am

          There are lattice Boltzmann models, e.g. https://doi.org/10.1016/j.physa.2009.01.005 but these sorts of things are rather more involved than cellular automata per se. I once tinkered with such things and the effort is almost all technicalities (of the sort I find annoying)

  2. Graham Jones says:
    19 October, 2021 at 9:53 am

    I think it might be hard to find a threshold c for defining bumps. In the video, it appears to me that just before bumps merge, they sometimers get pinched, or fade away a bit, especially if they are ‘young’ bumps, not well established ones. The Encyclopedia of Mathematics link has a ‘derivative’ version which looks symmetric about zero, so perhaps a threshold of zero would work for that.

    If you look at the valleys instead of the bumps, they tend to split and die, not emerge and merge. That is more like how life works. I like to think of the bumps as reproductive barriers between species.

    Reply
    • John Baez says:
      19 October, 2021 at 3:42 pm

      I was confused about how to read this image:

      I thought the stripes were ‘bumps’: regions where h > c for some positive c. In fact the light side of each stripe has u > 0 and the dark side has h < 0 (or maybe the other way around). In other words, brightness is proportional to h.

      This was clarified by Steve Huntsman, who produced an image showing the actual value of h:

      So, I need to define stripes correctly to fix my conjectures.

      Of course if I can define which regions are in stripes, I can define which regions are not in stripes.

      Note that it takes to about t = 70 for the solution to come close to the inertial manifold. For about 0 \le t \le 50 small initial ripples are merging and growing to form a few big stripes. By about t = 70 we see the usual pattern: stripes merging and being born at a roughly constant rate.

      By the way, the h values on Steve Huntsman’s image seem awfully large to me. Maybe they’re rescaled somehow? I may need to learn to write my own programs for this stuff.

      (Note added later: some of the confusion above is cleared up in the current version of the blog article, written 2021 October 21.)

      Reply
      • Wyrd Smythe says:
        19 October, 2021 at 5:07 pm

        Maybe Greg Egan might be interested in helping? He’s got some sophisticated animations on his website. Or maybe Grant Sanderson might be interested. Either might be willing to share or point to some useful animation tools.

        Reply
      • Graham Jones says:
        19 October, 2021 at 5:11 pm

        I was confused in the same way as you… unless people are using different definitions of u.

        In Steve Huntsman’s image, I’d be inclined to find zero-crossings and remove those that cross zero ‘too gently’. This is aimed at defining borders rather than regions.

        Reply
      • John Baez says:
        19 October, 2021 at 6:26 pm

        Yes, my article here discusses what the Encyclopedia of Mathematics calls the ‘derivative’ form of the equation, while they mainly discuss the ‘integral’ form. You get a solution of the derivative form by differentiating a solution of the integral form with respect to x.

        Since Thien An showed the derivative form on her movie, I optimistically assumed she was working with that form.

        However, this code claims to be solving the integral form.

        This makes a difference in how to define ‘stripes’, and right now I’m rather confused.

        Steve Huntsman claims to be solving the derivative form and getting this:

        Maybe this is why people program: if you don’t do the programming yourself you can never feel sure about what’s actually happening. Unfortunately, when I program myself I still can’t tell what’s actually happening.

        Reply
        • Steve Huntsman says:
          19 October, 2021 at 7:01 pm

          Ha! I didn’t write the code myself so I don’t understand what’s happening either, just taking the code comment at face value. But it wouldn’t be that hard to rewrite/understand it…

  3. Jamie Vicary says:
    19 October, 2021 at 1:35 pm

    I had no idea this sort of behaviour could arise from a differential equation, it’s extremely beautiful.

    I wonder if there is a straightforward 3d generalization where the bumps braid around each other before merging.

    Reply
    • John Baez says:
      19 October, 2021 at 4:42 pm

      Yes! I didn’t say it out loud, but here’s what we’re both thinking.

      If you have a monoid object x in a monoidal category, it has a multiplication

      m \colon x \otimes x \to x

      and unit

      i \colon I \to x

      and if we draw morphisms involving these as string diagrams, we get 2-dimensional pictures where strings can merge (thanks to the multiplication) and be born (thanks to the unit), but never split or die.

      Braiding might be possible in this ‘chemotaxis’ model animated by Theodore Kolokolnikov:

      But actually I don’t see braiding going on here. Maybe the ‘bacteria’ need more freedom to randomly roam about if you want braiding to happen.

      Reply
    • John Baez says:
      19 October, 2021 at 4:50 pm

      Theodore Kolokolnikov made some interesting comments in email, which he’s letting me post here:

      Really enjoyed your post on Kuramoto-Sivasinksy. I wanted to point out a couple of related papers, where these bumps also appear and equations are very similar. The first one is in the context of bacterial aggregation, which I worked on with my student Paul Chavy-Waddy a few years ago:

      • P-C Chavy-Waddy and T. Kolokolnikov, A local PDE model of aggregation formation in bacterial colonies, Nonlinearity 29.10 (2016), 3174.

      It leads to bumps that merge, but not new bump creation. See fig2 of that paper. PDE is very similar, with same linear terms, but instead of u_x^2 we get \left(\frac{u_x u_{xx}}{u}\right)_x. We also derive this one from first principles from cellular-automata limit (see paper). Unlike the K-S, we are able to find explicit bump-like solutions (they have the form of \mathrm{sech}(x)^p).

      A second paper is on chemotaxis model with growth. See this paper:

      • K. J. Painter and T. Hillen, Spatio-temporal chaos in a chemotaxis model, Physica D: Nonlinear Phenomena 240 (4-5), 363–375.

      Figures there look eerily similar to KS movies!

      Would love to work further on this… in fact sometime ago i made some movies of that chemotaxis model, see here:

      Also here are a buncha movies on aggregation, including stochastic original model. See here:

      • Talk on this given at SIAM PDE 2015: click here for pdf or click here for pdf plus movies (movies can be played by clicking on them from the pdf file).

      Reply
  4. John Baez says:
    20 October, 2021 at 2:19 am

    Here is a version Steve Huntsman did with L = 1280. Here time goes across the page. You can click to enlarge it. Note that the solution is close to spatially periodic until about t = 80, because the initial conditions are periodic, but then chaos starts to take over and it destroys the periodicity:


    Reply
  5. John Baez says:
    20 October, 2021 at 2:35 am

    Steve Huntsman wrote:

    I’ve updated the code and am close enough to grokking it that I believe it is correct or else there’s a Wikipedia conspiracy on the numerical integration scheme pages (since I haven’t dug into these or done Crank-Nicolson since 1998).

    Using this and running

    Lx = 128;

    Nx = 1024;

    dt = 1/16;

    Nt = 1600;

    %

    x = Lx*(0:(Nx-1))/Nx;

    u = cos(x) + 0.1*cos(x/16).*(1+2*sin(x/16));

    %

    [U,x,t] = kuramotoShivashinskyIntegrate(u,Lx,dt,Nt);

    figure;

    %

    subplot(1,2,1);

    pcolor(x,t,real(U));

    shading interp;

    xlabel(‘$x$’,’Interpreter’,’latex’);

    ylabel(‘$t$’,’Interpreter’,’latex’);

    %

    subplot(1,2,2);

    plot(sum(abs(diff(sign(real(U)),1,2)),2)/4,t,’k’);

    xlabel(‘number of stripes’,’Interpreter’,’latex’);

    ylabel(‘$t$’,’Interpreter’,’latex’);

    yields

    (Note that you can count the t = 0 and t = 100 stripes to confirm the plot on the right.) All the number of stripes counts is the zero crossings as in the blog comments. I see no reason to limit this to something “sufficiently large.”

    Reply
    • John Baez says:
      20 October, 2021 at 2:43 am

      Great! So, just eyeballing it, after the stripe count settles down to its average, we’re getting about 15 stripes when L = 128, for an average density of about 15/128 \approx 1/8.5.

      I’m predicting this stripe density approaches a constant that’s indepdent of the initial data as we time-average over longer and longer times, and that this constant in turn approaches a limit as L \to \infty.

      Reply
  6. John Baez says:
    20 October, 2021 at 3:10 am

    Steve Huntsman writes:

    Using initial conditions where the initial conditions at each grid point is IID uniform on [0,1], here’s 3 realizations:

    (There’s a new kind of symmetry breaking?) Running longer:

    Taking initial conditions cos(x)+0.1*IID uniform on [0,1]:

    Seems like the lucky number for L = 128 is ~14 stripes. I may come back to this tomorrow.

    Reply
    • John Baez says:
      20 October, 2021 at 3:21 am

      This is fascinating. Here’s the thing that may force me to change my conjectures:

      All the stripes seem to be moving to the left as time passes!

      There could be some conserved quantity like ‘momentum’ for this differential equation—conserved despite the chaos!—and if so, the inertial manifold does not contain a single attractor, but a family parametrized by momentum. If so, we can’t expect all solutions to have the same time-averaged properties. These properties can depend on the momentum.

      Or maybe something else is going on. What’s weird is that all three solutions with i.i.d. random initial conditions have stripes strongly moving to the left! That’s a real shocker.

      Reply
      • John Baez says:
        20 October, 2021 at 3:27 am

        By the way, this is related to the question of a conserved momentum. The Encyclopedia of Mathematics article writes this about the Kuramoto–Sivashinsky equation:

        Indeed, (a1) generically describes the dynamics near long-wave-length primary instabilities in the presence of appropriate (translational, parity and Galilean) symmetries.

        The translational symmetry of the equation is obvious, and if the equations come from a Lagrangian this symmetry will give a conserved momentum by Noether’s theorem. But the heat equation does not come from a Lagrangian, so it does not have a conserved momentum. I’m afraid the Kuramoto–Sivashinsky equation is similar. But I’m not sure.

        The Galilean symmetry is surprising to me. In fact it’s hard to believe. This would mean we can ‘boost’ a solution and get a new solution that’s moving relative to the original one. That’s not true of the heat equation!

        The parity symmetry makes me shocked that in so many of these solutions, all the stripes have u > 0 on the same side.

        Reply
        • domenico says:
          20 October, 2021 at 10:44 pm

          It seem that there are the attractors

          0=-h_{xx}-h_{xxxx}-h^2_x

          that are invariant functions, but I don’t find the analytic solution, only the trivial solution u=constant; but exist functions that are time invariants.
          Solutions near to the attractors should be close in the initial instants of motion.

        • John Baez says:
          21 October, 2021 at 8:30 pm

          One paper I read said there are no known analytical solutions of the closely related equation

          u_{xx} + u_{xxxx} + u_x u = 0

          except for zero of course, but they were nonetheless able to prove a lot about periodic-in-space solutions of this equation:

          • Uriel Frisch, Zhensu She and Olivier Thual, Viscoelastic behaviour of cellular solutions to the Kuramoto–Sivashinsky model, Journal of Fluid Mechanics 168 (1986), 221–240.

      • Steve Huntsman says:
        20 October, 2021 at 10:28 am

        Well IID uniform on [0,1] is different than IID on [-1,1]. My money is on that as the culprit for the “momentum”. Stay tuned this evening

        Reply
    • John Baez says:
      20 October, 2021 at 11:37 am

      Steve wrote:

      Seems like the lucky number for L = 128 is ~14 stripes.

      Earlier I had guessed ~15, just by eyeballing one of your pictures. So now we’re getting a stripe density of about 14/128 \approx 1/9.14.

      It’s not at all obvious why this should also be true of solutions where the stripes ‘slant’ a lot, as in some of your recent pictures. If the stripe density is really the same for these that seems like a nontrivial fact. But I’m quite puzzled by what’s going on in these slanted solutions.

      Reply
  7. John Baez says:
    21 October, 2021 at 9:14 pm

    Today (2021 October 21) I rewrote this blog post, correcting a bunch of errors that stemmed from me not realizing there are two different versions of the Kuramoto–Sivashinsky equation. If you care, and you read this article before today, you might like a look at the new version!

    Reply
    • arch1 says:
      23 October, 2021 at 7:59 pm

      You are so conscientious John. In fact you’re one of the people I don’t know well who ranks highest in my ‘what would the world be like if X were generically median’ ranking. (I suspect professional sports might take it in the shorts, but I might be wrong & in any case that’s a tradeoff I’m willing to make😊)

      Reply
    • John Baez says:
      24 October, 2021 at 12:04 am

      Thanks! I don’t feel especially conscientious, but when I’m enthusiastic about something I care about it a lot.

      Reply
  8. westy31 says:
    26 October, 2021 at 9:27 pm

    Inspired by your post, I constructed an electric circuit equivalent for the Kuramoto Sivashinsky equation (derivative form), as shown here:

    The R1 and R2 resistors encode the 2nd and 4th x-derivative. (The R1 are negative!). The R3 are non-linear, proportional to the gradient, or equivalently the currents in R1 and R2.

    I can recreate the stripe patterns. But by accident, I initialized a case that converges to a regular stripe pattern! Shown here:

    I used L=100, and the initial state was a sine-wave with 3 periods in L=100.

    Reply
    • westy31 says:
      26 October, 2021 at 9:37 pm

      If on the other hand I initialize with some random numbers, I get the same kind of strips as in other posts:

      Reply
    • John Baez says:
      26 October, 2021 at 10:10 pm

      Cool! For periodic boundary conditions with (spatial) period L, static stripe solutions are stable for small L, but for larger L they become unstable.

      Let’s see how easy it is to link to your tweet:

      Reply
  9. Nick Pizzo says:
    27 October, 2021 at 4:07 am

    Very fun write up! A small, possibly off-base, comment: these figures remind me of phase dislocations (Nye & Berry 1974: see also this paper: https://www.sciencedirect.com/science/article/abs/pii/0167278992900014). In the linked paper, some calculus constraining the topology of lines of constant phase can help us keep track of “wave” creation/annihilation and one can possibly estimate all kinds of useful statistical characterizations of the behavior of the stripes.

    Reply
    • John Baez says:
      27 October, 2021 at 11:21 pm

      That sounds interesting! It’s a hassle to use the VPN client to be able to read this paper, and it doesn’t seem to be free anywhere, but I’ll give it a try sometime. There is an interesting comparison of the nonlinear stabilization mechanisms in the Kuramoto–Sivashinsky and Ginzburg–Landau equations on the second page here:

      • P. Collet, J. Eckmann and J. Stubbe, A global attracting set for the Kuramoto–Sivashinsky equation, Communications in Mathematical Physics 152 (1993), 203–214.

      They explain why Kuramoto–Sivashinsky is subtler.

      Reply
  10. Quantum chaos & number theory | Where's my hat?! says:
    27 January, 2022 at 12:14 am

    […] I had a passing read over a series of posts on Azimuth starting with this one, on one of the simplest ODEs that demonstrates chaotic behaviour. The timing of this series of […]

    Reply

Leave a reply to Quantum chaos & number theory | Where's my hat?! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.