## Algorithmic Thermodynamics (Part 3)

This is my talk for the Santa Fe Institute workshop on Statistical Mechanics, Information Processing and Biology:

It’s about the link between computation and entropy. I take the idea of a Turing machine for granted, but starting with that I explain recursive functions, the Church-Turing thesis, Kolomogorov complexity, the relation between Kolmogorov complexity and Shannon entropy, the uncomputability of Kolmogorov complexity, the ‘complexity barrier’, Levin’s computable version of complexity, and finally my work with Mike Stay on algorithmic thermodynamics.

In my talk slides I mention the ‘complexity barrier’, and state this theorem:

Theorem. Choose your favorite set of axioms for math. If it’s finite and consistent, there exists C ≥ 0, the complexity barrier, such that for no natural number n can you prove the Kolmogorov complexity of n exceeds C.

For a sketch of the proof of this result, go here:

In my talk I showed a movie related to this: an animated video created in 2009 using a program less than 4 kilobytes long that runs on a Windows XP machine:

### For more

For more details, read our paper:

• John Baez and Mike Stay, Algorithmic thermodynamics, Math. Struct. Comp. Sci. 22 (2012), 771-787.

or these blog articles:

They all emphasize slightly different aspects!

### 4 Responses to Algorithmic Thermodynamics (Part 3)

1. The link to the talk doesn’t seem to work. I get a 404 error.

• looks like it’s working now

• John Baez says:

Sorry, some screwups… should be fixed now.

2. domenico says:

There are interesting theories, and articles.
I wonder if it exist a numerical simulation of the a computation algorithmic thermodynamic with an ensemble of short Turing machines.
I am thinking that some system, like the Ising model, have a two state string in a three dimensional structure (so that I understand the connection between string length and a function of volume, and the energy function like a step by step energy reduction in the time); so that if one consider some system like a calculus system (different from a Turing machine, but which it can be simulated by a Turing machine) then some systems can be a real algorithmic thermodynamics.

This site uses Akismet to reduce spam. Learn how your comment data is processed.