Here are two talks on the categorical semantics of entropy, given on Wednesday May 11th 2022 at CUNY. First one there’s one by me and then starting around 1:31:00 there’s one by Tai-Danae Bradley:

My talk is called “Shannon entropy from category theory”:

Shannon entropy is a powerful concept. But what properties single out Shannon entropy as special? Instead of focusing on the entropy of a probability measure on a finite set, it can help to focus on the “information loss”, or change in entropy, associated with a measure-preserving function. Shannon entropy then gives the only concept of information loss that is functorial, convex-linear and continuous. This is joint work with Tom Leinster and Tobias Fritz.

Tai-Danae Bradley’s is called “Operads and entropy”:

This talk will open with a basic introduction to operads and their representations, with the main example being the operad of probabilities. I’ll then give a light sketch of how this framework leads to a small, but interesting, connection between information theory, abstract algebra, and topology, namely a correspondence between Shannon entropy and derivations of the operad of probabilities.

This entry was posted on Saturday, May 28th, 2022 at 6:24 am and is filed under information and entropy. You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.

5 Responses to Tutorial on Categorical Semantics of Entropy

I still think back sometimes on our conversation about drought vs. floods in a hotter world. We’re having serious droughts in the western US, but floods quite often in the east.

A CSIRO climate report said that air can hold 7% more water for every degree of warming. But climate change affects different places differently, and some will be drier. There are claims that climate models show where it will be drier. They say southern Australia will be drier. We’ve had 2 very wet years after 9 years of drought. I wonder how much of a handle they have on the climate. Lake sediments show that 500 years ago Eastern Australia had a drought that lasted 80 years.

Thanks! The ability for hot air to hold more water is a double-edged sword: it also means that the soil gets more dried out in hot weather. We see that a lot in here in the deserts of Southern California.

You can use Markdown or HTML in your comments. You can also use LaTeX, like this: $latex E = m c^2 $. The word 'latex' comes right after the first dollar sign, with a space after it. Cancel reply

You need the word 'latex' right after the first dollar sign, and it needs a space after it. Double dollar signs don't work, and other limitations apply, some described here. You can't preview comments here, but I'm happy to fix errors.

I’m giving my talk again on Thursday, June 16th, at 18:00 Lisbon time, which is 17:00 UTC or 10:00 in California:

• Shannon entropy from category theory, Lisbon Webinar on Mathematics, Physics and Machine Learning.

The link here is a Zoom link which will work when the talk actually starts.

June 16th

Thanks—fixed!

I still think back sometimes on our conversation about drought vs. floods in a hotter world. We’re having serious droughts in the western US, but floods quite often in the east.

A CSIRO climate report said that air can hold 7% more water for every degree of warming. But climate change affects different places differently, and some will be drier. There are claims that climate models show where it will be drier. They say southern Australia will be drier. We’ve had 2 very wet years after 9 years of drought. I wonder how much of a handle they have on the climate. Lake sediments show that 500 years ago Eastern Australia had a drought that lasted 80 years.

Thanks! The ability for hot air to hold more water is a double-edged sword: it also means that the soil gets more dried out in hot weather. We see that a lot in here in the deserts of Southern California.