I wrote a paper that summarizes my work connecting natural selection to information theory:
• John Baez, The fundamental theorem of natural selection.
Check it out! If you have any questions or see any mistakes, please let me know.
Just for fun, here’s the abstract and introduction.
Abstract. Suppose we have n different types of self-replicating entity, with the population of the ith type changing at a rate equal to times the fitness of that type. Suppose the fitness is any continuous function of all the populations . Let be the fraction of replicators that are of the ith type. Then is a time-dependent probability distribution, and we prove that its speed as measured by the Fisher information metric equals the variance in fitness. In rough terms, this says that the speed at which information is updated through natural selection equals the variance in fitness. This result can be seen as a modified version of Fisher’s fundamental theorem of natural selection. We compare it to Fisher’s original result as interpreted by Price, Ewens and Edwards.
In 1930, Fisher stated his “fundamental theorem of natural selection” as follows:
The rate of increase in fitness of any organism at any time is equal to its genetic variance in fitness at that time
Some tried to make this statement precise as follows:
The time derivative of the mean fitness of a population equals the variance of its fitness.
But this is only true under very restrictive conditions, so a controversy was ignited.
An interesting resolution was proposed by Price, and later amplified by Ewens and Edwards. We can formalize their idea as follows. Suppose we have n types of self-replicating entity, and idealize the population of the ith type as a real-valued function . Suppose
where the fitness is a differentiable function of the populations of every type of replicator. The mean fitness at time is
where is the fraction of replicators of the ith type:
By the product rule, the rate of change of the mean fitness is the sum of two terms:
The first of these two terms equals the variance of the fitness at time t. We give the easy proof in Theorem 1. Unfortunately, the conceptual significance of this first term is much less clear than that of the total rate of change of mean fitness. Ewens concluded that “the theorem does not provide the substantial biological statement that Fisher claimed”.
But there is another way out, based on an idea Fisher himself introduced in 1922: Fisher information. Fisher information gives rise to a Riemannian metric on the space of probability distributions on a finite set, called the ‘Fisher information metric’—or in the context of evolutionary game theory, the ‘Shahshahani metric’. Using this metric we can define the speed at which a time-dependent probability distribution changes with time. We call this its ‘Fisher speed’. Under just the assumptions already stated, we prove in Theorem 2 that the Fisher speed of the probability distribution
is the variance of the fitness at time t.
As explained by Harper, natural selection can be thought of as a learning process, and studied using ideas from information geometry—that is, the geometry of the space of probability distributions. As changes with time, the rate at which information is updated is closely connected to its Fisher speed. Thus, our revised version of the fundamental theorem of natural selection can be loosely stated as follows:
As a population changes with time, the rate at which information is updated equals the variance of fitness.
The precise statement, with all the hypotheses, is in Theorem 2. But one lesson is this: variance in fitness may not cause ‘progress’ in the sense of increased mean fitness, but it does cause change!
For more details in a user-friendly blog format, read the whole series:
• Part 1: the obscurity of Fisher’s original paper.
• Part 2: a precise statement of Fisher’s fundamental theorem of natural selection, and conditions under which it holds.
• Part 3: a modified version of the fundamental theorem of natural selection, which holds much more generally.
• Part 4: my paper on the fundamental theorem of natural selection.