However, witnessing the rapid evolution of AI with just a few hundred GPUs, enough data, and power, I no longer wonder what a billion years of feedback loops and randomness can achieve.
A single training session will iterate more than the number of generations of all birds.
But that's not the right analogy. Evolution happens at the individual level, and even to some extent at the individual gamete level. So it's actually every single fecundated bird egg that ever existed, and even every single spermatozoon and egg cell every time two birds mated. Not to mention every division of every bacterial cell in every bird gut, since microflora are a key part of the organism too.
And even this is an undercount, since the DNA and gene expression of an individual actually changes during its lifetime, and those changes can be passed down to offspring through various mechanisms. So there is a constant process of evolution that even all cells inside a living organism go through, that we're still trying to fully understand.
That statements need a whole lot of backing. It contradicts the Central dogma of molecular biology [0]. The idea that an organism can pass on to its offspring physical characteristics that the parent organism acquired through use or disuse during its lifetime is called Lamarckism which was disproven more than a hundred years ago.
[0] https://en.wikipedia.org/wiki/Central_dogma_of_molecular_bio...
For an extremely simple example, if a female organism is exposed to significant doses of radiation, the DNA inside the egg cells it was born with will have a high chance of suffering mutations. If one of those eggs remains viable and later gets fertilized, the DNA of the offspring produced from it will be significantly different from the DNA that of offspring born before the radiation exposure.
There are other more subtle and more common processes, though. The most surprising one is that DNA methylation, a process in which environmental stimuli encountered in a living sexually mature individual affect gene expression, has been proven to be transmissible to offspring across several generations in certain species. This includes stimuli such as prolonged exposure to heat or cold, long-term starvation, and others. This is indeed a form of Lamarckism that has actually been proven to happen, though of course it involves much subtler changes than some of what Lamarck envisioned.