Distributed systems programming has stalled

The author is missing information about LLMs. In the "Obligatory LLM Section" he focuses on distributed systems that use LLMs.

But almost all of the new innovation I'm familiar with in distributed systems is about training LLMs. I wouldn't say the programming techniques are "new" in the way this post is describing them, but the specifics are pretty different from building a database or data pipeline engine (less message oriented, more heavily pipelined, more low level programming, etc)

> But almost all of the new innovation I'm familiar with in distributed systems is about training LLMs

I think database space is still hot topic with many unsolved problems.