Andrej Karpathy: Software in the era of AI [video]

I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly.

    def __main__:
        You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0.
        Should you be unable to do this, you print an explanation to stderr and exit 1.

(and then, perhaps, a bunch of 'DO NOT express amusement when the result is 5318008', etc.)

I wonder when companies will remove the personality out of LLMs by default, especially for tools

that would require actually curating the training data and eliminating sources that contain casual conversation

too expensive since those are all licensed sources, much easier to train on Reddit data

Just ask an LLM to remove the personality from the training data. Then train a new LLM on that.