←back to thread

Andrej Karpathy: Software in the era of AI [video]

(www.youtube.com)
1480 points sandslash | 1 comments | 19 Jun 25 00:33 UTC | HN request time: 0.206s | source
Show context
OJFord ◴[20 Jun 25 02:08 UTC] No.44324130[source]▶
I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly.

    def __main__:
        You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0.
        Should you be unable to do this, you print an explanation to stderr and exit 1.
(and then, perhaps, a bunch of 'DO NOT express amusement when the result is 5318008', etc.)
replies(10): >>44324398 #>>44324762 #>>44325091 #>>44325404 #>>44325767 #>>44327171 #>>44327549 #>>44328699 #>>44328876 #>>44329436 #
aaron695[dead post] ◴[20 Jun 25 07:14 UTC] No.44325404[source]▶
[flagged]
1. diggan ◴[20 Jun 25 10:47 UTC] No.44326489[source]▶
> It makes no sense at all, it's cuckooland, are you all on crazy pills?

First step towards understanding something you obviously have strong feelings about, is to try to avoid hitting those triggers while you think about the thing, otherwise it clouds you. Not a requirement by any measure, just a tip.

> are you telling me people will do three years university to learn to prompt?

Are people going to university for three years to write "1.0" or "2.0" software? I certainly didn't, and I don't think even the majority of software developers have done so, at least in my personal experience but YMMV.

> I do not understand where there is anything here to be "not sure" on?

They're not sure about the specific naming, not the concept or talk as a whole.

> LLMs making non-deterministic mistakes

Everything they do is non-deterministic when temperature is set to anything above 0.0, as that's the entire point. The "correct" answers are as non-deterministic as the "mistakes", although I'm not sure "mistake" is correct because it did chose the right/correct tokens, it's just that you didn't like/expect it to chose that particular tokens.