←back to thread

Andrej Karpathy: Software in the era of AI [video]

(www.youtube.com)
1479 points sandslash | 1 comments | 19 Jun 25 00:33 UTC | HN request time: 0.211s | source
Show context
benob ◴[19 Jun 25 07:17 UTC] No.44316289[source]▶
You can generate 1.0 programs with 3.0 programs. But can you generate 2.0 programs the same way?
replies(1): >>44316503 #
olmo23 ◴[19 Jun 25 08:07 UTC] No.44316503[source]▶
2.0 programs (model weights) are created by running 1.0 programs (training runs).

I don't think it's currently possible to ask a model to generate the weights for a model.

replies(1): >>44316919 #
1. movedx01 ◴[19 Jun 25 09:30 UTC] No.44316919[source]▶
But you can generate synthetic data using a 3.0 program to train a smaller, faster, cheaper-to-run 2.0 program.