←back to thread

AI should only run as fast as we can catch up

(higashi.blog)
196 points yuedongze | 1 comments | 08 Dec 25 17:38 UTC | HN request time: 0s | source
Show context
gradus_ad ◴[08 Dec 25 17:51 UTC] No.46195373[source]▶
The proliferation of nondeterministically generated code is here to stay. Part of our response must be more dynamic, more comprehensive and more realistic workload simulation and testing frameworks.
replies(5): >>46195431 #>>46195733 #>>46197437 #>>46197956 #>>46199307 #
wasmainiac ◴[08 Dec 25 20:46 UTC] No.46197437[source]▶
Code has always been nondetermistic. Which engineer wrote it? What was their past experience? This just feels like we are accepting subpar quality because we have no good way to ensure the code we generate is reasonable that wont mayyyybe rm-rf our server as a fun easter egg.
replies(1): >>46198281 #
mort96 ◴[08 Dec 25 22:05 UTC] No.46198281[source]▶
Code written by humans has always been nondeterministic, but generated code has always been deterministic before now. Dealing with nondeterministically generated code is new.
replies(2): >>46199734 #>>46221999 #
1. wasmainiac ◴[10 Dec 25 19:02 UTC] No.46221999[source]▶
> generated code has always been deterministic

Technically you are right… but in principle no. Ask an LLM any reasonably complex task and you will get different results. This is because the mode changes periodically and we have no control over the host systems source of entropy. It’s effectively non deterministic.