←back to thread

AI agents: Less capability, more reliability, please

(www.sergey.fyi)
423 points serjester | 1 comments | 31 Mar 25 14:45 UTC | HN request time: 0.252s | source
Show context
ramesh31 ◴[31 Mar 25 15:19 UTC] No.43536049[source]▶
More capability, less reliability please. I want something that can achieve superhuman results 1 out of 10 times, not something that gives mediocre human results 9 out of 10 times.

All of reality is probabilistic. Expecting that to map deterministically to solving open ended complex problems is absurd. It's vectors all the way down.

replies(5): >>43536239 #>>43536358 #>>43536391 #>>43537262 #>>43537360 #
soulofmischief ◴[31 Mar 25 15:35 UTC] No.43536239[source]▶
Stability is the bedrock of the evolution of stable systems. LLMs will not democratize software until an average person can get consistently decent and useful results without needing to be a senior engineer capable of a thorough audit.
replies(1): >>43536325 #
ramesh31 ◴[31 Mar 25 15:42 UTC] No.43536325[source]▶
>Stability is the bedrock of the evolution of stable systems.

So we also thought with AI in general, and spent decades toiling on rules based systems. Until interpretability was thrown out the window and we just started letting deep learning algorithms run wild with endless compute, and looked at the actual results. This will be very similar.

replies(3): >>43537298 #>>43537320 #>>43537703 #
1. skydhash ◴[31 Mar 25 17:10 UTC] No.43537298[source]▶
Rules based systems are quite useful, not for interacting with an untrained human, but for getting things done. Deep learning can be good at exploring the edges of a problem space, but when a solution is found, we can actually get to the doing part.