←back to thread

Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete

(www.newsweek.com)
124 points alphadelphi | 1 comments | 02 Apr 25 22:59 UTC | HN request time: 0.213s | source
Show context
gsf_emergency_2 ◴[05 Apr 25 15:45 UTC] No.43594330[source]▶
Recent talk: https://www.youtube.com/watch?v=ETZfkkv6V7Y

LeCun, "Mathematical Obstacles on the Way to Human-Level AI"

Slide (Why autoregressive models suck)

https://xcancel.com/ravi_mohan/status/1906612309880930641

replies(3): >>43594385 #>>43594491 #>>43594527 #
hatefulmoron ◴[05 Apr 25 16:09 UTC] No.43594491[source]▶
Maybe someone can explain it to me, but isn't that slide sort of just describing what makes solving problems hard in general? That there are many more decisions which put you on an inevitable path of failure?

"Probability e that any produced [choice] takes us outside the set of correct answers .. probability that answer of length n is correct: P(correct) = (1-e)^{n}"

replies(2): >>43594606 #>>43594957 #
1. conradev ◴[05 Apr 25 16:26 UTC] No.43594606[source]▶
The routing decision that an MoE model makes increases its chances of success by constraining its future paths.