←back to thread

Andrej Karpathy: Software in the era of AI [video]

(www.youtube.com)
1479 points sandslash | 1 comments | 19 Jun 25 00:33 UTC | HN request time: 0.211s | source
Show context
anythingworks ◴[19 Jun 25 01:51 UTC] No.44314766[source]▶
loved the analogies! Karpathy is consistently one of the clearest thinkers out there.

interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues?

noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

replies(2): >>44314822 #>>44315438 #
AlotOfReading ◴[19 Jun 25 02:06 UTC] No.44314822[source]▶
You don't "solve" autonomous driving as such. There's a long, slow grind of gradually improving things until failures become rare enough.
replies(1): >>44314866 #
petesergeant ◴[19 Jun 25 02:19 UTC] No.44314866[source]▶
I wonder at what point all the self-driving code becomes replaceable with a multimodal generalist model with the prompt “drive safely”
replies(4): >>44314937 #>>44315054 #>>44315210 #>>44316357 #
anon7000 ◴[19 Jun 25 03:34 UTC] No.44315210[source]▶
Very advanced machine learning models are used in current self driving cars. It all depends what the model is trying to accomplish. I have a hard time seeing a generalist prompt-based generative model ever beating a model specifically designed to drive cars. The models are just designed for different, specific purposes
replies(1): >>44315369 #
tshaddox ◴[19 Jun 25 04:13 UTC] No.44315369[source]▶
I could see it being the case that driving is a fairly general problem, and this models intentionally designed to be general end up doing better than models designed with the misconception that you need a very particular set of driving-specific capabilities.
replies(3): >>44315469 #>>44316063 #>>44318089 #
shakna ◴[19 Jun 25 06:36 UTC] No.44316063[source]▶
Driving is not a general problem, though. Its a contextual landscape of fast-based reactions and predictions. Both are required, and done regularly by the human element. The exact nature of every reaction, and every prediction, change vastly within the context window.

You need image processing just as much as you need scenario management, and they're orthoganol to each other, as one example.

If you want a general transport system... We do have that. It's called rail. (And can and has been automated.)

replies(2): >>44316240 #>>44318075 #
TeMPOraL ◴[19 Jun 25 12:36 UTC] No.44318075[source]▶
It partially is. You have the specialized part of maneuvering a fast moving vehicle in physical world, trying to keep it under control at all times and never colliding with anything. Then you have the general part, which is navigating the human environment. That's lanes and traffic signs and road works and schoolbuses, that's kids on the road and badly parked trailers.

Current breed of autonomous driving systems have problems with exceptional situations - but based on all I've read about so far, those are exactly of the kind that would benefit from a general system able to understand the situation it's in.

replies(1): >>44323579 #
1. tshaddox ◴[19 Jun 25 23:50 UTC] No.44323579[source]▶
Yes, that’s exactly what I meant. I’d go even further and say the hard parts of driving are the parts where you are likely better off with a general model. And it’s not just signs, construction, police stopping traffic, etc. Even just basic navigation amongst traffic seems to require a general model of the other nearby drivers. It’s important to be able to model drivers’ intentions, and also to drive your own car in a predictable manner.