←back to thread

The deep learning boom caught almost everyone by surprise

(www.understandingai.org)
306 points slyall | 1 comments | 06 Nov 24 04:05 UTC | HN request time: 0s | source
Show context
kleiba ◴[06 Nov 24 12:23 UTC] No.42061089[source]▶
> “Pre-ImageNet, people did not believe in data,” Li said in a September interview at the Computer History Museum. “Everyone was working on completely different paradigms in AI with a tiny bit of data.”

That's baloney. The old ML adage "there's no data like more data" is as old as mankind itself.

replies(7): >>42061617 #>>42061818 #>>42061987 #>>42063019 #>>42063076 #>>42064875 #>>42189460 #
FrustratedMonky ◴[06 Nov 24 13:01 UTC] No.42061617[source]▶
Not really. This is referring back to the 80's. People weren't even doing 'ML'. And back then people were more focused on teasing out 'laws' in as few data points as possible. The focus was more on formulas and symbols, and finding relationships between individual data points. Not the broad patterns we take for granted today.
replies(2): >>42062250 #>>42063993 #
mistrial9 ◴[06 Nov 24 15:42 UTC] No.42063993[source]▶
mid-90s had neural nets, even a few popular science kinds of books on it. The common hardware was so much less capable then.
replies(2): >>42064954 #>>42074497 #
1. robotresearcher ◴[07 Nov 24 07:48 UTC] No.42074497[source]▶
I worked on robot control with NNs in the early-mid nineties. Maybe seven neurons and 25 edges. No layers at all. The graph and edge weights determined by a genetic algorithm. Fun.