←back to thread

The deep learning boom caught almost everyone by surprise

(www.understandingai.org)
251 points slyall | 1 comments | 06 Nov 24 04:05 UTC | HN request time: 0s | source
Show context
hyperific ◴[06 Nov 24 19:26 UTC] No.42067859[source]▶
The article mentions Support Vector Machines being the hot topic in 2008. Is anyone still using/researching these?

I often wonder how many useful technologies could exist if trends went a different way. Where would we be if neural nets hadn't caught on and SVMs and expert systems had.

replies(3): >>42068207 #>>42071734 #>>42072615 #
1. Legend2440 ◴[07 Nov 24 02:19 UTC] No.42072615[source]▶
Expert systems did catch on and do see widespread use - they're just not called AI anymore. It's 'business logic' or 'rules engine' now.

The issue with SVMs is that they get intractably expensive for large datasets. The cost of training a neural network scales linearly with dataset size, while the kernel trick for SVMs scales with dataset size squared. You could never create an LLM-sized SVM.