←back to thread

387 points reaperducer | 3 comments | | HN request time: 0.686s | source
Show context
SubiculumCode ◴[] No.45772210[source]
Given that AI is a national security matter now, I'd expect the U.S.A to step in and rescue certain companies in the event of a crash. However, I'd give higher chances to NVIDIA than OpenAI. Weights are easily transferrable and the expertise is in the engineers, but ability to continue making advanced chips is not as easily transferred.
replies(4): >>45772241 #>>45772328 #>>45772343 #>>45772651 #
embedding-shape ◴[] No.45772241[source]
Why is ML knowledge "in the engineers" while chip manufacturing apparently sits in the company/hardware/something else than the engineers/humans?
replies(6): >>45772325 #>>45772346 #>>45772355 #>>45772369 #>>45772507 #>>45772729 #
bob1029 ◴[] No.45772355[source]
One person can implement a transformer model from scratch in a weekend. Hardware is not the valuable part of machine learning. Data and how it is used are.

The "magic of AI" doesn't live inside an Nvidia GPU. There are billions of dollars of marketing being deployed to convince you it does. As soon as the market realizes that nvidia != magic AI box, the music should stop pretty quickly.

replies(2): >>45772397 #>>45772784 #
1. tehjoker ◴[] No.45772397[source]
That's true, but without the kind of horsepower provided by modern hardware, even though I'm skeptical that it's all needed, especially given DeepSeek's amazing results, AI would be nearly impossible.

There are some important innovations on the algorithm / network structure side, but all these ideas are only able to be tried because the hardware supports it. This stuff has been around for decades.

replies(1): >>45772790 #
2. chermi ◴[] No.45772790[source]
Deepseek required existing models that required the horsepower.
replies(1): >>45777027 #
3. tehjoker ◴[] No.45777027[source]
That was claimed but never proven. I personally don't believe the American companies making this claim. I suspect they made this up to protect their valuations when they were hideously embarassed and lost a trillion dollars in equity.