←back to thread

AI PCs Aren't Good at AI: The CPU Beats the NPU

(github.com)
486 points dbreunig | 7 comments | 16 Oct 24 19:44 UTC | HN request time: 0.614s | source | bottom
1. tromp ◴[16 Oct 24 20:21 UTC] No.41863436[source]▶
> the 45 trillion operations per second that’s listed in the specs

Such a spec should be ideally be accompanied by code demonstrating or approximating the claimed performance. I can't imagine a sports car advertising a 0-100km/h spec of 2.0 seconds where a user is unable to get below 5 seconds.

replies(3): >>41863444 #>>41863452 #>>41864522 #
2. ◴[16 Oct 24 20:22 UTC] No.41863444[source]▶
3. dmitrygr ◴[16 Oct 24 20:23 UTC] No.41863452[source]▶
most likely multiplying the same 128x128 matrix from cache to cache. That gets you perfect MAC utilization with no need to hit memory. Gets you a big number that is not directly a lie - that perf IS attainable, on a useless synthetic benchmark
replies(1): >>41863655 #
4. kmeisthax ◴[16 Oct 24 20:42 UTC] No.41863655[source]▶
Sounds great for RNNs! /s
5. tedunangst ◴[16 Oct 24 22:32 UTC] No.41864522[source]▶
I have some bad news for you regarding how car acceleration is measured.
replies(1): >>41865349 #
6. otterley ◴[17 Oct 24 00:45 UTC] No.41865349[source]▶
Well, what is it?
replies(1): >>41865985 #
7. ukuina ◴[17 Oct 24 02:48 UTC] No.41865985{3}[source]▶
Everything from rolling starts to perfect road conditions and specific tires, I suppose.