←back to thread

486 points dbreunig | 1 comments | | HN request time: 0.199s | source
Show context
m00x ◴[] No.41864797[source]
NPUs are efficient, not especially fast. The CPU is much bigger than the NPU and has better cache access. Of course it'll perform better.
replies(2): >>41865195 #>>41870736 #
1. llm_nerd ◴[] No.41870736[source]
NPUs are actually incredibly fast for standard inference operations.

This benchmark is horribly flawed in many ways, and was so evidently useless that I'm surprised that they still decided to "publish" this. When your test gets 1% of the published performance, it's a good indication that things aren't being done correctly.