(github.com)

486 points dbreunig | 1 comments | 16 Oct 24 19:44 UTC | HN request time: 0.234s | source

1. piskov ◴[17 Oct 24 01:47 UTC] No.41865671[source]▶

Snapdragon touts 45 TOPS but it’s only int8.

For example Apple's m3 neural engine is mere 18 TOPS but it’s FP16.

So windows has bigger number but it’s not apple to apple comparison.

Did author test int8 performance?

AI PCs Aren't Good at AI: The CPU Beats the NPU