AI PCs Aren't Good at AI: The CPU Beats the NPU

The RTX 4080 should be capable of ~40 TFLOPS, yet they only report 2,160 billion operations per second. Shouldn't this be enough to reconsider the benchmark? They probably made some serious error in measuring FLOPS. Regarding the fact that CPU beats NPU is possible but they should benchmark many matrix multiplications without any application synchronization in order to have a decent comparison.

That isnt the half of it. A quick skim of the documentation shows that the cpu inference wasnt done in a comparable way either.