←back to thread

Speeding up PyTorch inference on Apple devices with AI-generated Metal kernels

(gimletlabs.ai)
186 points nserrino | 3 comments | 03 Sep 25 17:03 UTC | HN request time: 0.004s | source
Show context
nikolayasdf123 ◴[03 Sep 25 19:19 UTC] No.45119495[source]▶
> non 100% correctness of kernels

wouldn't model not work properly if kernels are even slightly off?

wasn't kernels a part of training stack for models? am I missing anything?

replies(2): >>45119795 #>>45120966 #
1. ymsodev ◴[03 Sep 25 19:56 UTC] No.45119795[source]▶
The article is referring to GPU compute kernel (https://en.wikipedia.org/wiki/Compute_kernel), not the term kernel used in ML/NN/etc.
replies(1): >>45124876 #
2. saagarjha ◴[04 Sep 25 08:09 UTC] No.45124876[source]▶
…aren't they the same thing
replies(1): >>45143386 #
3. ymsodev ◴[05 Sep 25 20:45 UTC] No.45143386[source]▶
They're not, but I also misunderstood the original question, they're referring to the correct definition of kernel. I thought they were confusing the GPU kernel with https://en.wikipedia.org/wiki/Kernel_method or https://en.wikipedia.org/wiki/Kernel_(image_processing)