←back to thread

Multiplatform Matrix Multiplication Kernels

(burn.dev)
80 points homarp | 2 comments | 18 Jul 25 19:59 UTC | HN request time: 1.419s | source
Show context
semessier ◴[19 Jul 25 01:04 UTC] No.44611583[source]▶
I had bet that matmult would be in transformer-optimized hardware costing a fraction of GPUs first class in torch 2 years ago with no reason to use GPUs any more. Wrong.
replies(2): >>44611628 #>>44613343 #
almostgotcaught ◴[19 Jul 25 01:12 UTC] No.44611628[source]▶
> matmult would be in transformer-optimized hardware

It is... it's in GPUs lol

> first class in torch

It is

> costing a fraction of GPUs

Why would anyone give you this for cheaper than GPUs lol?

replies(1): >>44611975 #
1. atty ◴[19 Jul 25 02:18 UTC] No.44611975[source]▶
I think they’re referring to hardware like TPUs and other ASICs. Which also exist, of course :)
replies(1): >>44612010 #
2. almostgotcaught ◴[19 Jul 25 02:24 UTC] No.44612010[source]▶
Sure but GPUs literally have MMA engines now