←back to thread

1045 points mfiguiere | 1 comments | | HN request time: 1.37s | source
Show context
codedokode ◴[] No.39351226[source]
As I understand, Vulkan allows to run custom code on GPU, including the code to multiply matrices. Can one simply use Vulkan and ignore CUDA, PyTorch and ROCm?
replies(5): >>39352478 #>>39353773 #>>39354188 #>>39354540 #>>39355589 #
1. 0xDEADFED5 ◴[] No.39354540[source]
there's a pretty cool Vulkan LLM engine here for example:

https://github.com/mlc-ai/mlc-llm