←back to thread

GGML – AI at the Edge

(ggml.ai)
899 points georgehill | 1 comments | 06 Jun 23 16:50 UTC | HN request time: 1.306s | source
Show context
world2vec ◴[06 Jun 23 17:25 UTC] No.36216161[source]▶
Might be a silly question but is GGML a similar/competing library to George Hotz's tinygrad [0]?

[0] https://github.com/geohot/tinygrad

replies(2): >>36216187 #>>36218539 #
qeternity ◴[06 Jun 23 17:27 UTC] No.36216187[source]▶
No, GGML is a CPU optimized library and quantized weight format that is closely linked to his other project llama.cpp
replies(2): >>36216244 #>>36216266 #
ggerganov ◴[06 Jun 23 17:32 UTC] No.36216266[source]▶
ggml started with focus on CPU inference, but lately we have been augmenting it with GPU support. Although still in development, it already has partial CUDA, OpenCL and Metal backend support
replies(3): >>36216327 #>>36216442 #>>36219452 #
1. qeternity ◴[06 Jun 23 17:36 UTC] No.36216327[source]▶
Hi Georgi - thanks for all the work, have been following and using since the availability of Llama base layers!

Wasn’t implying it’s CPU only, just that it started as a CPU optimized library.