←back to thread

899 points georgehill | 2 comments | | HN request time: 0.433s | source
Show context
Tan-Aki ◴[] No.36222313[source]
Can anyone explain to me, in simple terms, and at a high level, what the heck am I looking at? What is this library for? What does it mean "it is used by lama.cpp and whisper.cpp"? How is it revolutionary? Thank you very much in advance!
replies(3): >>36222346 #>>36222597 #>>36225600 #
1. orost ◴[] No.36222597[source]
ggml is a library that provides operations for running machine learning models

llama.cpp is a project that uses ggml to run LLaMA, a large language model (like GPT) by Meta

whisper.cpp is a project that uses ggml to run Whisper, a speech recognition model by OpenAI

ggml's distinguishing feature is efficient operation on CPU. Traditionally, this sort of work is done on GPU, but GPUs with large amounts of memory are specialized and extremely expensive hardware. ggml achieves acceptable speed on commodity hardware.

replies(1): >>36225610 #
2. Tan-Aki ◴[] No.36225610[source]
Thank you so much for your kindness Orost. Sharing really IS caring. I understand.

May good things happen to you. Peace.