←back to thread

GGML – AI at the Edge

(ggml.ai)
899 points georgehill | 1 comments | 06 Jun 23 16:50 UTC | HN request time: 0.686s | source
Show context
yukIttEft ◴[06 Jun 23 17:39 UTC] No.36216376[source]▶
Its graph execution is still full of busyloops, e.g.:

https://github.com/ggerganov/llama.cpp/blob/44f906e8537fcec9...

I wonder how much more efficient it would be when Taskflow lib was used instead, or even inteltbb.

replies(4): >>36217006 #>>36217540 #>>36217840 #>>36218226 #
mhh__ ◴[06 Jun 23 19:51 UTC] No.36218226[source]▶
It's not a very good library IMO.
replies(1): >>36224140 #
1. dindresto ◴[07 Jun 23 07:56 UTC] No.36224140[source]▶
ggml or Intel TBB?