(ggml.ai)

1. yukIttEft ◴[06 Jun 23 17:39 UTC] No.36216376[source]▶

Its graph execution is still full of busyloops, e.g.:

I wonder how much more efficient it would be when Taskflow lib was used instead, or even inteltbb.

2. moffkalast ◴[06 Jun 23 18:22 UTC] No.36217006[source]▶

Someone ought to be along with a PR eventually.

3. boywitharupee ◴[06 Jun 23 19:03 UTC] No.36217540[source]▶

is graph execution used for training only or inference also?

replies(1): >>36217851 #

4. make3 ◴[06 Jun 23 19:23 UTC] No.36217840[source]▶

does tbb work with apple Silicon?

replies(1): >>36217968 #

5. LoganDark ◴[06 Jun 23 19:24 UTC] No.36217851[source]▶

Inference. It's a big bottleneck for RWKV.cpp, second only to the matrix multiplies.

6. yukIttEft ◴[06 Jun 23 19:32 UTC] No.36217968[source]▶

7. mhh__ ◴[06 Jun 23 19:51 UTC] No.36218226[source]▶

It's not a very good library IMO.

replies(1): >>36224140 #

8. dindresto ◴[07 Jun 23 07:56 UTC] No.36224140[source]▶

ggml or Intel TBB?

GGML – AI at the Edge