←back to thread

GGML – AI at the Edge

(ggml.ai)
899 points georgehill | 3 comments | 06 Jun 23 16:50 UTC | HN request time: 1.859s | source
1. noman-land ◴[07 Jun 23 04:14 UTC] No.36222742[source]▶
Georgi if you're reading this, I've had a lot of fun with whisper.cpp llama.cpp because of you so thank you very much.
replies(1): >>36224059 #
2. hanselot ◴[07 Jun 23 07:45 UTC] No.36224059[source]▶
I envy his drive and ambition. I can't force myself to finish writing a simple alarm clock app for android, never mind pathing the literal road to the future of Open Source AI.

Would someone else have taken his place had he not been around? Maybe, but I'm insanely happy that he is around.

The amount of hours I've sunk into LLM's is crazy, and it's mostly thanks to his work that I can both run and download models in meaningful timeframes.

And yes, I have tested llama.cpp on my android and it works 100% on termux. (Your biggest enemy here will be Android process reaper when you hit the memory cap)

replies(1): >>36377964 #
3. ffvvtvtbyh ◴[18 Jun 23 06:57 UTC] No.36377964[source]▶
Keen to work together. I also struggle with follow through