←back to thread

343 points LorenDB | 1 comments | | HN request time: 0.21s | source
Show context
newusertoday ◴[] No.44001807[source]
why does ollama engine has to change to support new models? every time a new model comes ollama has to be upgraded.
replies(1): >>44001834 #
nkwaml ◴[] No.44001834[source]
Because of things like this: https://github.com/ggml-org/llama.cpp/issues/12637

Where "supporting" a model doesn't mean what you think it means for cpp

Between that and the long saga with vision models having only partial support, with a CLI tool, and no llama-server support (they only fixed all that very recently) the fact of the matter is that ollama is moving faster and implementing what people want before lama.cpp now

And it will finally shut down all the people who kept copy pasting the same criticism of ollama "it's just a llama.cpp wrapper why are you not using cpp instead"

replies(2): >>44001901 #>>44002040 #
Maxious ◴[] No.44001901[source]
There's also some interpersonal conflict in llama.cpp that's hampering other bug fixes https://github.com/ikawrakow/ik_llama.cpp/pull/400
replies(1): >>44007006 #
kergonath ◴[] No.44007006[source]
What the hell is going on there? It’s utterly bizarre to see devs discussing granting each other licences to work on the same code for an open source project. How on earth did they end up there?
replies(2): >>44008119 #>>44008366 #
Philpax ◴[] No.44008119[source]
There seems to be some bad blood between ikawrakow and ggerganov: https://github.com/ikawrakow/ik_llama.cpp/discussions/316
replies(1): >>44011036 #
1. tough ◴[] No.44011036[source]
But he's talking about a MIT License!

WTF