←back to thread

182 points BUFU | 1 comments | | HN request time: 0.209s | source
Show context
Patrick_Devine ◴[] No.42070613[source]
This was a pretty heavy lift for us to get out which was why it took a while. In addition to writing new image processing routines, a vision encoder, and doing cross attention, we also ended up re-architecting the way the models get run by the scheduler. We'll have a technical blog post soon about all the stuff that ended up changing.
replies(4): >>42070644 #>>42071917 #>>42072723 #>>42076774 #
1. jjice ◴[] No.42076774[source]
Y'all did a fantastic job! This works great and to have it all right there inside of Ollama is a huge step for local model execution.