←back to thread

137 points BUFU | 1 comments | | HN request time: 0.21s | source
Show context
Patrick_Devine ◴[] No.42070613[source]
This was a pretty heavy lift for us to get out which was why it took a while. In addition to writing new image processing routines, a vision encoder, and doing cross attention, we also ended up re-architecting the way the models get run by the scheduler. We'll have a technical blog post soon about all the stuff that ended up changing.
replies(3): >>42070644 #>>42071917 #>>42072723 #
1. zozbot234 ◴[] No.42071917[source]
How long until Vulkan Compute support is merged into ollama? There is an active pull request at https://github.com/ollama/ollama/pull/5059 but it seems to be stalled with no reviews.