←back to thread

684 points prettyblocks | 2 comments | | HN request time: 0.422s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
1. mrmage ◴[] No.42808082[source]
I am building GitHub-Copilot style AI autocomplete in any text field on your Mac. The point is to have the AI fill in all the redundant words required by human language, while you provide the entropy (i.e. the words that are unique to what you are trying to express). It is kind of a "dance" between accepting the AI's suggested words and typing yourself to keep it going in the right direction.

Using it, I find myself often writing only the first half of most words, because the second part can usually already be guessed by the AI. In fact, it has a dedicated shortcut for accepting only the first word of the suggestion — that way, it can save you some typing even when later words deviate from your original intent.

Completions are generated in real-time locally on your Mac using a variety of models (primarily Qwen 2.5 1.5B).

It is currently in open beta: https://cotypist.app

replies(1): >>42839984 #
2. smcleod ◴[] No.42839984[source]
Can vouch for cotypist - it's great!