←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 1 comments | 21 Jan 25 19:39 UTC | HN request time: 0.206s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
gpm ◴[22 Jan 25 03:34 UTC] No.42788651[source]▶
I made a shell alias to translate things from French to English, does that count?

    function trans
        llm "Translate \"$argv\" from French to English please"
    end
Llama 3.2:3b is a fine French-English dictionary IMHO.
replies(1): >>42790203 #
kreyenborgi ◴[22 Jan 25 07:52 UTC] No.42790203[source]▶
Is it better than translatelocally? https://translatelocally.com/downloads/ (the same as used in firefox)
replies(1): >>42793534 #
1. gpm ◴[22 Jan 25 15:02 UTC] No.42793534[source]▶
It's different. It doesn't always just give one translation but different options. I can do things like give it a phrase and then ask it to break it down. Or give it a word and if its translation doesn't make sense to me ask how it works in the context of a phrase.

llm -c, which continues the previous conversation, is specifically useful for that sort of manipulation.

It's also available from the command line, which I find convenient because I basically always have one open.