←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 5 comments | 21 Jan 25 19:39 UTC | HN request time: 1.317s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
1. mritchie712 ◴[21 Jan 25 21:51 UTC] No.42785570[source]▶
I used local LLMs via Ollama for generating H1's / marketing copy.

1. Create several different personas

2. Generate a ton of variation using a high temperature

3. Compare the variagtions head-to-head using the LLM to get a win / loss ratio

The best ones can be quite good.

0 - https://www.definite.app/blog/overkillm

replies(2): >>42788292 #>>42790343 #
2. UltraSane ◴[22 Jan 25 02:43 UTC] No.42788292[source]▶
clever name!
3. Mashimo ◴[22 Jan 25 08:14 UTC] No.42790343[source]▶
What is an H1?
replies(2): >>42791163 #>>42791221 #
4. TachyonicBytes ◴[22 Jan 25 10:13 UTC] No.42791163[source]▶
Not the OP, but they are "Headers". Probably coming from the <h1> tag in html. What outsiders probably call "Headlines".
5. laristine ◴[22 Jan 25 10:23 UTC] No.42791221[source]▶
Main heading of an article