684 points prettyblocks | 1 comments | 21 Jan 25 19:39 UTC | HN request time: 0s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?

Show context

mritchie712 ◴[21 Jan 25 21:51 UTC] No.42785570[source]▶

>>42784365 (OP) #

I used local LLMs via Ollama for generating H1's / marketing copy.

1. Create several different personas

2. Generate a ton of variation using a high temperature

3. Compare the variagtions head-to-head using the LLM to get a win / loss ratio

The best ones can be quite good.

0 - https://www.definite.app/blog/overkillm

replies(2): >>42788292 #>>42790343 #

1. UltraSane ◴[22 Jan 25 02:43 UTC] No.42788292[source]▶

>>42785570 #

clever name!

↑

Ask HN: Is anyone doing anything cool with tiny language models?