←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 2 comments | 21 Jan 25 19:39 UTC | HN request time: 1.227s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
Evidlo ◴[22 Jan 25 00:00 UTC] No.42786869[source]▶
I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman.

http://files.widloski.com/image10%20(1).png

http://files.widloski.com/image11.png

replies(11): >>42786904 #>>42786974 #>>42787151 #>>42787231 #>>42787781 #>>42789419 #>>42789860 #>>42794672 #>>42795730 #>>42795824 #>>42796084 #
1. zx8080 ◴[22 Jan 25 00:12 UTC] No.42786974[source]▶
Cool! Do you consider the risk of unintentional (and until some moment, an unknown) subscription to some paid SMS service and how do you mitigate it?
replies(1): >>42787017 #
2. Evidlo ◴[22 Jan 25 00:18 UTC] No.42787017[source]▶
I have to whitelist a conversation before the LLM can respond.