←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 2 comments | 21 Jan 25 19:39 UTC | HN request time: 0.516s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
Evidlo ◴[22 Jan 25 00:00 UTC] No.42786869[source]▶
I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman.

http://files.widloski.com/image10%20(1).png

http://files.widloski.com/image11.png

replies(11): >>42786904 #>>42786974 #>>42787151 #>>42787231 #>>42787781 #>>42789419 #>>42789860 #>>42794672 #>>42795730 #>>42795824 #>>42796084 #
RVuRnvbM2e ◴[22 Jan 25 00:04 UTC] No.42786904[source]▶
This is fantastic. How have your hooked up a mobile number to the llm?
replies(2): >>42786967 #>>42786993 #
Evidlo ◴[22 Jan 25 00:15 UTC] No.42786993[source]▶
Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.
replies(5): >>42787153 #>>42787356 #>>42791613 #>>42791742 #>>42793477 #
deadbabe ◴[22 Jan 25 00:31 UTC] No.42787153[source]▶
I’d love to see that. Could you simulate iMessage?
replies(2): >>42787315 #>>42787660 #
1. Evidlo ◴[22 Jan 25 00:55 UTC] No.42787315[source]▶
If you mean hook this into iMessage, I don't know. I'm willing to bet it's way harder though because Apple
replies(1): >>42790394 #
2. dambi0 ◴[22 Jan 25 08:23 UTC] No.42790394[source]▶
If you are willing to use Apple Shortcuts on iOS it’s pretty easy to add something that will be trigged when a message is received and can call out to a service or even use SSH to do something with the contents, including replying