←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 5 comments | 21 Jan 25 19:39 UTC | HN request time: 0.749s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
Evidlo ◴[22 Jan 25 00:00 UTC] No.42786869[source]▶
I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman.

http://files.widloski.com/image10%20(1).png

http://files.widloski.com/image11.png

replies(11): >>42786904 #>>42786974 #>>42787151 #>>42787231 #>>42787781 #>>42789419 #>>42789860 #>>42794672 #>>42795730 #>>42795824 #>>42796084 #
RVuRnvbM2e ◴[22 Jan 25 00:04 UTC] No.42786904[source]▶
This is fantastic. How have your hooked up a mobile number to the llm?
replies(2): >>42786967 #>>42786993 #
Evidlo ◴[22 Jan 25 00:15 UTC] No.42786993[source]▶
Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.
replies(5): >>42787153 #>>42787356 #>>42791613 #>>42791742 #>>42793477 #
1. deadbabe ◴[22 Jan 25 00:31 UTC] No.42787153[source]▶
I’d love to see that. Could you simulate iMessage?
replies(2): >>42787315 #>>42787660 #
2. Evidlo ◴[22 Jan 25 00:55 UTC] No.42787315[source]▶
If you mean hook this into iMessage, I don't know. I'm willing to bet it's way harder though because Apple
replies(1): >>42790394 #
3. great_psy ◴[22 Jan 25 01:33 UTC] No.42787660[source]▶
Yes it’s possible, but it’s not something you can easily scale.

I had a similar project a few years back that used OSX automations and Shortcuts and Python to send a message everyday to a friend. It required you to be signed in to iMessage on your MacBook.

Than was a send operation, the reading of replies is not something I implemented, but I know there is a file somewhere that holds a history of your recent iMessages. So you would have to parse it on file update and that should give you the read operation so you can have a conversation.

Very doable in a few hours unless something dramatic changed with how the messages apps works within the last few years.

replies(1): >>42791450 #
4. dambi0 ◴[22 Jan 25 08:23 UTC] No.42790394[source]▶
If you are willing to use Apple Shortcuts on iOS it’s pretty easy to add something that will be trigged when a message is received and can call out to a service or even use SSH to do something with the contents, including replying
5. dewey ◴[22 Jan 25 11:05 UTC] No.42791450[source]▶
They are all in a SQLite db on your disk.