←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 5 comments | 21 Jan 25 19:39 UTC | HN request time: 0.669s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
Evidlo ◴[22 Jan 25 00:00 UTC] No.42786869[source]▶
I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman.

http://files.widloski.com/image10%20(1).png

http://files.widloski.com/image11.png

replies(11): >>42786904 #>>42786974 #>>42787151 #>>42787231 #>>42787781 #>>42789419 #>>42789860 #>>42794672 #>>42795730 #>>42795824 #>>42796084 #
1. celestialcheese ◴[22 Jan 25 00:31 UTC] No.42787151[source]▶
Given the source, I'm skeptical it's not just a troll, but found this explanation [0] plausible as to why those vague spam text exists. If true, this trolling helps the spammers warm those phone numbers up.

0 - https://x.com/nikitabier/status/1867029883387580571

replies(1): >>42787482 #
2. stogot ◴[22 Jan 25 01:16 UTC] No.42787482[source]▶
Why does STOP work here?
replies(3): >>42787538 #>>42787551 #>>42792455 #
3. celestialcheese ◴[22 Jan 25 01:21 UTC] No.42787538[source]▶
https://x.com/nikitabier/status/1867069169256308766

Again, no clue if this is true, but it seems plausible.

4. inerte ◴[22 Jan 25 01:22 UTC] No.42787551[source]▶
Carriers and SMS service providers (like Twillio) obey that, no matter what service is behind.

There are stories of people replying STOP to spam, then never getting a legit SMS because the number was re-used by another service. That's because it's being blocked between the spammer and the phone.

5. yawgmoth ◴[22 Jan 25 13:15 UTC] No.42792455[source]▶
STOP works thanks to the Telephone Consumer Protection Act (“TCPA”), which offers consumers spam protections and senders a framework on how to behave.

(Edit: It's relevant that STOP didn't come from the TCPA itself, but definitely has teeth due to it)

https://www.infobip.com/blog/a-guide-to-global-sms-complianc...