←back to thread

Ask HN: Is anyone doing anything cool with tiny language models?

684 points prettyblocks | 1 comments | 21 Jan 25 19:39 UTC | HN request time: 0.213s | source

I mean anything in the 0.5B-3B range that's available on Ollama (for example). Have you built any cool tooling that uses these models as part of your work flow?
Show context
spiritplumber ◴[22 Jan 25 00:10 UTC] No.42786957[source]▶
My husband and me made a stock market analysis thing that gets it right about 55% of the time, so better than a coin toss. The problem is that it keeps making unethical suggestions, so we're not using it to trade stock. Does anyone have any idea what we can do with that?
replies(6): >>42787033 #>>42787185 #>>42787294 #>>42787375 #>>42787659 #>>42789438 #
dkga ◴[22 Jan 25 01:03 UTC] No.42787375[source]▶
Suggestion: calculate the out-of-sample Sharpe ratio[0] of the suggestions over a reasonable period to gauge how good the model would actually perform in terms of return compared to risks. It is better than vanilla accuracy or related metrics. Source: I'm a financial economist.

[0]: https://en.wikipedia.org/wiki/Sharpe_ratio

replies(1): >>42788360 #
1. spiritplumber ◴[22 Jan 25 02:50 UTC] No.42788360[source]▶
thank you! that's exactly the sort of thing I don't know.