←back to thread

207 points lexandstuff | 1 comments | | HN request time: 0.001s | source
Show context
edg5000 ◴[] No.44478026[source]
I've spent many year moving away from relying on third parties and got my own servers, do everything locally and with almost no binary blobs. It has been fun, saved me money and created a more powerful and pleasant IT environment.

However, I recently got a 100 EUR/m LLM subscription. That is the most I've spend on IT excluding a CAD software license. So've made a huge 180 and now am firmly back on the lap of US companies. I must say I've enjoyed my autonomy while it lasted.

One day AI will be democratized/cheap allowing people to self host what are now leading edge models, but it will take a while.

replies(3): >>44478081 #>>44478692 #>>44480848 #
cco ◴[] No.44478081[source]
Have you tried out Gemma3? The 4b parameter model runs super well on a Macbook as quickly as ChatGPT 4o. Of course the results are a bit worse and other product features (search, codex etc) don't come along for the ride, but wow, it feels very close.
replies(2): >>44478510 #>>44480651 #
1. int_19h ◴[] No.44478510[source]
On any serious task, it's not even close. There's no free lunch.