←back to thread

Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop

330 points threeturn | 1 comments | 31 Oct 25 13:39 UTC | HN request time: 0.236s | source

Dear Hackers, I’m interested in your real-world workflows for using open-source LLMs and open-source coding assistants on your laptop (not just cloud/enterprise SaaS). Specifically:

Which model(s) are you running (e.g., Ollama, LM Studio, or others) and which open-source coding assistant/integration (for example, a VS Code plugin) you’re using?

What laptop hardware do you have (CPU, GPU/NPU, memory, whether discrete GPU or integrated, OS) and how it performs for your workflow?

What kinds of tasks you use it for (code completion, refactoring, debugging, code review) and how reliable it is (what works well / where it falls short).

I'm conducting my own investigation, which I will be happy to share as well when over.

Thanks! Andrea.

Show context
sho ◴[31 Oct 25 15:35 UTC] No.45773247[source]▶
Real-world workflows? I'm all for local LLM, tinker with it all the time, but for productive coding use no local LLM approaches cloud and it's not even close. There's no magic trick or combination of pieces, it just turns out that a quarter million dollars worth of H200s is just much, much better than anything a normal person could possibly deploy at home.

Give it time, we'll get there, but not anytime soon.

replies(2): >>45773307 #>>45774111 #
1. starik36 ◴[31 Oct 25 15:40 UTC] No.45773307[source]▶
You are right. This is the current situation. Plus the downside is that your laptop heats up like a furnace if you use the local LLM a lot.