←back to thread

Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop

335 points threeturn | 1 comments | 31 Oct 25 13:39 UTC | HN request time: 0.206s | source

Dear Hackers, I’m interested in your real-world workflows for using open-source LLMs and open-source coding assistants on your laptop (not just cloud/enterprise SaaS). Specifically:

Which model(s) are you running (e.g., Ollama, LM Studio, or others) and which open-source coding assistant/integration (for example, a VS Code plugin) you’re using?

What laptop hardware do you have (CPU, GPU/NPU, memory, whether discrete GPU or integrated, OS) and how it performs for your workflow?

What kinds of tasks you use it for (code completion, refactoring, debugging, code review) and how reliable it is (what works well / where it falls short).

I'm conducting my own investigation, which I will be happy to share as well when over.

Thanks! Andrea.

Show context
mwambua ◴[31 Oct 25 18:34 UTC] No.45775199[source]▶
Tangential question. What do people use for search? What search engines provide the best quality to cost ratios?

Also are there good solutions for searching through a local collection of documents?

replies(2): >>45775508 #>>45782663 #
1. nickthegreek ◴[01 Nov 25 15:56 UTC] No.45782663[source]▶
just setup searxng yesterday and mcp for it in lm studio to be able to search the net for answers to simple queries. small ibm granite worked surpassingly well, while oss20b seemed to be looping searches.