←back to thread

Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop

335 points threeturn | 2 comments | 31 Oct 25 13:39 UTC | HN request time: 0.416s | source

Dear Hackers, I’m interested in your real-world workflows for using open-source LLMs and open-source coding assistants on your laptop (not just cloud/enterprise SaaS). Specifically:

Which model(s) are you running (e.g., Ollama, LM Studio, or others) and which open-source coding assistant/integration (for example, a VS Code plugin) you’re using?

What laptop hardware do you have (CPU, GPU/NPU, memory, whether discrete GPU or integrated, OS) and how it performs for your workflow?

What kinds of tasks you use it for (code completion, refactoring, debugging, code review) and how reliable it is (what works well / where it falls short).

I'm conducting my own investigation, which I will be happy to share as well when over.

Thanks! Andrea.

Show context
jetsnoc ◴[31 Oct 25 17:24 UTC] No.45774453[source]▶

  Models
    gpt-oss-120b, Meta Llama 3.2, or Gemma
    (just depends on what I’m doing)

  Hardware
    - Apple M4 Max (128 GB RAM)
      paired with a GPD Win 4 running Ubuntu 24.04 over USB-C networking

  Software
    - Claude Code
    - RA.Aid
    - llama.cpp

  For CUDA computing, I use an older NVIDIA RTX 2080 in an old System76 workstation.

  Process

    I create a good INSTRUCTIONS.md for Claude/Raid that specifies a task & production process with a task list it maintains. I use Claude Agents with an Agent Organizer that helps determine which agents to use. It creates the architecture, prd and security design, writes the code, and then lints, tests and does a code review.
replies(3): >>45774481 #>>45774630 #>>45776950 #
CubsFan1060 ◴[31 Oct 25 17:42 UTC] No.45774630[source]▶
What is the Agent Organizer you use?
replies(1): >>45775105 #
1. jetsnoc ◴[31 Oct 25 18:25 UTC] No.45775105[source]▶
It’s a Claude agent prompt. I don’t recall who originally shared it, so I can’t yet attribute the source, but I’ll track that down shortly and add proper attribution here.

Here’s the Claude agent markdown:

https://github.com/lst97/claude-code-sub-agents/blob/main/ag...

Edit: Updated from the old Pastebin link to the GitHub version. Attribution found: lst97 on GitHub

replies(1): >>45776708 #
2. nicce ◴[31 Oct 25 21:07 UTC] No.45776708[source]▶
How it looks like Claude agent is written by Claude...