←back to thread

I regret building this $3000 Pi AI cluster

(www.jeffgeerling.com)
468 points speckx | 2 comments | 19 Sep 25 14:28 UTC | HN request time: 0s | source
1. iLoveOncall ◴[19 Sep 25 17:27 UTC] No.45304213[source]▶
> With 160 GB of total RAM, shared by the CPU and iGPU, this could be a small, efficient AI Cluster, right? Well, you'd think.

I don't know anyone who would think this actually.

replies(1): >>45304492 #
2. geerlingguy ◴[19 Sep 25 17:53 UTC] No.45304492[source]▶
Most people who haven't actually self-hosted AI models would think this—for some reason people still think RAM is RAM, and they don't think about specs like memory speed, whether the full amount of RAM is shared with the GPU, etc.

You'd be surprised by the number of emails, Instagram DMs, YouTube comments, etc. I get—even after explicitly showing how bad a system is at a certain task—asking if a Pi would be good for X, or if they could run ChatGPT on their laptop...