←back to thread

I regret building this $3000 Pi AI cluster

(www.jeffgeerling.com)
468 points speckx | 1 comments | 19 Sep 25 14:28 UTC | HN request time: 0.224s | source
Show context
Aurornis ◴[19 Sep 25 14:52 UTC] No.45302320[source]▶
I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks.

If your goal is to play with or learn on a cluster of Linux machines, the cost effective way to do it is to buy a desktop consumer CPU, install a hypervisor, and create a lot of VMs. It’s not as satisfying as plugging cables into different Raspberry Pi units and connecting them all together if that’s your thing, but once you’re in the terminal the desktop CPU, RAM, and flexibility of the system will be appreciated.

replies(11): >>45302356 #>>45302424 #>>45302433 #>>45302531 #>>45302676 #>>45302770 #>>45303057 #>>45303061 #>>45303424 #>>45304502 #>>45304568 #
bunderbunder ◴[19 Sep 25 14:55 UTC] No.45302356[source]▶
The cost effective way to do it is in the cloud. Because there's a very good chance you'll learn everything you intended to learn and then get bored with it long before your cloud compute bill reaches the price of a desktop with even fairly modest specs for this purpose.
replies(12): >>45302408 #>>45302469 #>>45302503 #>>45302550 #>>45302742 #>>45302824 #>>45303327 #>>45303352 #>>45304169 #>>45304176 #>>45304278 #>>45305010 #
Almondsetat ◴[19 Sep 25 15:06 UTC] No.45302469[source]▶
I can get a Xeon E5-2690V4 with 28 threads and 64GB of RAM for about $150. If you need cores and memory to make a lot of VMs you can do it extremely cheaply
replies(7): >>45302491 #>>45302525 #>>45302535 #>>45302992 #>>45303342 #>>45303344 #>>45303461 #
kbenson ◴[19 Sep 25 15:50 UTC] No.45302992[source]▶
Source? That seems like something I would want to take advantage if at the moment...
replies(1): >>45303066 #
kllrnohj ◴[19 Sep 25 15:54 UTC] No.45303066[source]▶
Note the E5-2690V4 is a 10 year old CPU, they are talking about used servers. You can find those on ebay or whatever as well as stores specializing in that. Depending on where you live, you might even find them free as they are often considered literal ewaste by the companies decommissioning them.

It also means it performs like a 10 year old server CPU, so those 28 threads are not exactly worth a lot. The geekbench results, for whatever value those are worth, are very mediocre in the context of anything remotely modern: https://browser.geekbench.com/processors/intel-xeon-e5-2690-...

Like a modern 12-thread 9600x runs absolute circles around it https://browser.geekbench.com/processors/amd-ryzen-5-9600x

replies(3): >>45303457 #>>45313507 #>>45354389 #
1. flas9sd ◴[20 Sep 25 14:01 UTC] No.45313507[source]▶
I tend to use quite old hardware that is powered-off when not in use for its intended purpose and I coined "capability is its own quality".

For dedicated build boxes that crunch through lots of sources (whole distributions, AOSP) but do run seldomly, getting your hands on lots of Cores and RAM very cheaply can still trump buying newer CPUs with better perf/watt but higher cost.