←back to thread

I regret building this $3000 Pi AI cluster

(www.jeffgeerling.com)
468 points speckx | 1 comments | 19 Sep 25 14:28 UTC | HN request time: 0.206s | source
Show context
nromiun ◴[19 Sep 25 15:31 UTC] No.45302752[source]▶
There is a reason all the big supercomputers have started using GPUs in the last decade. They are much more efficient. If you want 32bit parallel performance just buy some consumer GPUs and hook them up. If you need 64bit buy some prosumer GPUs like the RTX 6000 Pro and you are done.

Nobody is really building CPU clusters these days.

replies(2): >>45304577 #>>45305705 #
1. anematode ◴[19 Sep 25 19:48 UTC] No.45305705[source]▶
Unfortunately even the RTX 6000 Pro has nerfed double-precision throughput at about 2 TFLOPS, 64x slower than single precision. For comparison an EPYC 9755 does ~10 TFLOPS, while drawing less power. An A100 -- if you can find one -- is in the same ballpark.

The best option for DP throughput for hobbyists interested in HPC might be old AMD cards from before they, too, realized that scientific folks would pay up the nose for higher precision.