Most active commenters

    ←back to thread

    I regret building this $3000 Pi AI cluster

    (www.jeffgeerling.com)
    468 points speckx | 12 comments | 19 Sep 25 14:28 UTC | HN request time: 0.871s | source | bottom
    Show context
    Aurornis ◴[19 Sep 25 14:52 UTC] No.45302320[source]▶
    I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks.

    If your goal is to play with or learn on a cluster of Linux machines, the cost effective way to do it is to buy a desktop consumer CPU, install a hypervisor, and create a lot of VMs. It’s not as satisfying as plugging cables into different Raspberry Pi units and connecting them all together if that’s your thing, but once you’re in the terminal the desktop CPU, RAM, and flexibility of the system will be appreciated.

    replies(11): >>45302356 #>>45302424 #>>45302433 #>>45302531 #>>45302676 #>>45302770 #>>45303057 #>>45303061 #>>45303424 #>>45304502 #>>45304568 #
    1. moduspol ◴[19 Sep 25 15:02 UTC] No.45302433[source]▶
    Also cost effective is to buy used rack mount servers from Amazon. They may be out of warranty but you get a lot more horsepower for your buck, and now your VMs don’t have to be small.
    replies(3): >>45302450 #>>45302687 #>>45302719 #
    2. Aurornis ◴[19 Sep 25 15:04 UTC] No.45302450[source]▶
    Putting a retired datacenter rack mount server in your house is a great way to learn how unbearably loud a real rack mount datacenter server is.
    replies(6): >>45302637 #>>45302759 #>>45303695 #>>45304110 #>>45304344 #>>45304626 #
    3. tempest_ ◴[19 Sep 25 15:21 UTC] No.45302637[source]▶
    ahah and pricey power wise.

    Currently the cloud providers are dumping second gen xeon scalables and those things are pigs when it comes to power use.

    Sound wise its like someone running a hair dryer at full speed all the time and it can be louder under load.

    4. Y_Y ◴[19 Sep 25 15:26 UTC] No.45302687[source]▶
    If you're following this path, make sure to use the finest traditional server rack that money can buy: https://www.ikea.com/ie/en/p/lack-side-table-white-30449908/
    5. allanrbo ◴[19 Sep 25 15:29 UTC] No.45302719[source]▶
    No, again, just run VMs on your desktop/laptop. The software doesn't know or care if it's a rack mounted machine.
    replies(1): >>45304612 #
    6. Tsiklon ◴[19 Sep 25 15:32 UTC] No.45302759[source]▶
    To quote @swiftonsecurity - https://x.com/swiftonsecurity/status/1650223598903382016 ;

    > DO NOT TAKE HOME THE FREE 1U SERVER YOU DO NOT WANT THAT ANYWHERE A CLOSET DOOR WILL NOT STOP ITS BANSHEE WAIL TO THE DARK LORD AN UNHOLY CONDUIT TO THE DEPTHS OF INSOMNIA BINDING DARKNESS TO EVEN THE DAY

    replies(1): >>45303566 #
    7. buildbot ◴[19 Sep 25 16:32 UTC] No.45303566{3}[source]▶
    This 1000%; and some 1us are extra 666. I had a sparc t2000 at one point, it was so much louder than a 1u Supermicro. Or whatever was in Microsoft HW labs, those you could hear from multiple hallways over… There were non optional earplugs at the doors.
    8. _boffin_ ◴[19 Sep 25 16:42 UTC] No.45303695[source]▶
    Not true. Have one running in the closet and never hear it.
    9. ComputerGuru ◴[19 Sep 25 17:18 UTC] No.45304110[source]▶
    Only if it’s a 1U. 2U units idle at silent.
    10. J_Shelby_J ◴[19 Sep 25 17:39 UTC] No.45304344[source]▶
    Buy a 3/4u case for $100 and put whatever board you want in it with standard PC fans and a decent cpu cooler. Dead silent.
    11. ◴[19 Sep 25 18:05 UTC] No.45304612[source]▶
    12. moduspol ◴[19 Sep 25 18:07 UTC] No.45304626[source]▶
    True! They aren't quiet. I keep mine in a well-ventilated room that doesn't typically have people in it.