←back to thread

108 points Krontab | 9 comments | | HN request time: 0.158s | source | bottom
Show context
xyse53 ◴[] No.46276223[source]
I've noticed there aren't a lot of reasonable home/sb m.2 NVME NAS options for main boards and enclosures.

SATA SSD still seems like the way you have to go for a 5 to 8 drive system (boot disk + 4+ raid6).

replies(5): >>46276416 #>>46276486 #>>46276576 #>>46277298 #>>46279401 #
1. poly2it ◴[] No.46276486[source]
How well does buying PCIe to M.2 adapters work for a custom NAS? Slot-wise you should be able to get 16 M.2 devices per motherboard with for example a Supermicro consumer board.
replies(3): >>46276673 #>>46276738 #>>46276797 #
2. wtallis ◴[] No.46276673[source]
Can you point to a specific motherboard? 16 separate PCIe links of any width sounds rather high for a consumer platform.
replies(1): >>46276902 #
3. toast0 ◴[] No.46276738[source]
The difficulty with pcie to m.2 adapters is you usually can't use bifurcation below x4 and active PCIe switches got very expensive after PCIe 3.0.

Used multiport SATA HBA cards are inexpensive on eBay. Multiport nvme cards are either passive for bifurcation and give you 4x x4 for an x16 slot or are active and very expensive.

I don't see how you get to 16 m.2 devices on a consumer socket without lots of expense.

replies(2): >>46282674 #>>46299840 #
4. crote ◴[] No.46276797[source]
I don't think there are any consumer boards which support this?

In practice you can put 4 drives in the x16 slot intended for a GPU, 1 drive each in any remaining PCIe slots, plus whatever is available onboard. 8 should be doable, but I doubt you can go beyond 12.

I know there are some $2000 PCIe cards with onboard switches so you can stick 8 NVMe drives on there - even with an x1 upstream connection - but at that point you're better off going for a Threadripper board.

5. poly2it ◴[] No.46276902[source]
C9X299-RPGF

https://www.supermicro.com/en/products/motherboard/C9X299-RP...

replies(2): >>46277193 #>>46277252 #
6. crote ◴[] No.46277193{3}[source]
That's a workstation board, not a regular consumer board, and it is over 5 years old by now - it has even been discontinued by Supermicro.

Buiding a new system with that in 2025 would be a bit silly.

7. toast0 ◴[] No.46277252{3}[source]
A few generations old, and HEDT, which isn't exactly consumer but ok. I see one for $100 on ebay, so that's not awful either.

Even that gives you one m.2 slot, and 8/8/8/16 on the x16 slots, if you have the right cpu. Assuming those are can all bifurcate down to x4 (which is most common), that gets you 10 m.2 slots out of the 40 lanes. That's more than you'd get on a modern desktop board, but it's not 16 either.

For home use, you're in a tricky spot; can't get it in one box, so horizontal scaling seems like a good avenue. But in order to do horizontal scaling, you probably need high speed networking, and if you take lanes for that, you don't have many lanes left for storage. Anyway, I don't think there's much simple software to scale out storage over multiple nodes; there's stuff out there, but it's not simple and it's not really targeted towards a small node count. But, if you don't really need high speed, a big array of spinning disks is still approachable.

8. tracker1 ◴[] No.46282674[source]
Not to mention, the physical x16 slot may be running in x8 mode if you're using a video card.
9. rasz ◴[] No.46299840[source]
PCI switches got very expensive after Broadcom bought PLX.