←back to thread

An intro to DeepSeek's distributed file system

(maknee.github.io)
621 points sebg | 1 comments | 17 Apr 25 12:50 UTC | HN request time: 0.2s | source
Show context
randomtoast ◴[17 Apr 25 14:01 UTC] No.43717002[source]▶
Why not use CephFS instead? It has been thoroughly tested in real-world scenarios and has demonstrated reliability even at petabyte scale. As an open-source solution, it can run on the fastest NVMe storage, achieving very high IOPS with 10 Gigabit or faster interconnect.

I think their "Other distributed filesystem" section does not answer this question.

replies(4): >>43717453 #>>43717925 #>>43719471 #>>43721116 #
elashri ◴[17 Apr 25 15:01 UTC] No.43717925[source]▶
CERN use CephFS with ~50PB for different applications and they are happy with it.
replies(1): >>43718236 #
dfc ◴[17 Apr 25 15:23 UTC] No.43718236[source]▶
I thought they used ceph too. But I started looking around and it seems like they have switched to CernVM-FS and in house solution. I'm not sure what changed.
replies(2): >>43719123 #>>43727400 #
1. elashri ◴[17 Apr 25 16:29 UTC] No.43719123[source]▶
They didn't switch, they use both for different needs. EOS (CVMFS) is used mainly for physics data storage and user data. Ceph is used for many other things like infrastructure, selfhosted apps..etc.