←back to thread

492 points vladyslavfox | 2 comments | | HN request time: 0.429s | source
Show context
trompetenaccoun ◴[] No.41895988[source]
We need archives built on decentralized storage. Don't get me wrong, I really like and support the work Internet Archive is doing, but preserving history is too important to entrust it solely to singular entities, which means singular points of failure.
replies(19): >>41896170 #>>41896389 #>>41896411 #>>41896420 #>>41897459 #>>41897680 #>>41897913 #>>41898320 #>>41898841 #>>41899160 #>>41899729 #>>41899779 #>>41899999 #>>41900368 #>>41901199 #>>41902340 #>>41904676 #>>41905019 #>>41907926 #
__MatrixMan__ ◴[] No.41897459[source]
To make the web distributed-archive-friendly I think we need to start referencing things by hash and not by a path which some server has implied it will serve consistently but which actually shows you different data at different times for a million different reasons.

If different data always gets a different reference, it's easy to know if you have enough backups of it. If the same name gets you a pile of snapshots taken under different conditions, it's hard to be sure which of those are the thing that we'd want to back up for that particular name.

replies(2): >>41897960 #>>41899538 #
Cheer2171 ◴[] No.41897960[source]
Done. It is called IPFS. The IA already supports it.

https://github.com/internetarchive/dweb-archive/blob/master/...

replies(3): >>41898278 #>>41898354 #>>41898515 #
majorchord ◴[] No.41898354[source]
IPFS has shown that the protocol is fundamentally broken at the level of growth they want to achieve and it is already extremely slow as it is. It often takes several minutes to locate a single file.
replies(2): >>41898517 #>>41898578 #
1. BlueTemplar ◴[] No.41898578[source]
Several minutes sounds more than fine for this purpose ?

Especially if it's about having an Internet Archive backup.

replies(1): >>41899135 #
2. Aachen ◴[] No.41899135[source]
I think the point is that it's already slow at the current amount of data, let alone when you stuff dozens more PB into it