←back to thread

S3 as a Git remote and LFS server

(github.com)
194 points kbumsik | 6 comments | 19 Oct 24 10:37 UTC | HN request time: 0.204s | source | bottom
1. Evidlo ◴[19 Oct 24 23:37 UTC] No.41891680[source]▶
For the LFS part there is also dvc which works better than git-lfs and natively supports S3.
replies(3): >>41892558 #>>41896488 #>>41898528 #
2. bagavi ◴[20 Oct 24 03:00 UTC] No.41892558[source]▶
Dvc is great tool!
replies(1): >>41892610 #
3. lenova ◴[20 Oct 24 03:17 UTC] No.41892610[source]▶
I haven't heard of dvc, so I had to google it, which took me to: https://dvc.org/

But I'm still confused as to what is dvc is after a cursory glance at their homepage.

replies(1): >>41892904 #
4. chatmasta ◴[20 Oct 24 04:39 UTC] No.41892904{3}[source]▶
It was on the front page contemporaneously with this comment that recommended it, so you know it was an unbiased recommendation. :)
5. matrss ◴[20 Oct 24 16:28 UTC] No.41896488[source]▶
There is also git-annex, which supports S3 as well as a bunch of other storage backends (and it is very easy to implement your own, it just has to loosely resemble a key-value store). Git-annex can use any of its special remotes as git remotes, like what the presented tool does for just S3.
6. kernelsanderz ◴[20 Oct 24 21:14 UTC] No.41898528[source]▶
Also worth checking out https://github.com/jasonwhite/rudolfs

Been using it to store datasets via lfs. Written in rust and has been very reliable.