←back to thread

Show HN: Sir – Git-diff-able JSON database on yer filesystem

(github.com)
115 points graderjs | 2 comments | 06 Nov 20 03:19 UTC | HN request time: 0.435s | source
Show context
dreamer7 ◴[06 Nov 20 04:27 UTC] No.25004897[source]▶
Slightly off topic - can we use git-diff-able databases for faster syncing of clients with servers?

Or is there no practical difference?

We can return just the latest updated documents by maintaining a lastUpdated timestamp on client and server docs. But this would be at a document level. So, only the fields that have changed would be sent to the client.

replies(3): >>25004919 #>>25005083 #>>25005831 #
1. moonchild ◴[06 Nov 20 07:43 UTC] No.25005831[source]▶
An mutch easier solution that gets you 90% of the way is to just use a binary patcher (like bsdiff) with whatever database format you're already using.
replies(1): >>25006433 #
2. Scaevolus ◴[06 Nov 20 09:51 UTC] No.25006433[source]▶
bsdiff doesn't scale to gigabytes-- vcdiff or rsync will work better