←back to thread

What If OpenDocument Used SQLite?

(www.sqlite.org)
275 points whatisabcdefgh | 4 comments | 04 Sep 25 21:36 UTC | HN request time: 0s | source
Show context
lifthrasiir ◴[05 Sep 25 02:21 UTC] No.45134401[source]▶
SQLite can't be reliably used in networked file systems because it heavily relies on locking to be correctly implemented. I recently had to add a check for such file systems in my application [1] because I noticed a related corruption firsthand. Simpler file formats do not demand such requirements. SQLite is certainly good, but not for this use.

[1] https://github.com/lifthrasiir/angel/commit/50a15e703ef2c1af...

replies(4): >>45134413 #>>45135134 #>>45135346 #>>45135619 #
greenavocado ◴[05 Sep 25 02:23 UTC] No.45134413[source]▶
Easy fix is an empty lock file adjacent to the real one.
replies(1): >>45134419 #
lifthrasiir ◴[05 Sep 25 02:24 UTC] No.45134419[source]▶
Yeah, but only if SQLite did support that mode in some built-in VFS implementation...
replies(1): >>45134841 #
1. hedora ◴[05 Sep 25 03:52 UTC] No.45134841[source]▶
Which network filesystems are still corrupting sqlite files?

Sqlite on NFSv3 has been rock solid for some NFS servers for a decade.

Maybe name and shame?

replies(1): >>45135307 #
2. lifthrasiir ◴[05 Sep 25 05:42 UTC] No.45135307[source]▶
Specifically I had an issue over 9p used by WSL2. (I never thought it was networked before this incident.)
replies(1): >>45151333 #
3. hedora ◴[06 Sep 25 17:42 UTC] No.45151333[source]▶
It seems odd to break a wide range of valid configs for something so obscure.
replies(1): >>45155150 #
4. lifthrasiir ◴[07 Sep 25 03:30 UTC] No.45155150{3}[source]▶
Yes, that was surprising to me too! I was able to fairly reliably reproduce data corruption in this case.