←back to thread

275 points whatisabcdefgh | 2 comments | | HN request time: 0.015s | source
Show context
liuliu ◴[] No.45133756[source]
One thing I would call out, if you use SQLite as an application format:

BLOB type is limited to 2GiB in size (int32). Depending on your use cases, that might seem high, or not.

People would argue that if you store that much of binary data in a SQLite database, it is not really appropriate. But, application format usually has this requirement to bundle large binary data in one nice file, rather than many files that you need to copy together to make it work.

replies(1): >>45134101 #
Retr0id ◴[] No.45134101[source]
You can split your data up across multiple blobs
replies(3): >>45135219 #>>45136032 #>>45140501 #
1. johncolanduoni ◴[] No.45135219[source]
Also you almost certainly want to do this anyway so you can stream the blobs into/out of the network/filesystem, well before you have GBs in a single blob.
replies(1): >>45136933 #
2. Retr0id ◴[] No.45136933[source]
Singular sqlite blobs are streamable too! But for streaming in you need to know the size in advance.