←back to thread

172 points frectonz | 1 comments | | HN request time: 0.27s | source

pglite-fusion is a PostgreSQL extension that allows you to embed SQLite databases into your PostgreSQL tables by enabling the creation of columns with the `SQLITE` type. This means every row in the table can have an embedded SQLite database.

In addition to the PostgreSQL `SQLITE` type, pglite-fusion provides the `query_sqlite`` function for querying SQLite databases and the `execute_sqlite` function for updating them. Additional functions are listed in the project’s README.

The pglite-fusion extension is written in Rust using the pgrx framework [1].

----

Implementation Details

The PostgreSQL `SQLITE` type is stored as a CBOR-encoded `Vec<u8>`. When a query is made, this `Vec<u8>` is written to a random file in the `/tmp` directory. SQLite then loads the file, performs the query, and returns the result as a table containing a single row with an array of JSON-encoded values.

The `execute_sqlite` function follows a similar process. However, instead of returning query results, it returns the contents of the SQLite file (stored in `/tmp`) as a new `SQLITE` instance.

[1] https://github.com/pgcentralfoundation/pgrx

Show context
fredtalty5 ◴[] No.42184000[source]
"Introducing pglite-fusion: Embed SQLite Databases Directly Into PostgreSQL Tables

What is pglite-fusion? pglite-fusion is a powerful PostgreSQL extension that bridges two popular database worlds by allowing you to embed SQLite databases directly into PostgreSQL tables. Each row can contain its own SQLite database using the new `SQLITE` column type—perfect for scenarios where you need highly localized or structured data at the row level.

How It Works - SQLITE Type: Define columns in PostgreSQL that hold embedded SQLite databases, stored as CBOR-encoded `Vec<u8>` objects. - Querying SQLite: Use the `query_sqlite` function to run SQL queries on the embedded SQLite databases. Results are returned as JSON-encoded arrays in a single row. - Updating SQLite: Use `execute_sqlite` to modify the SQLite database and retrieve updated instances.

Why You'll Love It - Seamlessly blend the simplicity of SQLite with the scalability of PostgreSQL. - Unlock new use cases like row-specific data isolation, nested data structures, or lightweight experimentation with different SQLite schemas. - Built on Rust using the pgrx framework for safety and performance.

Under the Hood pglite-fusion temporarily stores SQLite databases as files in `/tmp` to perform operations. SQLite processes these files to execute queries or updates and passes the results back into PostgreSQL.

Who Is It For? Developers and DBAs who want fine-grained control over data storage, hybrid database use cases, or just love the flexibility of combining PostgreSQL and SQLite in innovative ways.

replies(1): >>42188502 #
1. SahAssar ◴[] No.42188502[source]
Nobody wants AI-generated comment summaries, even less so without disclosing it's generated.