←back to thread

157 points craigkerstiens | 1 comments | | HN request time: 0s | source
Show context
oulipo ◴[] No.41873813[source]
Cool, would this be better than using a clickhouse / duckdb extension that reads postgres and saves to Parquet?

What would be recommended to output regularly old data to S3 as parquet file? To use a cron job which launches a second Postgres process connecting to the database and extracting the data, or using the regular database instance? doesn't that slow down the instance too much?

replies(2): >>41874097 #>>41881043 #
1. coredog64 ◴[] No.41881043[source]
RDS for MySQL and Postgres natively support exporting a consistent snapshot to S3 in Parquet format.

https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_...