←back to thread

Max severity RCE flaw discovered in widely used Apache Parquet

(www.bleepingcomputer.com)
174 points andy99 | 3 comments | 06 Apr 25 17:21 UTC | HN request time: 0.731s | source
1. marginalia_nu ◴[07 Apr 25 22:32 UTC] No.43616661[source]▶
I migrated off apache parquet to a very simple columnar format. Cut processing times in half, reduced RAM usage by almost 90%, and (as it turns out) dodged this security vulnerability.

I don't want to make too harsh remarks about the project, as it may simply not have been the right tool for my use case, though it sure gave me a lot of issues.

replies(1): >>43617894 #
2. ryan-duve ◴[08 Apr 25 02:42 UTC] No.43617894[source]▶
What "very simple columnar format" did you switch to?
replies(1): >>43619809 #
3. marginalia_nu ◴[08 Apr 25 09:30 UTC] No.43619809[source]▶
https://github.com/MarginaliaSearch/SlopData

Writeup about some of the ideas that went into it:

https://www.marginalia.nu/log/a_112_slop_ideas/