←back to thread

77 points eatonphil | 1 comments | | HN request time: 0s | source
Show context
0cf8612b2e1e ◴[] No.40371539[source]

  Third, faster and cheaper storage devices mean that it is better to use faster decoding schemes to reduce computation costs than to pursue more aggressive compression to save I/O bandwidth. Formats should not apply general-purpose block compression by default because the bandwidth savings do not justify the decompression overhead.
Not sure I agree with that. Have a situation right now where I am bottlenecked by IO and not compute.
replies(6): >>40372011 #>>40372288 #>>40372399 #>>40372660 #>>40373077 #>>40373820 #
1. miohtama ◴[] No.40373077[source]
Try blosch, faster than memcpy

https://www.blosc.org/pages/blosc-in-depth/