←back to thread

FireDucks: Pandas but Faster

(hwisnu.bearblog.dev)
398 points sebg | 5 comments | 14 Nov 24 11:48 UTC | HN request time: 1.109s | source
Show context
bratao ◴[20 Nov 24 11:16 UTC] No.42192811[source]▶
Unfortunately it is not Opensource yet - https://github.com/fireducks-dev/fireducks/issues/22
replies(2): >>42192865 #>>42192935 #
Y_Y ◴[20 Nov 24 11:27 UTC] No.42192865[source]▶
Wouldn't it be nice if GitHub was just for source code and you couldn't just slap up a README that's an add for some proprietary shitware with a vague promise of source some day in the glorious future?
replies(3): >>42192929 #>>42192940 #>>42193049 #
thecopy ◴[20 Nov 24 11:38 UTC] No.42192929[source]▶
>proprietary shitware

Is this shitware? It seems to be very high quality code

replies(2): >>42193251 #>>42193373 #
ori_b ◴[20 Nov 24 12:35 UTC] No.42193373[source]▶
How can you tell?
replies(1): >>42193668 #
sbarre ◴[20 Nov 24 13:15 UTC] No.42193668[source]▶
I mean, based on the claims and the benchmarks, it seems to provide massive speedups to a very popular tool.

How would you define "quality" in this context?

replies(2): >>42193773 #>>42193949 #
echoangle ◴[20 Nov 24 13:30 UTC] No.42193773[source]▶
High quality code isn't just code that performs well when executed, but also is readable, understandable and maintainable. You can't judge code quality by looking at the compiled result, just because it works well.
replies(1): >>42195645 #
1. sbarre ◴[20 Nov 24 16:37 UTC] No.42195645[source]▶
That's certainly one opinion about it.

One could also say that quality is related to the functional output.

replies(1): >>42195790 #
2. echoangle ◴[20 Nov 24 16:51 UTC] No.42195790[source]▶
> One could also say that quality is related to the functional output.

Right, I said nothing that contradicts that ("High quality code isn't just code that performs well when executed, but also ..."). High quality functional output is a necessary requirement, but it isn't sufficient to determine if code is high quality.

replies(1): >>42197101 #
3. sbarre ◴[20 Nov 24 19:07 UTC] No.42197101[source]▶
Sure, I guess it depends on what matters to you or to your evaluation criteria.

My point was that it's all subjective in the end.

replies(1): >>42197322 #
4. echoangle ◴[20 Nov 24 19:35 UTC] No.42197322{3}[source]▶
It's not really subjective if you're at all reasonable about it.

Imagine writing a very good program, running it through an obfuscator, and throwing away the original code. Is the obfuscated code "high quality code" now, because the output of the compilation still works as before?

replies(1): >>42232860 #
5. sbarre ◴[25 Nov 24 03:04 UTC] No.42232860{4}[source]▶
Again it depends what you mean by "high quality code".

Do you mean how well it was written, or do you mean how well it performs? Or do both matter? Equally, or one more/less than the other?

It probably depends on whether you're the developer taking over the codebase, or the customer running the code in production..

Take video games.. A lot of it is messy spaghetti C++ code, not modular or well structured, full of hacks and manual optimizations, to give the best possible performance on available hardware.

It might be impossible to parse or maintain, but it does the job about as well as possible, which is really all that matters to the end user. I would call that high quality code.

So again, subjective...