Most active commenters
  • sbarre(3)
  • echoangle(3)

←back to thread

FireDucks: Pandas but Faster

(hwisnu.bearblog.dev)
374 points sebg | 23 comments | | HN request time: 0.9s | source | bottom
1. bratao ◴[] No.42192811[source]
Unfortunately it is not Opensource yet - https://github.com/fireducks-dev/fireducks/issues/22
replies(2): >>42192865 #>>42192935 #
2. Y_Y ◴[] No.42192865[source]
Wouldn't it be nice if GitHub was just for source code and you couldn't just slap up a README that's an add for some proprietary shitware with a vague promise of source some day in the glorious future?
replies(3): >>42192929 #>>42192940 #>>42193049 #
3. thecopy ◴[] No.42192929[source]
>proprietary shitware

Is this shitware? It seems to be very high quality code

replies(2): >>42193251 #>>42193373 #
4. gus_massa ◴[] No.42192935[source]
> FireDucks is not a open source library at this moment. You can get it installed freely using pip and use under BSD-3 license and of course can look into the python part of the source code.

I don't understand what it means. It looks like a contradiction. Does it have a BSD-3 licence or not?

replies(3): >>42193026 #>>42193077 #>>42193145 #
5. rad_gruchalski ◴[] No.42192940[source]
You'd slap that in a comment then?
6. _flux ◴[] No.42193026[source]
They provide BSD-3-licensed Python files but the interesting bit happens in the shared object library, which is only provided in binary form (but is also BSD-3-licensed it seems, so you can distribute it freely).
replies(1): >>42193175 #
7. diggan ◴[] No.42193049[source]
> Wouldn't it be nice if GitHub was just for source code

GitHub always been a platform for "We love to host FOSS but we won't be 100% FOSS ourselves", so makes sense they allow that kind of usage for others too.

I think what you want, is something like Codeberg instead, which is explicitly for FOSS and 100% FOSS themselves.

8. abcalphabet ◴[] No.42193077[source]
From the above link:

> While the wheel packages are available at https://pypi.org/project/fireducks/#files, and while they do contain Python files, most of the magic happens inside a (BSD-3-licensed) shared object library, for which source code is not provided.

9. sampo ◴[] No.42193145[source]
BSD license gives you the permission to use and to redistribute. In this case you may use and redistribute the binaries.

Edit: To use, redistribute, and modify, and distribute modified versions.

replies(2): >>42193513 #>>42193533 #
10. joshuaissac ◴[] No.42193175{3}[source]
Since it is under the BSD 3 licence, users would also be permitted to decompile and modify the shared object under the licence terms.
replies(1): >>42196032 #
11. yupyupyups ◴[] No.42193251{3}[source]
I think the anger comes from the fact that we expect Github repositories to host the actual source code and not be a dead-end with a single README.md file.
12. ori_b ◴[] No.42193373{3}[source]
How can you tell?
replies(1): >>42193668 #
13. japhyr ◴[] No.42193513{3}[source]
"Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met..."

https://opensource.org/license/bsd-3-clause

14. GardenLetter27 ◴[] No.42193533{3}[source]
Such a crazy distortion of the meaning of the license.

Imagine being like "the project is GPL - just the compiled machine code".

replies(1): >>42195450 #
15. sbarre ◴[] No.42193668{4}[source]
I mean, based on the claims and the benchmarks, it seems to provide massive speedups to a very popular tool.

How would you define "quality" in this context?

replies(2): >>42193773 #>>42193949 #
16. echoangle ◴[] No.42193773{5}[source]
High quality code isn't just code that performs well when executed, but also is readable, understandable and maintainable. You can't judge code quality by looking at the compiled result, just because it works well.
replies(1): >>42195645 #
17. ori_b ◴[] No.42193949{5}[source]
Written so that it's easy to maintain, well tested, correct in its handling of edge cases, easy to debug, and easy to iterate on.
18. PittleyDunkin ◴[] No.42195450{4}[source]
This is pretty common for binary blobs for where the source code has been lost.
19. sbarre ◴[] No.42195645{6}[source]
That's certainly one opinion about it.

One could also say that quality is related to the functional output.

replies(1): >>42195790 #
20. echoangle ◴[] No.42195790{7}[source]
> One could also say that quality is related to the functional output.

Right, I said nothing that contradicts that ("High quality code isn't just code that performs well when executed, but also ..."). High quality functional output is a necessary requirement, but it isn't sufficient to determine if code is high quality.

replies(1): >>42197101 #
21. jlokier ◴[] No.42196032{4}[source]
Nice insight!
22. sbarre ◴[] No.42197101{8}[source]
Sure, I guess it depends on what matters to you or to your evaluation criteria.

My point was that it's all subjective in the end.

replies(1): >>42197322 #
23. echoangle ◴[] No.42197322{9}[source]
It's not really subjective if you're at all reasonable about it.

Imagine writing a very good program, running it through an obfuscator, and throwing away the original code. Is the obfuscated code "high quality code" now, because the output of the compilation still works as before?