←back to thread

Open-source Zig book

(www.zigbook.net)
692 points rudedogg | 4 comments | | HN request time: 0.017s | source
Show context
rudedogg ◴[] No.45952436[source]
I submitted this and unfortunately it is likely AI generated. The authors github history suggests it at the very least, along with seemingly misunderstanding a reference to a Zig language feature (labeled blocks - https://zig.guide/language-basics/labelled-blocks/) in the project issues (https://github.com/zigbook/zigbook/issues/4).

I’m not sure how much value is to be had here, and it’s unfortunate the author wasn’t honest about how it was created.

I wish I wouldn’t have submitted this so quickly but I was excited about the new resource and the chapters I dug into looked good and accurate.

I worry about whether this will be maintained, if there are hallucinations, and if it’s worth investing time into.

replies(13): >>45952561 #>>45952581 #>>45952667 #>>45952728 #>>45952742 #>>45952869 #>>45953014 #>>45953055 #>>45953161 #>>45953533 #>>45953660 #>>45956501 #>>45969184 #
PaulRobinson ◴[] No.45952667[source]
I'd love it if we can stop the "Oh, this might be AI, so it's probably crap" thing that has taken over HN recently.

1. There is no evidence this is AI generated. The author claims it wasn't, and on the specific issue you cite, he explains why he's struggling with understanding it, even if the answer is "obvious" to most people here.

2. Even if it were AI generated, that does not automatically make it worthless. In fact, this looks pretty decent as a resource. Producing learning material is one of the few areas we can likely be confident that AI can add value, if the tools are used carefully - it's a lot better at that than producing working software, because synthesising knowledge seen elsewhere and moving it into a new relatable paradigm (which is what LLMs do, and excel at), is the job of teaching.

3. If it's maintained or not is neither here nor there - can it provide value to somebody right now, today? If yes, it's worth sharing today. It might not be in 6 months.

4. If there are hallucinations, we'll figure them out and prove the claim it is AI generated one way or another, and decide the overall value. If there is one hallucination per paragraph, it's a problem. If it's one every 5 chapters, it might be, but probably isn't. If it's one in 62 chapters, it's beating the error rate of human writers quite some way.

Yes, the GitHub history looks "off", but maybe they didn't want to develop in public and just wanted to get a clean v1.0 out there. Maybe it was all AI generated and they're hiding. I'm not sure it matters, to be honest.

But I do find it grating that every time somebody even suspects an LLM was involved, there is a rush of upvotes for "calling it out". This isn't rational thinking. It's not using data to make decisions, its not logical to assume all LLM-assisted writing is slop (even if some of it is), and it's actually not helpful in this case to somebody who is keen to learn zig to decide if this resource is useful or not: there are many programming tutorials written by human experts that are utterly useless, this might be a lot better.

replies(3): >>45952747 #>>45952800 #>>45952953 #
toinewx ◴[] No.45952747[source]
> 1. There is no evidence this is AI generated. The author claims it wasn't, and on the specific issue you cite, he explains why he's struggling with understanding it, even if the answer is "obvious" to most people here.

There is, actually, You may copy the introduction to Pangram and it will say 100% AI generated.

replies(1): >>45952762 #
1. PaulRobinson ◴[] No.45952762[source]
That's not evidence, at least not evidence that would stand up to a peer review if the author were to refute it.
replies(3): >>45952778 #>>45952819 #>>45959117 #
2. toinewx ◴[] No.45952778[source]
When I give my own writings to Pangram, it says 100% human.
3. tpoacher ◴[] No.45952819[source]
It's not proof but it's definitely evidence.
4. keybored ◴[] No.45959117[source]
What’s the evidence that it is human-generated? Oh I see. If it is AI generated then you still have to judge it by its merit, manually. (Or can I get an AI to do it for me?) And if they lied about it being human-authored? Well what if the author refutes that accusation? (Maybe using AI? But why judge them if they use AI to refute the claim? After all we must judge its on its own merit (repeats forever))