←back to thread

Do AI detectors work? Students face false cheating accusations

(www.bloomberg.com)
427 points JumpCrisscross | 3 comments | 20 Oct 24 17:26 UTC | HN request time: 0.001s | source
Show context
jmugan ◴[20 Oct 24 18:47 UTC] No.41897583[source]▶
My daughter was accused of turning in an essay written by AI because the school software at her online school said so. Her mom watched her write the essay. I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Evidently, the software vendors are either ignorant or are lying, and school administrators are believing them.
replies(9): >>41897721 #>>41897958 #>>41898000 #>>41898366 #>>41900887 #>>41901340 #>>41903397 #>>41905013 #>>41909285 #
Daz1 ◴[21 Oct 24 05:18 UTC] No.41900887[source]▶
>I thought it was common knowledge that it was impossible to tell whether text was generated by AI.

Anyone who's been around AI generated content for more than five minutes can tell you what's legitimate and what isn't.

For example this: https://www.maersk.com/logistics-explained/transportation-an... is obviously an AI article.

replies(3): >>41900902 #>>41901127 #>>41901323 #
kreyenborgi ◴[21 Oct 24 06:43 UTC] No.41901323[source]▶
Obviously false, as LLMs parrot what they're trained on. Not that hard to get them to regurgitate Shakespeare or what have you.
replies(1): >>41901557 #
Daz1 ◴[21 Oct 24 07:25 UTC] No.41901557[source]▶
Sounds like a skill issue on your part
replies(1): >>41901832 #
1. kreyenborgi ◴[21 Oct 24 08:13 UTC] No.41901832[source]▶
Let's test your skills as a plagiarism detector. Below are two paragraphs. One of them was written by an LLM, one by a human. I have only altered whitespace in order to make them scan the same. Can you tell which is which? How much would you bet that you are correct?

A. The Pathfinder and The Deerslayer stand at the head of Cooper's novels as artistic creations. There are others of his works which contain parts as perfect as are to be found in these, and scenes even more thrilling. Not one can be compared with either of them as a finished whole. The defects in both of these tales are comparatively slight. They were pure works of art.

B. The Pathfinder and The Deerslayer stand at the head of Cooper's novels as artistic creations. There are others of his works which contain parts as perfect as are to be found in these, and scenes even more thrilling. Not one can be compared with either of them as a finished whole. The defects in both of these tales are comparatively slight. They were pure works of art.

replies(1): >>41902725 #
2. 71bw ◴[21 Oct 24 10:44 UTC] No.41902725[source]▶
One is the original, the second one is an AI verbatim copy

https://www.gutenberg.org/files/3172/3172-h/3172-h.htm#:~:te....

replies(1): >>41903769 #
3. eulenteufel ◴[21 Oct 24 13:07 UTC] No.41903769[source]▶
Unfortunately the essays of your students can not be found on gutenberg.org. You have to try evaluating only the text and it's context to guess what's LLM-generated.