←back to thread

Do AI detectors work? Students face false cheating accusations

(www.bloomberg.com)
427 points JumpCrisscross | 2 comments | 20 Oct 24 17:26 UTC | HN request time: 0.406s | source
Show context
mikeyinternews ◴[21 Oct 24 13:12 UTC] No.41903806[source]▶
One of my kid's teachers sent out a warning to students that all essays would be checked with AI detection software and the repercussions one would face if caught. A classmate did an AI check on the teacher's warning and it came back positive for having been AI-generated.
replies(4): >>41903863 #>>41903940 #>>41903941 #>>41906606 #
1. bbor ◴[21 Oct 24 13:27 UTC] No.41903941[source]▶
Hah, that’s great! Hopefully this dramatic chapter in history is a short one, and we learn to adapt away from graded homework. A 4% false positive rate is insane when that could mean failure and/or expulsion, and even more so when any serious cheater can get around in two minutes with a “write in the style of…” preprompt.
replies(1): >>41904000 #
2. baby_souffle ◴[21 Oct 24 13:33 UTC] No.41904000[source]▶
> Hopefully this dramatic chapter in history is a short one

Doubtful. This is a new sector/era in the cat-v-mouse game.

> we learn to adapt away from graded homework.

Nothing proposed as an alternative scales well and - ironically - it's likely that something _like_ an LLM will be used to evaluate pupil quality / progress over time.