Do AI detectors work? Students face false cheating accusations

That's kinda nuts how adult people learned to trust some random algorithms in a year or two. They don't know how it works, they cannot explain it, they don't care, it just works. It's magic. If it says you cheated, you cheated. You cannot do anything about it.

I want to emphasize, that this isn't really about trusting magic, it's about people nonchalantly doing ridiculous stuff nowdays and that they aren't held accountable for that, apparently. For example, there were times back at school when I was "accused" of cheating, because it was the only time when I liked the homework at some class and took it seriously, and it was kinda insulting to hear that there's absolutely no way I did it, but I still got my mark, because it doesn't matter what she thinks if she cannot prove it, so please just sign it and fuck off, it's the last time I'm doing my homework at your class anyway.

On the contrary, if this article to be believed, these teachers don't have to prove anything, the fact that a coin flipped heads is considered enough of a proof. And everyone supposedly treats it as if it's ok. "Well, they have this system at school, what can we do!" It's crazy.

It is not a bug, it is a feature.

That's how you can mold society as you like at your level: this student's older sibling was a menace? Let's fuck them over, being shitty must run in the family. You don't like the race / gender / sexuality of a student? Now "chatGPT" can give you an easy way to make their school life harder.

See HyperNormalisation.

> They don't know how it works, they cannot explain it, they don't care, it just works. It's magic. If it says you cheated, you cheated. You cannot do anything about it.

People trust a system because other people trust a system.

It does not matter if the system is the inquisition looking for witches, machine or Gulag from USSR.

The system said you are guilty. The system can’t be wrong.

Kafka is rolling in his grave.

This is not about ChatGPT. The same happens in HR departments And governments.

Just introduce an incomprehensible process, Like applying for a Visa or planning permission, and then use it to your advantage.

From the victims perspective, there is no difference between bureaucracy and AI

> This is not about ChatGPT.

I agree. But now some people can point to ChatGPT or other tools and use it as an excuse. So for them, the "bugs" are a feature. They don't care about false positives, they care about the fact some authority tells them a student they don't like used AI to write an essay.

Someone here at HN made a great observation about this. The problem with neural networks and their generated output is that they are programs, running on the computers. We have been training humans for more than three decade that computers are producing precise, correct and reproducible outputs. And now these NN corporations have created a random symbol generators, and they actively hide the fact that there is programmed randomness in their programs.

There was recent article about yet another generated text in the US court, this time without malicious intent (it seems). The article boils down to the fact that the plaintiff asked neural network to do a historical financial calculation of property cost and immediately trusted it, "because computers". Computers are always correct, NNs run on computers, hence they are always correct :) . Soon this mentality will be in every household on the planet. We will be remembering days of media dishonesty and propaganda with fondness, at least previously we kinda could discern if the source was intentionally lying.

the ai companies should have had the foresight to guide educators given the hassle they unleashed on them.

> That's kinda nuts how adult people learned to trust some random algorithms in a year or two. They don't know how it works, they cannot explain it, they don't care, it just works. It's magic.

Well, you shouldn’t be so surprised. You just described 95%+ of the population’s approach to any form of technology. And there’s very rarely any discomfort with such ignorance, nor any desire to learn even the basics. It’s very hard to understand for me — some of us just have to know!