Most active commenters
  • deepsun(3)

←back to thread

399 points pseudolus | 21 comments | | HN request time: 1.233s | source | bottom
Show context
dtnewman ◴[] No.43633873[source]

> A common question is: “how much are students using AI to cheat?” That’s hard to answer, especially as we don’t know the specific educational context where each of Claude’s responses is being used.

I built a popular product that helps teachers with this problem.

Yes, it's "hard to answer", but let's be honest... it's a very very widespread problem. I've talked to hundreds of teachers about this and it's a ubiquitous issue. For many students, it's literally "let me paste the assignment into ChatGPT and see what it spits out, change a few words and submit that".

I think the issue is that it's so tempting to lean on AI. I remember long nights struggling to implement complex data structures in CS classes. I'd work on something for an hour before I'd have an epiphany and figure out what was wrong. But that struggling was ultimately necessary to really learn the concepts. With AI, I can simply copy/paste my code and say "hey, what's wrong with this code?" and it'll often spot it (nevermind the fact that I can just ask ChatGPT "create a b-tree in C" and it'll do it). That's amazing in a sense, but also hurts the learning process.

replies(34): >>43633957 #>>43634006 #>>43634053 #>>43634075 #>>43634251 #>>43634294 #>>43634327 #>>43634339 #>>43634343 #>>43634407 #>>43634559 #>>43634566 #>>43634616 #>>43634842 #>>43635388 #>>43635498 #>>43635830 #>>43636831 #>>43638149 #>>43638980 #>>43639096 #>>43639628 #>>43639904 #>>43640528 #>>43640853 #>>43642243 #>>43642367 #>>43643255 #>>43645561 #>>43645638 #>>43646665 #>>43646725 #>>43647078 #>>43654777 #
enjo ◴[] No.43640528[source]

> it's literally "let me paste the assignment into ChatGPT and see what it spits out, change a few words and submit that".

My wife is an accounting professor. For many years her battle was with students using Chegg and the like. They would submit roughly correct answers but because she would rotate the underlying numbers they would always be wrong in a provably cheating way. This made up 5-8% of her students.

Now she receives a parade of absolutely insane answers to questions from a much larger proportion of her students (she is working on some research around this but it's definitely more than 30%). When she asks students to recreate how they got to these pretty wild answers they never have any ability to articulate what happened. They are simply throwing her questions at LLMs and submitting the output. It's not great.

replies(6): >>43640669 #>>43640941 #>>43641433 #>>43642050 #>>43642506 #>>43643150 #
DSingularity ◴[] No.43640669[source]

This is now reality -- fighting to change the students is a losing battle. Besides in terms of normalizing grade distributions this is not that complicated to solve.

Target the cheaters with pop quizzes. Prof can randomly choose 3 questions from assignments. If students cant get enough marks on 2/3 of them they are dealt a huge penalty. Students that actually work through the problems will have no problems with scoring enough marks on 2/3 of the questions. Students that lean irresponsibly on LLMs will lose their marks.

replies(2): >>43640891 #>>43640910 #
cellularmitosis ◴[] No.43640910[source]

Why not just grade solely based on live performance? (quizzes and tests)

Homework would still be assigned as a learning tool, but has no impact on your grade.

replies(6): >>43641029 #>>43641123 #>>43641987 #>>43642145 #>>43643397 #>>43652773 #
1. deepsun ◴[] No.43641123[source]

I've heard that's how studying is done in Oxford/Cambridge: https://en.wikipedia.org/wiki/Tutorial_system

replies(5): >>43641367 #>>43641640 #>>43641919 #>>43641978 #>>43642951 #
2. vmilner ◴[] No.43641367[source]

Certainly with maths you’re marked almost totally on written exams, but even if that weren’t true you’re also required to go over example sheets (hard homework questions that don’t form part of the final mark) with a tutor in two-student sessions so it’d be completely obvious if you were relying on AI.

replies(2): >>43641692 #>>43643413 #
3. HPsquared ◴[] No.43641640[source]

Funnily enough, the best use of AI in education is to serve as exactly this kind of tutor. This is the future of education.

replies(1): >>43641929 #
4. miningape ◴[] No.43641692[source]

I really like oral exams on top of regular exams. The teacher can ask questions and dive into specific areas - it'll be obvious who is just using LLMs to answer the questions vs those who use LLMs to tutor them.

replies(1): >>43647380 #
5. pja ◴[] No.43641919[source]

The tutorial system is just for teaching, not grading. It does keep students honest with themselves about their progress when they’re personally put on the spot once a week in front of one or two of their peers.

replies(1): >>43643872 #
6. pja ◴[] No.43641929[source]

The promise of the expansion of this kind of tutorial teaching to everyone via AI is great. The problem is keeping students honest with themselves.

replies(1): >>43643559 #
7. sersi ◴[] No.43641978[source]

That's also how it's done in almost all French engineering schools. You get open book tests with a small amount of relatively difficult questions and you have 3-4 hours to complete.

In some of the CS tests, coding by hand sucks a bit but to be honest, they're ok with pseudo code as long as you show you understand the concepts.

replies(1): >>43642015 #
8. kgwgk ◴[] No.43642015[source]

The European mind cannot comprehend take-home exams.

replies(4): >>43642080 #>>43642593 #>>43644123 #>>43647258 #
9. ghaff ◴[] No.43642080{3}[source]

I don’t recall take home exams being at all common undergrad in the US. Open book or one page formula sheets more so.

10. danielbln ◴[] No.43642593{3}[source]

There is no European mind when it comes to education, hell, there is barely a national mind for those countries with federated education systems (e.g. Germany).

11. rahimnathwani ◴[] No.43642951[source]

Yes, my undergrad degree grade was determined solely by my performance on 8 three-hour exams at the end of the final year.

12. guappa ◴[] No.43643413[source]

In italy there's an oral in most exams. In math exams you're asked proofs of theorems (that were part of the course).

13. pc86 ◴[] No.43643559{3}[source]

At the end of the day you can't force people to learn if they don't want to.

As a society we need to be okay with failing people who deserve to fail and not drag people across the finish line at the expense of diluting the degrees of everyone else who actually put in effort.

replies(2): >>43648316 #>>43652088 #
14. owlbite ◴[] No.43643872[source]

The biggest contrast for me between Oxbridge and another red brick was the Oxbridge tutors aren't shy of saying "You've not done the homework, go away and stop wasting my time", whereas the red brick approach was to pick you up and carry you over the finishing line (at least until the hour was up).

15. baud147258 ◴[] No.43644123{3}[source]

in France I got a bunch of equivalent take-home tests, between high school and graduate level, mostly in math and science. The teacher would give us exercice equivalent to what we'd get in our exams and we'd have one week to complete it (sometimes in pairs) and it'd be graded as part of that semester

16. sersi ◴[] No.43647258{3}[source]

Well take home exams are not very useful nowadays with AI. And yeah, other commenters are right when he says there's no European mind when it comes to education, each country does its own thing.

17. deepsun ◴[] No.43647380{3}[source]

Of course, the reasons they do quizes is to optimize the process (need less tutors/examiners), and to remove bias (any tutor holds biases one way or the other).

18. deepsun ◴[] No.43648316{4}[source]

I only partially agree with "you can't force people". I think that all people are just like children, but bigger. You can force a kid to not eat to much sugar, even when they want to.

Same with education, for example you can financially force people to learn, say, computer science instead of liberal arts. Even when they don't like it. It's harder, less efficient, but possible.

19. amanaplanacanal ◴[] No.43652088{4}[source]

I'm not sure why we care about the degree. Employers care about the degree, but they aren't paying for my education.

The students who want to learn, will learn. For the students who just want the paper so they can apply for jobs, we ought to give them their diploma on the first day of class, so they can stop wasting everybody's time.

replies(2): >>43654826 #>>43656025 #
20. chipsrafferty ◴[] No.43654826{5}[source]

Then employers will stop caring about the degree...

21. pc86 ◴[] No.43656025{5}[source]

Employers want the degree because it's supposed to verify that you have a certain set of knowledge and/or skills, or at the very least, you're capable of thought to the extent required to get that degree. That's the only reason they want it.

Student being unable to unwilling to learn that knowledge or acquire those skills should mean they don't get that degree, they don't get those jobs, and they go work in fast food or a warehouse.

"Just give them the degree" is quite literally the worst possible solution to the problem.