Most active commenters

    ←back to thread

    395 points pseudolus | 14 comments | | HN request time: 0.008s | source | bottom
    Show context
    dtnewman ◴[] No.43633873[source]
    > A common question is: “how much are students using AI to cheat?” That’s hard to answer, especially as we don’t know the specific educational context where each of Claude’s responses is being used.

    I built a popular product that helps teachers with this problem.

    Yes, it's "hard to answer", but let's be honest... it's a very very widespread problem. I've talked to hundreds of teachers about this and it's a ubiquitous issue. For many students, it's literally "let me paste the assignment into ChatGPT and see what it spits out, change a few words and submit that".

    I think the issue is that it's so tempting to lean on AI. I remember long nights struggling to implement complex data structures in CS classes. I'd work on something for an hour before I'd have an epiphany and figure out what was wrong. But that struggling was ultimately necessary to really learn the concepts. With AI, I can simply copy/paste my code and say "hey, what's wrong with this code?" and it'll often spot it (nevermind the fact that I can just ask ChatGPT "create a b-tree in C" and it'll do it). That's amazing in a sense, but also hurts the learning process.

    replies(34): >>43633957 #>>43634006 #>>43634053 #>>43634075 #>>43634251 #>>43634294 #>>43634327 #>>43634339 #>>43634343 #>>43634407 #>>43634559 #>>43634566 #>>43634616 #>>43634842 #>>43635388 #>>43635498 #>>43635830 #>>43636831 #>>43638149 #>>43638980 #>>43639096 #>>43639628 #>>43639904 #>>43640528 #>>43640853 #>>43642243 #>>43642367 #>>43643255 #>>43645561 #>>43645638 #>>43646665 #>>43646725 #>>43647078 #>>43654777 #
    enjo ◴[] No.43640528[source]
    > it's literally "let me paste the assignment into ChatGPT and see what it spits out, change a few words and submit that".

    My wife is an accounting professor. For many years her battle was with students using Chegg and the like. They would submit roughly correct answers but because she would rotate the underlying numbers they would always be wrong in a provably cheating way. This made up 5-8% of her students.

    Now she receives a parade of absolutely insane answers to questions from a much larger proportion of her students (she is working on some research around this but it's definitely more than 30%). When she asks students to recreate how they got to these pretty wild answers they never have any ability to articulate what happened. They are simply throwing her questions at LLMs and submitting the output. It's not great.

    replies(6): >>43640669 #>>43640941 #>>43641433 #>>43642050 #>>43642506 #>>43643150 #
    DSingularity ◴[] No.43640669[source]
    This is now reality -- fighting to change the students is a losing battle. Besides in terms of normalizing grade distributions this is not that complicated to solve.

    Target the cheaters with pop quizzes. Prof can randomly choose 3 questions from assignments. If students cant get enough marks on 2/3 of them they are dealt a huge penalty. Students that actually work through the problems will have no problems with scoring enough marks on 2/3 of the questions. Students that lean irresponsibly on LLMs will lose their marks.

    replies(2): >>43640891 #>>43640910 #
    cellularmitosis ◴[] No.43640910[source]
    Why not just grade solely based on live performance? (quizzes and tests)

    Homework would still be assigned as a learning tool, but has no impact on your grade.

    replies(6): >>43641029 #>>43641123 #>>43641987 #>>43642145 #>>43643397 #>>43652773 #
    1. foxglacier ◴[] No.43641029[source]
    Because students wouldn't do the homework and would fail the quizzes. Students need to be pressured into learning and grades for doing the practice are a way. Don't pretend many students are self-motivated enough to follow the lecturer's instructions when there's no grade in it and insisting that "trust me, you won't learn if you don't do it".
    replies(8): >>43641094 #>>43641449 #>>43641500 #>>43641517 #>>43641991 #>>43643424 #>>43644559 #>>43646082 #
    2. chii ◴[] No.43641094[source]
    > would fail the quizzes.

    not those who did actually do the work, and learnt.

    The change ought to be that students are allowed to be failed, and this should be a form of punishment for those who "cheat".

    replies(1): >>43642427 #
    3. Unroasted6154 ◴[] No.43641449[source]
    I've mostly had non-graded homework in my studies because cheating was always easy. In highschool they might have told your parents if you don't do homework. In university you do what you want. It's never been an issue overall.
    4. kazinator ◴[] No.43641500[source]
    Or, well, LLM wouldn't do the homework anymore --- which was the sought-after outcome.
    5. boxed ◴[] No.43641517[source]
    The pop quizzes being part of the grade was the entire point of the comment you replied to. I guess you misread?
    6. sersi ◴[] No.43641991[source]
    When I was a student, I spent my first 2 years in a so-called prépa intégré of a French engineering school. 20% of students failed and were shown the door during those two years (some failed, some figured that it just wasn't for them). That's fine, that means you keep the ones who actually do the work. At a certain point, you have to start treating students like adult, either they succeed or they don't but it's their personal responsibility.
    replies(1): >>43643463 #
    7. lelanthran ◴[] No.43642427[source]
    Aren't students already allowed to fail?

    As a comment upthread said, let them cheat on the take home as much as they want to, they're still going to fail the exam.

    replies(2): >>43642661 #>>43643042 #
    8. fhd2 ◴[] No.43642661{3}[source]
    Well, from what I understand, the answer is kinda "no".

    Depends on the country and educational system I suppose, but I do believe professors in many places get in trouble for failing too many students. It's right there in the phrasing.

    If most students pass and some fail, that's fine. Revenue comes in, graduates are produced, the university is happy.

    If most students fail, revenue goes down, less students might sign up, less graduate, the university is unhappy.

    It's a tragedy of the commons situation, because some professors will be happy to pass the majority of students regardless of merit. Then the professors that don't become the problem, there's something wrong with them.

    Likewise, if most universities are easy and some are really hard, they might not attract students. The US has this whole prestige thing going on, that I haven't seen all that much in other countries.

    So if the students overall get dumber because they grow up over relying on tools, the correction mechanism is not that they have to work harder once the exam approaches. It's that the exam gets easier.

    9. NiloCK ◴[] No.43643042{3}[source]
    > Aren't students already allowed to fail?

    It's technically allowed on an individual basis, but the economics don't work for any institution to attempt to raise its bar.

    If institutions X and Y grant credential Z, and X starts failing a third of its students, who would apply to go there?

    replies(1): >>43643693 #
    10. guappa ◴[] No.43643424[source]
    If they fail they learn that they have to study.
    11. guappa ◴[] No.43643463[source]
    That looks bad in the international statistics and so on, there's a lot of pressure to just pass everyone.

    In Italy university keeps getting easier because their funding is tied to not failing students.

    12. pc86 ◴[] No.43643693{4}[source]
    For the most part degrees from roughly comparable schools in the same subject are fungible. However, graduating cheaters who should have flunked out of school their freshman year is a one-way ticket to having a reputation that your degree is worthless. You're now comparable to a lower tier of schools and suddenly Y's degree is worth a lot more than yours. The best way (not to only way) to combat this is to actively cull the bottom of your classes. Most schools already do this by kicking out people with low enough GPAs, academic probation, etc. My undergrad would expel you if you had a GPA below 1.8 after your first semester, and you were on academic probation if your GPA was > 1.8 and <=2.5.

    This assumes, of course, an institution is actively trying to raise the academic bar of its student population. Most schools are emphatically not trying to do this and are focused more on just increasing enrollment, getting more tax dollars, and hiring more administrators.

    13. linkregister ◴[] No.43644559[source]
    Many mathematics professors don't require homework to be turned in for grading. For example, the calculus courses at many US universities. Grades are solely determined by quizzes in the discussion section and by exams. Failure rates are above 30%, but that's accepted.

    This model won't work for subjects that rely on students writing reports. But yes, universities frequently accept that failure rates for some courses will be high, especially for engineering and the sciences.

    14. calfuris ◴[] No.43646082[source]
    My favorite math professor said "your homework is as many of the odd-numbered problems as you feel like you need to do to understand the material" and set a five minute quiz at the start of each lecture which counted as the homework grade. I can't speak for the other students, but I did more homework in his classes than any of the other math classes I took.