←back to thread

427 points JumpCrisscross | 2 comments | | HN request time: 0.001s | source
Show context
lwhi ◴[] No.41901852[source]
It is no longer effective to solely use a written essay to measure how deeply a student comprehends a subject.

AI is here to stay; new methods should be used to assess student performance.

I remember being told at school, that we weren't allowed to use calculators in exams. The line provided by teachers was that we could never rely on having a calculator when we need it most—obviously there's irony associated with having 'calculators' in our pockets 24/7 now.

We need to accept that the world has changed; I only hope that we get to decide how society responds to that change together .. rather than have it forced upon us.

replies(26): >>41902001 #>>41902004 #>>41902006 #>>41902027 #>>41902041 #>>41902094 #>>41902144 #>>41902281 #>>41902432 #>>41902446 #>>41902471 #>>41902612 #>>41902683 #>>41902805 #>>41902892 #>>41903019 #>>41903144 #>>41903279 #>>41903529 #>>41903547 #>>41903572 #>>41903881 #>>41904424 #>>41904494 #>>41904546 #>>41905807 #
gklitz ◴[] No.41902805[source]
Written assay evaluation is not and has never been an effective evaluation. It was always a cost saving measure because allocating 30min face to face time with each individual student for each class is such a gigantic cost for the institution that they cannot even imagine doing it. Think about that the next time you look at your student debt, it couldn’t even buy you 30min time per class individually with the teacher to evaluate your performance. Instead you had to waste more time on a written assignment so they could offload grading to a minimum wage assistent.
replies(10): >>41902890 #>>41903033 #>>41903100 #>>41903238 #>>41903325 #>>41903978 #>>41903995 #>>41904389 #>>41905332 #>>41905671 #
mountainb ◴[] No.41903238[source]
You can still do written essay evaluations. You could just require proctored exams whether or not you use software like Examsoft. If it's a topic that benefits from writing from a store of material, you can permit students to bring either unlimited supplemental printed material or a limited body of printed material into the exam room.

For longer essays, you can just build in an oral examination component. This face time requirement is just not that hard to include given that even in lecture hall style settings you can rely on graduate student TAs who do not really cost anything. The thing is that the universities don't want to change how they run things. Adjuncts in most subjects don't cost anything and graduate students don't cost anything. They earn less than e.g. backroom stocking workers. This is also why they, by and large, all perform so poorly. 30 minutes of examiner time costs maybe $11 or less. Even for a lecture class with 130 students, that's under $1,500. Big woop.

There are some small changes to grading practices that would make life very hard for AI cheaters, such as even cite checking a portion of citations in an essay. The real problem is that US universities are Soviet-style institutions in which gargantuan amounts of cash are dumped upon them and they pretend to work for it while paying the actual instructors nothing.

replies(1): >>41905475 #
1. cmgbhm ◴[] No.41905475[source]
That’s 8 days of TA time. You’re going to get high variance and most likely having to boil it down to the equivalent of a multiple choice oral exam.

Hiring a n TA to delegate grading that’s hard to verify seems like will cost more than you think.

replies(1): >>41905832 #
2. mountainb ◴[] No.41905832[source]
So get more TAs. They cost less than Class B CDL drivers and will drag themselves over broken glass to take these jobs. And 65 hours of work per semester for oral examinations seems entirely reasonable. A week and a half for an FTE spent observing, with another half week to full week for grading seems completely reasonable for capstone semester work.