←back to thread

427 points JumpCrisscross | 2 comments | | HN request time: 0.407s | source
Show context
lwhi ◴[] No.41901852[source]
It is no longer effective to solely use a written essay to measure how deeply a student comprehends a subject.

AI is here to stay; new methods should be used to assess student performance.

I remember being told at school, that we weren't allowed to use calculators in exams. The line provided by teachers was that we could never rely on having a calculator when we need it most—obviously there's irony associated with having 'calculators' in our pockets 24/7 now.

We need to accept that the world has changed; I only hope that we get to decide how society responds to that change together .. rather than have it forced upon us.

replies(26): >>41902001 #>>41902004 #>>41902006 #>>41902027 #>>41902041 #>>41902094 #>>41902144 #>>41902281 #>>41902432 #>>41902446 #>>41902471 #>>41902612 #>>41902683 #>>41902805 #>>41902892 #>>41903019 #>>41903144 #>>41903279 #>>41903529 #>>41903547 #>>41903572 #>>41903881 #>>41904424 #>>41904494 #>>41904546 #>>41905807 #
pjc50 ◴[] No.41902041[source]
> I only hope that we get to decide how society responds to that change together .. rather than have it forced upon us.

That basically never happens and the outcome is the result of some sort of struggle. Usually just a peaceful one in the courts and legislatures and markets, but a struggle nonetheless.

> new methods should be used to assess student performance.

Such as? We need an answer now because students are being assessed now.

Return to the old "viva voce" exam? Still used for PhDs. But that doesn't scale at all. Perhaps we're going to have to accept that and aggressively ration higher education by the limited amount of time available for human-to-human evaluations.

Personally I think all this is unpredictable and destabilizing. If the AI advocates are right, which I don't think they are, they're going to eradicate most of the white collar jobs and academic specialties for which those people are being trained and evaluated.

replies(11): >>41902087 #>>41902096 #>>41902246 #>>41902261 #>>41902287 #>>41902324 #>>41902349 #>>41902440 #>>41902449 #>>41902820 #>>41904142 #
ben_w ◴[] No.41902096[source]
> Such as? We need an answer now because students are being assessed now.

My current best guess, is to hand the student stuff that was written by an LLM, and challenge them to find and correct its mistakes.

That's going to be what they do in their careers, unless the LLMs get so good they don't need to, in which case https://xkcd.com/810/ applies.

> Personally I think all this is unpredictable and destabilizing. If the AI advocates are right, which I don't think they are, they're going to eradicate most of the white collar jobs and academic specialties for which those people are being trained and evaluated.

Yup.

I hope the e/acc types are wrong, we're not ready.

replies(2): >>41902277 #>>41903451 #
erikerikson ◴[] No.41903451[source]
> e/acc types

Please expand?

replies(1): >>41904054 #
1. ben_w ◴[] No.41904054[source]
Effective Acceleration, the promotion of rapid AI development and roll out, appealing to all the deaths and suffering that can be prevented if we have the Singularity a year early.

Extremely optimistic about the benefits of new tech, downplay all the risks, my experience of self-identifying e/acc people has generally been that they assume AI alignment will happen by default or be solved in the marketplace… and specifically where I hope they're wrong, is that many seem to think this is all imminent, as in 3-5 years.

If they're right about everything else then we're all going to have a great time regardless of when it comes, but I don't see human nature being compatible with even just an LLM that can do a genuinely novel PhD's worth of research rather than "merely" explain it or assist with it (impressive though even those much easier targets are).

replies(1): >>41905122 #
2. erikerikson ◴[] No.41905122[source]
TYVM. Hopefully the inability to see ways this could go wrong or really look at the problem is sufficiently correlated with the lack of the tools required for progress.