←back to thread

178 points ohjeez | 1 comments | | HN request time: 0.743s | source
Show context
pcrh ◴[] No.44474775[source]
How is an LLM supposed to review an original manuscript?

At their core (and as far as I understand), LLMs are based on pre-existing texts, and use statistical algorithms to stitch together text that is consistent with these.

An original research manuscript will not have formed part of any LLMs training dataset, so there is no conceivable way that it can evaluate it, regardless of claims that LLMs "understand" anything or not.

Reviewers who use LLMs are likely deluding themselves that they are now more productive due to use of AI, when in fact they are just polluting science through their own ignorance of epistemology.

replies(3): >>44474852 #>>44474964 #>>44475084 #
1. analog31 ◴[] No.44475084[source]
It's like anybody else managing their workload. Professors assign the papers to their grad students to review. Overworked grad student feeds it into the LLM. It doesn't matter if the work is novel, only that it produces something that looks like a review.