←back to thread

Over fifty new hallucinations in ICLR 2026 submissions

(gptzero.me)
504 points puttycat | 1 comments | 07 Dec 25 13:16 UTC | HN request time: 0.253s | source
Show context
jameshart ◴[07 Dec 25 14:50 UTC] No.46182056[source]▶
Is the baseline assumption of this work that an erroneous citation is LLM hallucinated?

Did they run the checker across a body of papers before LLMs were available and verify that there were no citations in peer reviewed papers that got authors or titles wrong?

replies(5): >>46182229 #>>46182238 #>>46182245 #>>46182375 #>>46186305 #
1. _alternator_ ◴[07 Dec 25 15:28 UTC] No.46182375[source]▶
Let me second this: a baseline analysis should include papers that were published or reviewed at least 3-4 years ago.

When I was in grad school, I kept a fairly large .bib file that almost certainly had a mistake or two in it. I don’t think any of them ever made it to print, but it’s hard to be 100% sure.

For most journals, they actually partially check your citations as part of the final editing. The citation record is important for journals, and linking with DOIs is fairly common.