Can LLMs accurately recall the Bible?

(benkaiser.dev)

223 points benkaiser | 1 comments | 29 Dec 24 03:44 UTC | HN request time: 0.218s | source

Show context

danpalmer ◴[30 Dec 24 03:18 UTC] No.42546115[source]▶

LLMs are bad databases, so for something like a bible which is so easily and precisely referenced, why not just... look it up?

This is playing against their strengths. By all means ask them for a summary, or some analysis, or textual comparison, but please, please stop treating LLMs as databases.

replies(2): >>42546183 #>>42546545 #

madiator ◴[30 Dec 24 03:33 UTC] No.42546183[source]▶

>>42546115 #

Not sure why you are so upset about a small and neat study ("please, please stop"). If you ask it to summarize (without feeding the entire bible), it needs to know the bible. Knowledge and reasoning are not entirely disconnected.

replies(2): >>42546430 #>>42546695 #

1. nwatson ◴[30 Dec 24 04:16 UTC] No.42546430[source]▶

>>42546183 #

ChatGPT chat interface has impressed me when going beyond the scope presented on TFA, eg, when asking about predestination, biblical passages for and against, theologians' and scholars' takes on the debate, and exploring the details in subsequent follow-ups. The LLMs have been fed the Bible and all manner of discussions of Bible-related matters. Like the grandparent comment suggests, the LLMs are much more impressive at interpreting biblical passages and presenting the varieties of opinions about them, or finding passages related to specific topics and presenting opinions.

↑