←back to thread

Can LLMs accurately recall the Bible?

(benkaiser.dev)
223 points benkaiser | 2 comments | 29 Dec 24 03:44 UTC | HN request time: 0.414s | source
Show context
asim ◴[29 Dec 24 06:22 UTC] No.42538054[source]▶
I had similar thoughts about using it for the Quran. I think this highlights you have to be very specific in your use cases especially when expecting an exact response on static text that shouldn't change. This is why I'm trying something a bit different. I've generated embeddings for the Quran and use chromem-go for this. So I'll ask the index the question first based on a similarity search and then feed the results in as context to an LLM. But in the response I'll still sight the references so I can see what they were. It's not perfect but a first step towards something. I think they call this RAG.

What I'm working on https://reminder.dev

replies(6): >>42538137 #>>42538188 #>>42538217 #>>42543891 #>>42545257 #>>42548243 #
1. joshuamcginnis ◴[30 Dec 24 01:00 UTC] No.42545257[source]▶
I asked it:

> How can the Qur'an acknowledge the Torah (Tawrat), Psalms (Zabur), and the Gospel (Injil) as divine revelations from God (Allah) yet deny the deity of Jesus Christ. Don't these contradictions falsify the truth of the text?

It gave the classic counter argument:

> A: The Qur'an acknowledges the Torah, Psalms, and Gospel as divine revelations from God, emphasizing their role as guidance for their respective communities. However, it also teaches that these scriptures were either altered or misinterpreted over time.

Of course, the Qu'ran makes these theological assertions rather than one grounded in concrete historical or manuscript evidence. Nevertheless, your app does a good job at fairly representing the beliefs of the Qur'an.

replies(1): >>42547420 #
2. logicchains ◴[30 Dec 24 07:54 UTC] No.42547420[source]▶
It's possible to accept the Gospel as divine revelations while denying the divinity of Jesus Christ: there's a large sect called Unitarians that do precisely that. https://www.biblicalunitarian.com/100-scriptural-arguments-f... are some of the verses they based their arguments on. Similarly in early Christianity there were many Arian Christians, who did not believe in the Trinity, but they were eventually violently suppressed by the Roman Emperor on penalty of death.