←back to thread

Can LLMs accurately recall the Bible?

(benkaiser.dev)
223 points benkaiser | 2 comments | 29 Dec 24 03:44 UTC | HN request time: 0s | source
Show context
cowmix ◴[30 Dec 24 02:06 UTC] No.42545698[source]▶
When I test new LLMs (whether SaaS or local), I have them create a fake post to r/AmItheAsshole from the POV of the older brother in the parable of the Prodigal Son.

It's a great, fun test.

replies(1): >>42546124 #
reynaldi ◴[30 Dec 24 03:21 UTC] No.42546124[source]▶
I’m interested to know if you let the LLMs automatically make posts and interact on their own, or do you only use the response and submit manually?
replies(1): >>42546243 #
1. drdeca ◴[30 Dec 24 03:44 UTC] No.42546243[source]▶
I didn’t get the impression that the GP actually posted them to r/aita , just asked it to write something in the style of such posts
replies(1): >>42550099 #
2. cowmix ◴[30 Dec 24 15:27 UTC] No.42550099[source]▶
This is correct. I just submit the prompt and 'rate it' in my head.

I wish there was a 'historical' or fiction version of that subreddit though.