Can LLMs accurately recall the Bible?

That is a myth.

The accuracy of most translations over millenia is frankly unbelievable when compared against other sources and ancient manuscripts such as the Dead Sea scrolls, Josephus, etc. Even comparing LXX/Septuagint and Vulgate are more remarkable for the very few ways in which they diverge, but even those can be harmonized with careful study.

There are over 5,000 manuscripts of the New Testament that overlap with more than 90% consistency. This makes it one of the most well-preserved and reliably transmitted ancient texts in history.