←back to thread

416 points floverfelt | 1 comments | | HN request time: 0.351s | source
Show context
bko ◴[] No.45056268[source]
> Certainly if we ever ask a hallucination engine for a numeric answer, we should ask it at least three times, so we get some sense of the variation.

This works on people as well!

Cops do this when interrogating. You tell the same story three times, sometimes backwards. It's hard to keep track of everything if you're lying or you don't recall clearly so you can get a sense of confidence. Also works on interviews, ask them to explain a subject in three different ways to see if they truly understand.

replies(4): >>45056315 #>>45056413 #>>45058249 #>>45061677 #
inerte ◴[] No.45058249[source]
Triple modular redundancy. I remember reading that's how Nasa space shuttles calculate things because a processor / memory might have been affected by space radiation https://llis.nasa.gov/lesson/18803
replies(1): >>45061157 #
1. anon7725 ◴[] No.45061157[source]
Triple redundancy works because you know that under nominal conditions each computer would produce the correct result independently. If 2 out of 3 computers agree, you have high confidence that they are correct and the 3rd one isn’t.

With LLMs you have no such guarantee or expectation.