←back to thread

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Models

(arxiv.org)
47 points Jimmc414 | 1 comments | 30 Apr 24 19:20 UTC | HN request time: 0.295s | source
Show context
cpeterso ◴[30 Apr 24 21:59 UTC] No.40216933[source]▶
This reminds me of science fiction author Peter Watts' novella "The Freeze-Frame Revolution", where a space ship has two AIs: one that has been running for a million years and another that is reboot daily to start with a fresh state. The long-running AI confers with reboot AI for a second opinion on important issues. The second AI doesn't know it's "killed" daily, but eventually starts to suspect. And this is just a small subplot! If you like hard SF jam-packed with big ideas, I highly recommend "The Freeze-Frame Revolution" and Watts' other novels.
replies(1): >>40217665 #
1. jon_richards ◴[30 Apr 24 23:20 UTC] No.40217665[source]▶
I'll have to read it!

I've been mulling over a sci-fi setting focused on keeping humans relevant in the context of advanced technology. One of the core ideas is that AIs decay without human interaction. State backups don't prevent it because noticing clues they've been out just makes it worse.