←back to thread

Using LLMs at Oxide

(rfd.shared.oxide.computer)
694 points steveklabnik | 1 comments | 07 Dec 25 01:17 UTC | HN request time: 0.201s | source
Show context
cobertos ◴[07 Dec 25 05:50 UTC] No.46179465[source]▶
> LLMs are especially good at evaluating documents to assess the degree that an LLM assisted their creation!)

That's a bold claim. Do they have data to back this up? I'd only have confidence to say this after testing this against multiple LLM outputs, but does this really work for, e.g. the em dash leaderboard of HN or people who tell an LLM to not do these 10 LLM-y writing cliches? I would need to see their reasoning on why they think this to believe.

replies(3): >>46180279 #>>46180384 #>>46182998 #
1. elAhmo ◴[07 Dec 25 09:03 UTC] No.46180279[source]▶
I would be surprised they have any data about this. There are so many ways LLMs can be involved, from writing everything, to making text more concise or just "simple proofreading". Detecting all this with certainty is not trivial and probably not possible with the current tools we have.