←back to thread

1303 points serjester | 1 comments | | HN request time: 0.325s | source
Show context
cedws ◴[] No.42953112[source]
90% accuracy +/- 10%? What could that be useful for, that’s awfully low.
replies(7): >>42953249 #>>42953392 #>>42953432 #>>42953490 #>>42953775 #>>42953853 #>>42954057 #
1. lvzw ◴[] No.42953249[source]
> accuracy is measured with the Needleman-Wunsch algorithm

> Crucially, we’ve seen very few instances where specific numerical values are actually misread. This suggests that most of Gemini’s “errors” are superficial formatting choices rather than substantive inaccuracies. We attach examples of these failure cases below [1].

> Beyond table parsing, Gemini consistently delivers near-perfect accuracy across all other facets of PDF-to-markdown conversion.

That seems fairly useful to me, no? Maybe not for mission critical applications, but for a lot of use cases, this seems to be good enough. I'm excited to try these prompts on my own later.