←back to thread

AI assistants misrepresent news content 45% of the time

(www.bbc.co.uk)
423 points sohkamyung | 2 comments | 22 Oct 25 13:39 UTC | HN request time: 0s | source
Show context
iainctduncan ◴[22 Oct 25 15:44 UTC] No.45670881[source]▶
I'm curious how many people have actually taken the time to compare AI summaries with sources they summarize. I did for a few and ... it was really bad. In my experience, they don't summarize at all, they do a random condensation.. not the same thing at all. In one instance I looked at the result was a key takeaway being the opposite of what it should have been. I don't trust them at all now.
replies(10): >>45671039 #>>45671541 #>>45671813 #>>45672108 #>>45672572 #>>45672678 #>>45673123 #>>45674739 #>>45674888 #>>45675283 #
1. hamasho ◴[22 Oct 25 21:20 UTC] No.45675283[source]▶
I wonder that's because a lot of news titles are clickbait. If they hallucinate the summary based on what the title may suggest, no wonder they misunderstand half of news articles.
replies(1): >>45675565 #
2. iainctduncan ◴[22 Oct 25 21:45 UTC] No.45675565[source]▶
I had the same experience for summaries of private things too. They were just shit!