←back to thread

118 points soraminazuki | 7 comments | | HN request time: 0s | source | bottom
Show context
VariousPrograms ◴[] No.45080897[source]
Among many small examples at my job, an incident report summary used to be hand written with a current status and pending actions. Then it was heavily encouraged to start with LLM output and edit by hand. Now it’s automatically generated by an LLM. No one bothers to read the summary anymore because they’re verbose, unfocused, and can be inaccurate. But we’re all hitting our AI metrics now.
replies(4): >>45081002 #>>45081034 #>>45081059 #>>45081071 #
1. incompatible ◴[] No.45081002[source]
If a report can be generated by an LLM and nobody cares about inaccuracies, why was it ever produced in the first place?
replies(6): >>45081052 #>>45081054 #>>45081063 #>>45081282 #>>45082745 #>>45090261 #
2. aniforprez ◴[] No.45081052[source]
Cargo culting
3. VariousPrograms ◴[] No.45081054[source]
People read the summary to see the actual action items instead of reading the whole case. Now the action plan has constant random bullet points like “John Smith will add Mohammad to the email thread. Target date: Tuesday, July 20 2025. This will ensure all critical resources are engaged on the outage and reduce business impact.” or whatever because it’s literally summarizing every email rather than understanding the core of the work that needs doing.
4. zdragnar ◴[] No.45081063[source]
It's not that they weren't useful, it's that someone higher up has to justify the expensive enterprise contract that they've foisted upon everyone else with the vague promise of saving money by using it.

The consumers of the incident report aren't the ones who had any say in using LLMs so they're stuck with less certainty.

5. ironmagma ◴[] No.45081282[source]
Perverse incentives.
6. dkiebd ◴[] No.45082745[source]
It will be funny when one of those reports says that certain steps will be taken in the future to make sure the same incident doesn't occur again, nobody reads the report so nobody notices, and then when the same incident occurs again one of the clients sues.
7. rk06 ◴[] No.45090261[source]
OP mentions it directly in the post. they were "heavily encouraged" and then "they met their AI metrics"

now, this is wrong on so many levels. but that is a different discussion