My wife works in healthcare and they just announced that AI would generate 50% of their documents. According to my wife, every in every review she's done of the work, there are critical errors in logic or reasoning (hallucinations), but leadership doesn't care because they a "grading" the AI on things like grammar and spelling. So, yay, it spelled "fusospirochetosis" correctly, but unfortunately it attributed that to a 23 year old woman who came in for a broken arm.
I think we need to be prepared for "vibe coding" taking over every industry. Leadership is going to blindly implement broken AI to replace workers.
Now, you might think that threat of lawsuits, regulations, and ethics standards will save your industry. And maybe that's true, but I personally don't think so. I personally think we are going to see country-scale enshitification of everything as lazy people use AI to generate everything which is then reviewed by lazy people who also use AI to review everything and no one notices or cares until it's too late (and maybe not even then).
I hope you're right, but I'm not convinced.
Sound about right to me. A large quantity of documentation is written solely to be written, not read. If it's your job to write reports, article, memos, whatever, and you deep down know that this isn't being read, then why not have to AI do it?
I think that we're producing way to many documents/reports/content in general and we need to slow down. Humans can't keep up, neither on the production side, nor the consumption, so we employ computers to "help", but it's all busy work.
If AI could cause a fiasco on the level of Toyota's unintended acceleration debacle from 2008, which caused the largest auto recall in history, that is something that would give pause to using AI, no? If AI leads to bad products that kill people, companies will lose money and they will not want to use AI.
After about 3 months of doing this, I asked my manager why I was doing this if no-one cared or noticed. He told me to stop and see if anyone said something. I stopped, interned another 15 months and it wasn't ever mentioned.
Hell of a lesson to learn as a newbie
Medical records seems to be the opposite of this. Nurses document to report to doctors so they can diagnose and advise. That seems like the worst step to cut corners on. Accountants document reports for patient for prescriptions and diagnosis that can affect their lives. Heck, as a CYA you document records in case a law firm comes in demanding papers to read. Do they think lawyers don't care about this stuff?
Just because not everyone is gonna pour over ever word doesn't mean no one will.
Not saying you were wrong to drop, but multiple people dropped the BL there if there how they are treating their testing.