←back to thread

630 points xbryanx | 1 comments | | HN request time: 0.207s | source
Show context
mike_hearn ◴[] No.44531351[source]
To the NY Times: please don't say they died by suicide. The passive voice makes it sound like some act of God, something regrettable but unavoidable that just somehow happened. It's important not to sugarcoat what happened: the postmasters killed themselves because the British state was imprisoning them for crimes they didn't commit, based on evidence from a buggy financial accounting system. Don't blur the details of what happened by making it sound like a natural disaster.

Horizon is the case that should replace Therac-25 as a study in what can go wrong if software developers screw up. Therac-25 injured/killed six people, Horizon has ruined hundreds of lives and ended dozens. And the horrifying thing is, Horizon wasn't something anyone would have previously identified as safety-critical software. It was just an ordinary point-of-sale and accounting system. The suicides weren't directly caused by the software, but from an out of control justice and social system in which people blindly believed in public institutions that were actually engaged in a massive deep state cover-up.

It is reasonable to blame the suicides on the legal and political system that allowed the Post Office to act in that way, and which put such low quality people in charge. Perhaps also on the software engineer who testified repeatedly under oath that the system worked fine, even as the bug tracker filled up with cases where it didn't. But this is HN, so from a software engineering perspective what can be learned?

Some glitches were of their time and wouldn't occur these days, e.g. malfunctions in resistive touch screens that caused random clicks on POS screens to occur overnight. But most were bugs due to loss of transactionality or lack of proper auditing controls. Think message replays lacking proper idempotency, things like that. Transactions were logged that never really occurred, and when the cash was counted some appeared to be missing, so the Post Office accused the postmasters of stealing from the business. They hadn't done so, but this took place over decades, and decades ago people had more faith in institutions than they do now. And these post offices were often in small villages where the post office was the center of the community, so the false allegations against postmasters were devastating to their social and business lives.

Put simply - check your transactions! And make sure developers can't rewrite databases in prod.

replies(19): >>44531419 #>>44531429 #>>44531441 #>>44531521 #>>44531528 #>>44531663 #>>44531829 #>>44531922 #>>44531950 #>>44531986 #>>44531999 #>>44532057 #>>44532232 #>>44532622 #>>44532757 #>>44532759 #>>44533432 #>>44535081 #>>44538524 #
cedws ◴[] No.44531441[source]
>if software developers screw up

Well, yes, they did screw up, but the fallout was amplified 100x by bad management.

replies(3): >>44531543 #>>44532415 #>>44534970 #
mrkramer ◴[] No.44531543[source]
"The Horizon IT system contained "hundreds" of bugs[0]."

If your accounting software has hundreds of bugs then you are really in the deep shit.

[0]https://en.wikipedia.org/wiki/British_Post_Office_scandal#:~...

replies(7): >>44531604 #>>44531684 #>>44531831 #>>44531853 #>>44532648 #>>44533820 #>>44534107 #
tialaramex ◴[] No.44531831[source]
So long as the jury understands this, it's all fine.

If you're on trial for doing X and your jury is told by a prosecution witness "mrkramer did X" and under cross they admit that's based on computer records which are often bogus, inconsistent, total nonsense, it doesn't take the world's best defence lawyer to secure an "innocent" verdict. That's not a fun experience, but it probably won't drive you to suicide.

One of the many interlocking failures here is that the Post Office, historically a government function, was allowed to prosecute people.

Suppose I work not for the Post Office (by this point a private company which is just owned in full by the government) but for say, an Asda, next door. I'm the most senior member of staff on weekends, so I have keys, I accept deliveries, all that stuff. Asda's crap computer system says I accepted £25000 of Amazon Gift Cards which it says came on a truck from the depot on Saturday. I never saw them, I deny it, there are no Gift Cards in stock at our store.

Asda can't prosecute me. They could try to sue, but more likely they'd call the police. If the police think I stole these Amazon cards, they give the file to a Crown Prosecutor, who works for the government to prosecute criminals. They don't work for Asda and they're looking at a bunch of "tests" which decide whether it makes sense to prosecute people.

https://www.cps.gov.uk/about-cps/how-we-make-our-decisions

But because the Sub-postmasters worked under contract to the Post Office, it could and did in many cases just prosecute them, it was empowered to do that. That's an obvious mistake, in many of these cases if you show a copper, let alone a CPS lawyer your laughable "case" that although this buggy garbage is often wrong you think there's signs of theft, they'll tell you that you can't imprison people on this basis, piss off.

A worse failure is that Post Office people were allowed to lie to a court about how reliable this information was, and indeed they repeatedly lied in later cases where it's directly about the earlier lying. That's the point where it undoubtedly goes from "Why were supposedly incompetent morons given this important job?" where maybe they're morons or maybe they're liars, to "Lying to a court is wrong, send them to jail".

replies(4): >>44532139 #>>44532231 #>>44532264 #>>44534251 #
cameronh90 ◴[] No.44532231[source]
> Asda can't prosecute me.

They can, actually. Anyone in the UK can launch a private prosecution. It's rare because it's expensive and the CPS can (and often do) take over any private prosecution then drop it.

Nevertheless, the power exists and has been intentionally protected by parliament. I think most would agree it needs reform, however.

replies(2): >>44533532 #>>44535079 #
1. carstout ◴[] No.44535079[source]
Unfortunately the "its rare" isnt true. it is more common now than it was back in the horizon days. It also isnt necessarily expensive since you can apply for costs with the default being for it to be paid (unless good reason not to). As such whilst its not an option for the average person who cant afford the upfront cost it is very practical for large businesses especially if they engage in it often and hence can stand up a department for it.

Its one of the offerings from TM-Eye aka one of the "private police forces". https://tm-eye.co.uk/what-we-do/private-prosecutions/

It is an actual example of a two tier justice system since those who can afford the private prosecution skip the queue for the public system but will still normally have the taxpayer pay for it.

There is currently a consultation underway as per below article which, incidentally, mentions a more recent dubious example of private prosecutions which got slapped down.

https://www.gov.uk/government/consultations/oversight-and-re...