←back to thread

Accountability sinks

(aworkinglibrary.com)
493 points l0b0 | 8 comments | | HN request time: 0.446s | source | bottom
Show context
alilleybrinker ◴[] No.41892299[source]
Cathy O'Neil's "Weapons of Math Destruction" (2016, Penguin Random House) is a good companion to this concept, covering the "accountability sink" from the other side of those constructing or overseeing systems.

Cathy argues that the use of algorithm in some contexts permits a new scale of harmful and unaccountable systems that ought to be reigned in.

https://www.penguinrandomhouse.com/books/241363/weapons-of-m...

replies(4): >>41892714 #>>41892736 #>>41892843 #>>41900231 #
1. bigiain ◴[] No.41892714[source]
Brings to mind old wisdom:

"A computer can never be held accountable, therefore a computer must never make a Management Decision." IBM presentation, 1979

replies(4): >>41893321 #>>41893743 #>>41894623 #>>41895644 #
2. k1t ◴[] No.41893321[source]
"A computer can never be held accountable, therefore all Management Decisions shall be made by a computer." - Management, 2 seconds later.
replies(1): >>41893758 #
3. lifeisstillgood ◴[] No.41893743[source]
Admittedly the context matters “we are trying to sell to Management, therefore let’s butter them up and tell them they make great decisions and they won’t get automated away” while the next page of the presentation says “we will Automate away 50% of the people Working for you saving globs of money for your next bonus”

IBM in 1979 was not doing anything different to 2024. They were just more relevant

4. lifeisstillgood ◴[] No.41893758[source]
Therefore all management decisions are made by the people writing the code

Hence coders are the new managers, managers just funnel the money around, a job which can be automated

replies(1): >>41895620 #
5. heresie-dabord ◴[] No.41894623[source]
> presentation, 1979

= Presentation, 21st Century

A computer is not alive. A computer system is a tool that can do harm. It can be disconnected or unplugged like any tool in a machine shop that begins to do harm or damage. But a tool is not responsible. Only people are responsible. Accountability is anchored in reality by personal cost.

= Notes

Management calculates the cost of not unplugging the computer that is doing harm. Management often calculates that it is possible to pay the monetary cost for the harm done.

People in management will abdicate personal responsibility. People try to avoid paying personal cost.

We often hold people accountable by forcing them to give back (e.g. community service, monetary fines, return of property), by sacrificing their reputation in one or more domains, by putting them in jail (they pay with their time), or in some societies, by putting them to death ("pay" with their lives).

Accountability is anchored in reality by personal cost.

6. intelVISA ◴[] No.41895620{3}[source]
Soon(tm)
7. RobotToaster ◴[] No.41895644[source]
See also: “To err is human, but to really foul things up requires a computer.” —Paul Ehrlich
replies(1): >>41897792 #
8. chgs ◴[] No.41897792[source]
To err requires a computer

To really foul things up requires scalability