←back to thread

Accountability sinks

(aworkinglibrary.com)
493 points l0b0 | 1 comments | | HN request time: 0.001s | source
Show context
alilleybrinker ◴[] No.41892299[source]
Cathy O'Neil's "Weapons of Math Destruction" (2016, Penguin Random House) is a good companion to this concept, covering the "accountability sink" from the other side of those constructing or overseeing systems.

Cathy argues that the use of algorithm in some contexts permits a new scale of harmful and unaccountable systems that ought to be reigned in.

https://www.penguinrandomhouse.com/books/241363/weapons-of-m...

replies(4): >>41892714 #>>41892736 #>>41892843 #>>41900231 #
bigiain ◴[] No.41892714[source]
Brings to mind old wisdom:

"A computer can never be held accountable, therefore a computer must never make a Management Decision." IBM presentation, 1979

replies(4): >>41893321 #>>41893743 #>>41894623 #>>41895644 #
1. heresie-dabord ◴[] No.41894623[source]
> presentation, 1979

= Presentation, 21st Century

A computer is not alive. A computer system is a tool that can do harm. It can be disconnected or unplugged like any tool in a machine shop that begins to do harm or damage. But a tool is not responsible. Only people are responsible. Accountability is anchored in reality by personal cost.

= Notes

Management calculates the cost of not unplugging the computer that is doing harm. Management often calculates that it is possible to pay the monetary cost for the harm done.

People in management will abdicate personal responsibility. People try to avoid paying personal cost.

We often hold people accountable by forcing them to give back (e.g. community service, monetary fines, return of property), by sacrificing their reputation in one or more domains, by putting them in jail (they pay with their time), or in some societies, by putting them to death ("pay" with their lives).

Accountability is anchored in reality by personal cost.