←back to thread

Techno-feudalism and the rise of AGI: A future without economic rights?

(arxiv.org)
207 points lexandstuff | 1 comments | 05 Jul 25 21:19 UTC | HN request time: 0.228s | source
Show context
jandrewrogers ◴[06 Jul 25 03:08 UTC] No.44477503[source]▶
A critical flaw in arguments like this is the embedded assumption that the creation of democratic policy is outside the system in some sense. The existence of AGI has the implication that it can effectively turn most people into sock puppets at scale without them realizing they are sock puppets.

Do you think, in this hypothesized environment, that “democratic policy” will be the organic will of the people? It assumes much more agency on the part of people than will actually exist, and possibly more than even exists now.

replies(7): >>44478486 #>>44478493 #>>44478695 #>>44479345 #>>44479418 #>>44479714 #>>44482752 #
1. trhway ◴[06 Jul 25 07:52 UTC] No.44478695[source]▶
Most critical flaw is thinking that any policy on its own would be able to solve the issue. The technology will find a way no matter the policy.

The society built on empathy would have been able to work out any issue brought by technology as long as empathic goals take priority. Unfortunately our society is far from being based on empathy, to say the least. And technology and the people wielding it would always work around and past the formal laws, rules and policies in such a society. (that isn't to say that all those laws, rules, etc. aren't needed. They are like levies, dams, etc - necessary local, in time and space, fixes which willn't help in the case of the global ocean rise which AGI and robots (even less-than-AGI ones) will be like)

May be it is one of the technological Filters - we didn't become empathic enough (and i mean not only at the individual level, we are even less at the level of the societal systems) before AGI and as a result woudln't be able to instill enough of empathy into the AGI.