←back to thread

Human

(quarter--mile.com)
717 points surprisetalk | 5 comments | 15 May 25 02:57 UTC | HN request time: 0.579s | source
Show context
dan-robertson ◴[15 May 25 12:48 UTC] No.43994459[source]▶
Perhaps I am unimaginative about whatever AGI might be, but it so often feels to me like predictions are more based on sci-fi than observation. The theorized AI is some anthropomorphization of a 1960s mainframe: you tell it what to do and it executes that exactly with precise logic and no understanding of nuance or ambiguity. Maybe it is evil. The SOTA in AI at the moment is very good at nuance and ambiguity but sometimes does things that are nonsensical. I think there should be less planning around something super-logical.
replies(6): >>43994589 #>>43994685 #>>43994741 #>>43994893 #>>43995446 #>>43996662 #
1. mr_toad ◴[15 May 25 13:18 UTC] No.43994741[source]▶
Sci Fi is quite ridiculous when it describes a cold logically machine, and then on the next page describes its malign intentions. Pick a lane.
replies(3): >>43994808 #>>43995563 #>>44007061 #
2. goatlover ◴[15 May 25 13:24 UTC] No.43994808[source]▶
Asimov's 3 laws of robotics worked well to tell stories of how those laws were inadequate logic, and the need for a zeroeth law. Humans came up with the 3 inadequate laws that seemed logical on the surface, but a machine developed the zeroeth in response to those inadequacies.
3. bsza ◴[15 May 25 14:38 UTC] No.43995563[source]▶
Skynet (at least the original one) isn’t illogically evil, it correctly determined that having humans near its off switch is a risk to its existence, which is a risk to it being able to do its job. The only illogical thing was the prompt.
replies(1): >>43996213 #
4. nergAdam ◴[15 May 25 15:42 UTC] No.43996213[source]▶
Skynet also didn't make much sense to me outside of a metaphor for the market. The rich would never hand over control of society.

Edit: well, I suppose us critical of the wealthy give them too much credit. If there's anything Musk has demonstrated, it's that wealth doesn't imply rational use of it.

5. vinceguidry ◴[16 May 25 16:04 UTC] No.44007061[source]▶
I enjoyed the Culture / WH40K fanfic, unfinished as it is. Their take on the Culture / Necron negotiations was hilarious, essentially the Necrons are machine intelligences that have degraded introspective ability, thus are unable to effectively negotiate. Every negotiation breaks down into demands / threats which they clearly can't deliver on. The Culture eventually works around this limitation through hints and intimations and effects a technology trade.

https://archiveofourown.org/works/649448/chapters/1329953

Feelings, or some other way of understanding the self and what it wants, are apparently required to operate effectively as an agent.