←back to thread

626 points __rito__ | 1 comments | | HN request time: 0s | source

Related from yesterday: Show HN: Gemini Pro 3 imagines the HN front page 10 years from now - https://news.ycombinator.com/item?id=46205632
Show context
collinmcnulty ◴[] No.46221809[source]
> But if intelligence really does become too cheap to meter, it will become possible to do a perfect reconstruction and synthesis of everything. LLMs are watching (or humans using them might be). Best to be good.

I cannot believe this is just put out there unexamined of any level of "maybe we shouldn't help this happen". This is complete moral abdication. And to be clear, being "good" is no defense. Being good often means being unaligned with the powerful, so being good is often the very thing that puts you in danger.

replies(5): >>46221981 #>>46222014 #>>46222133 #>>46222642 #>>46224955 #
doctoboggan ◴[] No.46222014[source]
I've had the same though as Karpathy over the past couple of months/years. I don't think it's good, exciting, or something to celebrate, but I also have no idea how to prevent it.

I would read his "Best to be good." as a warning or reminder that everything you do or say online will be collected and analyzed by an "intelligence". You can't count on hiding amongst the mass of online noise. Imagine if someone were to collect everything you've written or uploaded to the internet and compiled it into a long document. What sort of story would that tell about who you are? What would a clever person (or LLM) be able to do with that document?

If you have any ideas on how to stop everyone from building the torment nexus, I am willing to listen.

replies(4): >>46222084 #>>46222216 #>>46223059 #>>46224626 #
collinmcnulty ◴[] No.46222216[source]
This is my plan at least

1. Don't build the Torment Nexus yourself. Don't work for them and don't give them your money.

2. When people you know say they're taking a new job to work at Torment Nexus, act like that's super weird, like they said they're going to work for the Sinaloa cartel. Treat rich people working on the Torment Nexus like it's cringe to quote them.

3. Get hostile to bots. Poison the data. Use AdNauseum and Anubis.

4. Give your non-tech friends the vague sense that this stuff is bad. Some might want to listen more, but most just take their sense of what's cool and good from people they trust in the area.

replies(3): >>46222659 #>>46222897 #>>46223043 #
1. ◴[] No.46223043[source]