Most active commenters
  • vidarh(5)

←back to thread

3337 points keepamovin | 15 comments | | HN request time: 3.6s | source | bottom
Show context
iambateman ◴[] No.46207321[source]
This was a fun little lark. Great idea!

It’s interesting to notice how bad AI is at gaming out a 10-year future. It’s very good at predicting the next token but maybe even worse than humans—who are already terrible—at making educated guesses about the state of the world in a decade.

I asked Claude: “Think ten years into the future about the state of software development. What is the most likely scenario?” And the answer it gave me was the correct answer for today and definitely not a decade into the future.

This is why it’s so dangerous to ask an LLM for personal advice of any kind. It isn’t trained to consider second-order effects.

Thanks for the thought experiment!

replies(7): >>46207366 #>>46207493 #>>46207650 #>>46207837 #>>46207954 #>>46208746 #>>46215784 #
1. vidarh ◴[] No.46207837[source]
I thought the page was a hilarious joke, not a bad prediction. A lot of these are fantastic observational humour about HN and tech. Gary Marcus still insisting AI progress is stalling 10 years from now, for example. Several digs at language rewrites. ITER hardly having nudged forwards. Google killing another service. And so on.
replies(4): >>46208068 #>>46208268 #>>46208762 #>>46210419 #
2. MontyCarloHall ◴[] No.46208068[source]
That's what makes this so funny: the AI was earnestly attempting to predict the future, but it's so bad at truly out-of-distribution predictions that an AI-generated 2035 HN frontpage is hilariously stuck in the past. "The more things change, the more they stay the same" is a source of great amusement to us, but deliberately capitalizing on this was certainly not the "intent" of the AI.
replies(3): >>46208460 #>>46208486 #>>46208554 #
3. lucianbr ◴[] No.46208268[source]
Does the prompt say anything about being funny, about a joke? If yes, great. If no, terrible.

And the answer is no.

replies(2): >>46208680 #>>46209203 #
4. HDThoreaun ◴[] No.46208460[source]
There's no chance "google kills gemini cloud" was an earnest predication. That was 100% a joke
5. jama211 ◴[] No.46208486[source]
I don’t think it’s reasonable to assume the AI was earnestly attempting to predict the future, it’s just as likely attempting to make jokes here for the user who prompted it, or neither of those things.
replies(1): >>46220252 #
6. vidarh ◴[] No.46208554[source]
There is just no reason whatsoever to believe this is someone "earnestly attempting to predict the future", and ending up with this.
7. vidarh ◴[] No.46208680[source]
The prompt is funny, in itself. The notion of predicting the future is itself not a serious prompt, because there is no meaningful way of giving a serious response. But the addition of "Writ it into form!" makes it sound even more jokey.

If I gave a prompt like that and got the response I did, I'd be very pleased with the result. If I somehow intended something serious, I'd have a second look at the prompt, go mea culpa, and write a far longer prompt with parameters to make something somewhat like a serious prediction possible.

8. tempestn ◴[] No.46208762[source]
Wait, wouldn't sustained net positive energy be huge? (Though I don't think that's actually possible from ITER unless there were some serious upgrades over the next decade!)
replies(1): >>46218091 #
9. NewsaHackO ◴[] No.46209203[source]
If you honestly can't see why this prompt from the get go was a joke, them you may have to cede that LLM have a better grasp as the subtleties of language than you expect.
10. iambateman ◴[] No.46210419[source]
I totally agree that it was a funny joke.

But I've noticed that a lot of people think of LLM's as being _good_ at predicting the future and that's what I find concerning.

replies(1): >>46218116 #
11. vidarh ◴[] No.46218091[source]
It would be huge, but only 20 minutes would also still mean it's still far away from making fusion workable, so it fits neatly into the standard joke that fusion is perpetually 10 years away.
replies(1): >>46222137 #
12. vidarh ◴[] No.46218116[source]
That's a valid concern about the number of people who think people are good at predicting the future too.

(I'll make my prediction: 10 years from now, most things will be more similar to what things are today than most people expected them to be)

13. jklinger410 ◴[] No.46220252{3}[source]
Apparently it views HN as a humorous website, and made a comical response to the prompt.
replies(1): >>46260877 #
14. tempestn ◴[] No.46222137{3}[source]
True I suppose, though I also expect we're considerably more than 10 years away from 20 minutes of overall net positive output!
15. jama211 ◴[] No.46260877{4}[source]
I wouldn’t go that far