←back to thread

Grok 3: Another win for the bitter lesson

(www.thealgorithmicbridge.com)
129 points kiyanwang | 9 comments | | HN request time: 0s | source | bottom
Show context
bambax ◴[] No.43112611[source]
This article is weak and just general speculation.

Many people doubt the actual performance of Grok 3 and suspect it has been specifically trained on the benchmarks. And Sabine Hossenfelder says this:

> Asked Grok 3 to explain Bell's theorem. It gets it wrong just like all other LLMs I have asked because it just repeats confused stuff that has been written elsewhere rather than looking at the actual theorem.

https://x.com/skdh/status/1892432032644354192

Which shows that "massive scaling", even enormous, gigantic scaling, doesn't improve intelligence one bit; it improves scope, maybe, or flexibility, or coverage, or something, but not "intelligence".

replies(7): >>43112886 #>>43112908 #>>43113270 #>>43113312 #>>43113843 #>>43114290 #>>43115189 #
cardanome ◴[] No.43113843[source]
> Sabine Hossenfelder

She really needs to stop commenting on topics outside of theoretical physics.

Even in physics she does not represent the scientific consensus but has some very questionable fringe beliefs like labeling whole sub-fields as "scams to get funding".

She regularly speaks with "scientific authority" about topics she barely knows anything about.

Her video on autism is considered super harmful and misleading by actual autistic people. She also thinks she is an expert on trans-issues and climate change. And I doubt she know enough about artificial intelligence and computer science to comment on LLMs.

replies(8): >>43113905 #>>43114246 #>>43114537 #>>43115760 #>>43116614 #>>43116644 #>>43117944 #>>43121775 #
Mekoloto ◴[] No.43113905[source]
Your statement is missleading.

She doesn't say she is an expert on trans-issues at all! She analyzed the studies and looked at data and stated that there is no real transpendemic but highlighed an statistical increased numbers in young woman without stating a clear opinion on this finding.

The climate change videos do the same thing. She evaluates these studies discusses them to clarify that for her, certain numbers are unspecific and she also is not coming to a clear conclusion in sense of climate change yes, no, bad, good.

She is for sure not an expert in all fields, but her way of discussing these topics are based on studies, numbers and is a good viewpoint.

The funding scam you mention is a reference of "these people get billions for particle research but the outcome for us as society is way to small"

replies(3): >>43114307 #>>43115852 #>>43120600 #
bccdee ◴[] No.43115852[source]
> for her, certain numbers are unspecific and she also is not coming to a clear conclusion in sense of climate change yes, no, bad, good.

Climate chance is settled science. To claim that "certain numbers are unspecific, so I can't say whether climate change is real or not, or whether it's good or bad" (which, based on your paraphrasing, is what it sounds like she said) is an unacceptable position. It's muddying the waters.

I'm not going to go watch her content about trans people, but it sounds like the same thing: Muddying the waters by Just Asking Questions about anti-trans "social contagion" talking points.

---

EDIT: Okay I went back and watched some clips of her anti-trans video. She takes a pseudoscientific theory based on an opinion poll of parents active on an anti-trans web forum and suggests we take it seriously because "there is no conclusive evidence for or against it," as if the burden of proof weren't on the party making the positive claim, and as if the preponderance of evidence and academic consensus didn't overwhelmingly weigh against it. It's textbook laundering of pseudoscience. You've significantly misrepresented her position.

replies(3): >>43116149 #>>43116242 #>>43120698 #
1. toolz ◴[] No.43116242[source]
There's no such thing as "settled science". You can not prove that any scientific consensus has no flaws in the same way you can't prove the absence of bugs in any software. It's unproductive to treat science as anything more than an ongoing, constantly improving process.
replies(1): >>43116595 #
2. bccdee ◴[] No.43116595[source]
Yes there is. Germ theory is settled science. Is it theoretically possible that we'll overturn it? Sure. Is it likely? No. In the absence of any groundbreaking experimental results, it worth wasting time entertaining germ theory skepticism? Also no.

> It's unproductive to treat science as anything more than an ongoing, constantly improving process.

It's unproductive to constantly re-litigate questions like "is germ theory true" or "is global warming real" in the absence of any experimental results that seriously challenge those theories. Instead, we should put our effort into advancing medicine and fixing climate change, predicated on the settled science which makes both those fields possible.

replies(3): >>43116826 #>>43116949 #>>43118721 #
3. Matthyze ◴[] No.43116826[source]
Spot on. Reminds me of that old approach by evangelicals to frame scientific consensus as 'just a theory.'
replies(2): >>43116866 #>>43117289 #
4. toolz ◴[] No.43116866{3}[source]
Ironically, it's often attributed to religion that they claim settled truths that can't be proven.
5. toolz ◴[] No.43116949[source]
> Germ theory is settled science. Is it theoretically possible that we'll overturn it? Sure.

You need to understand that every single theory will be improved upon in the future. That means they will change and it's impossible to predict if these improvements will have consequences in different contexts where people incorrectly claim the science is settled.

> It's unproductive to constantly re-litigate questions like "is germ theory true" or "is global warming real"

Can you think of any cases where the science had nearly full consensus and it was useful to re-litigate? Galileo isn't the only example. I can think of many.

replies(1): >>43119649 #
6. barbazoo ◴[] No.43117289{3}[source]
“Just a theory” is simply a signal that they have no clue about basics of scientific process.
7. srid ◴[] No.43118721[source]
We understand very little about human microbiota (therapies like fecal microbiota transplant, however, are promising) yet germ theory is "settled science"? Interesting.
8. mrguyorama ◴[] No.43119649{3}[source]
Newtonian physics is still settled science even though we have relativity to give more accurate results in domains where Newtonian mechanics fails. It still holds in all the same places it used to.

You don't seem to understand how scientific models and theories work.

In fact, germ theory of medicine is much the same way. Germ Theory does not explain or predict or account for ALL disease, for example PTSD, and if you build a useful theory for mental illnesses that aren't caused by little creatures of some sort, that doesn't overturn germ theory, it compliments it. A person creating a new theory of how Long Covid hurts people for example may not stick strictly to germ theory, but that would STILL not overturn germ theory.

>Can you think of any cases where the science had nearly full consensus and it was useful to re-litigate? Galileo isn't the only example.

Galileo isn't an example of the science being "settled" and someone radically overturning it. Nobody believed in geocentrism due to "Science", which is also why Galileo had so much difficulty, it was literally a religious matter. Kepler was about as close as we had to any sort of consistent theory to how the heavenly bodies moved, and it was not at all settled, and yet he was still basically right

In actuality, there are remarkably few times where a theory was entirely overturned, especially by a new theory. When we know little enough about a field that we could get something so wrong, we usually don't have much in the way of "theory" and are still spitballing, and that's not considered settled science. If you want a good feeling for what this looks like, go read up on the debates science had when we first started looking at Statistical Mechanics and basics of thermodynamics. There were heated(lol) debates about the very philosophy of science, and whether we should really rely on theories that don't seem like they are physical, and that mostly went away as it continued to bear high quality predictions. The problems and places where theories are not great are usually well understood by the very scientists who work through a theory, because understanding the parameter space and confidence intervals for a theory are a requirement of using that theory successfully.

"Human CO2 and other pollutants are the near totality of the cause of the globe warming" is settled science.

"The globe is warming" is settled science

"Global warming will cause changes in micro and macro climates all over" is settled science

"A hotter globe will result in more energetic, chaotic, and potentially destructive weather" is settled science and obvious

"Global warming is going to kill us all in a decade" is NOT settled science. There is no settled science for how bad climate change will make things for us, who will be worst affected, who might benefit, etc. There is comprehensive agreement among climate scientists that global warming is harmful to our future, and something we have to try and reduce the effect of, prepare for the outcomes of, and adapt to the consequences of, and something that, whether we do anything to combat it, will be immensely costly to handle.

replies(1): >>43119976 #
9. toolz ◴[] No.43119976{4}[source]
> Newtonian physics is still settled science even though we have relativity to give more accurate results..

You've proved my entire point in your very first sentence and then go on to say I don't seem to understand how scientific models and theories work.

> Nobody believed in geocentrism due to "Science"...

This isn't a serious argument. Feel free to look up the works of Aristotle, who is sometimes called the first scientist.

I don't have the energy to address the rest of your incorrect conjecture.