←back to thread

256 points hirundo | 4 comments | | HN request time: 0s | source
Show context
iq_throw_123 ◴[] No.35518554[source]
Imagine that, 150 years ago or whenever, some clever soul had decided to make a written test to measure niceness, and called the test score Niceness Quotient. And the first version sucked, but some other folks iterated on it and over time the test was improved until it correlated pretty well to the sorts of things you would think that niceness would correlate to. 150 years of progress later, we'd have a whole field of Niceometry and researchers trying to isolate sub-areas like charity, friendliness, etc, and trying to suss out an underlying factor of general amiability, and the whole thing would be so well embedded in to the culture that almost no one remembers that "nice" is just a regular word with no objective or scientific definition, and that we measure it with a written test not because that's a good way to measure niceness but because we can't find a better way.
replies(2): >>35519437 #>>35520589 #
QuiDortDine ◴[] No.35519437[source]
This is a terrible analogy, IQ tests measure something real and objective called the g factor : https://en.wikipedia.org/wiki/G_factor_(psychometrics)

Also, intelligence tests are but a tiny part of psychology, I would hardly call it a "whole field".

replies(2): >>35519683 #>>35522444 #
iq_throw_123 ◴[] No.35519683[source]
> IQ tests measure something real and objective called the g factor

Sure, and NQ tests do too, because look how well graciousness correlates with cheerfulness! That can't be an accident, can it?

Less snarkily, a better analogy would be athletic ability. Suppose you take a bunch of people and measure how fast they can run, how well they can shoot free throws, and how far they can throw a football. Will the results be correlated? Of course, some people are more athletic than others. Does that mean there's a quantity called 'athleticism' that we can objectively measure with a number? No; and not because all people are equally athletic, but because you're trying to take a squishy subjective English language word and pretend it's a scalar value.

> I would hardly call it a "whole field".

The problem isn't the size of the field, it's that academics work within their field, they don't refute it. There's a very uncomfortable result about IQ tests that a generation of psychologists have tried to explain away, and I maintain that the reason they haven't succeeded is because they are institutionally incapable of saying, "Hey, maybe this is pseudoscience."

replies(4): >>35519789 #>>35519954 #>>35520727 #>>35528164 #
QuiDortDine ◴[] No.35519954[source]
Respectfully, you chose the wrong hill to die on. Psychology has many squishy parts, but psychometry is basically the closest thing it has to a hard science.

The other comment adresses your NQ argument, but here's something I don't understand: "There's a very uncomfortable result about IQ tests that a generation of psychologists have tried to explain away"

This reeks of anti-intellectualism by the way ("can't trust the experts!"), but I am curious to know what you're referring to. It can't be the validity or reliability of IQ tests, surely? Both have been very solidly established for a long time.

replies(2): >>35520057 #>>35523058 #
iq_throw_123 ◴[] No.35520057[source]
> This reeks of anti-intellectualism by the way ("can't trust the experts!"), but I am curious to know what you're referring to.

I'm referring to HBD. Respectfully, if you're not familiar with that then you have a lot of prior art to catch up on before you expound on how well-grounded psychometry is.

replies(1): >>35520213 #
QuiDortDine ◴[] No.35520213[source]
HBD is so fringe I had a hard time googling it. Just because a subset of a subfield is politically motivated and hateful does not invalidate the whole field. That intelligence testing can be misrepresented to defend racism is an argument against humans, not against the science.

Meanwhile, unbiased research has shown for a long time that there is no significant variations in IQ between races when considering socioeconomic factors. We've determined this with, guess what, psychometry, and it is the overwhelming consensus in psychology. If this was your main gripe with it, rest assured that the field you so underestimate is entirely dismissive of it.

It seems to me you're just looking for ways to dismiss decades of research based on misinformation perpetuated, overwhelmingly, by non-experts. Congratulations, you are in this group.

replies(2): >>35520465 #>>35528319 #
1. Apocryphon ◴[] No.35520465[source]
Thoughts on this comment about the supposed hidebound nature of the field of psychometrics?

https://news.ycombinator.com/item?id=29798887

replies(1): >>35521010 #
2. QuiDortDine ◴[] No.35521010[source]
The problem is there are no sources and many claims. I can barely tell what point, if any, they're trying to make.

They don't seem to know about the g factor, which I've linked to many times today. The existence of it means one thing: smart is smart. If you're above average at "mental labor", you're also above average at learning the tools you can leverage to make your labor better faster. This would explain why the calculator didn't shatter the economic predictiveness of the g factor, and neither did the computer, and neither will ChatGPT until it becomes a true AGI. Until mental labor stops being a thing, g factor will always be a strong (though not absolute) predictor of economic success, and so will IQ tests, since they measure it.

I don't see how the comment is related to the article however. The g factor going down in general wouldn't change this correlation; it's still better to be smarter no matter what the average is.

replies(2): >>35521397 #>>35522484 #
3. Apocryphon ◴[] No.35521397[source]
I believe based on that account's other responses in that thread they are highly dismissive of g ("Yes, psychometrics researchers believe in psychometrics.")

> The existence of it means one thing: smart is smart. If you're above average at "mental labor", you're also above average at learning the tools you can leverage to make your labor better faster.

But isn't this highly reductive? The very responses in this thread attempt to explain the improvement in spatial reasoning can be attributed to video games, at least three responses independently advance that hypothesis. If societal responses to the tests change over time, doesn't that mean the tests themselves are not objective across all time periods?

Funnily enough, that comment suggests that someone who grinded thousands of hours of Tetris would have higher spatial reasoning than a novice, and that's the precise category that the study in the OP reports has improved.

> Until mental labor stops being a thing

But the point is, mental labor changes over time. The measure of g measured by arithmetic tests might go down if society deemphasizes arithmetic because of technological changes. What exactly goes into g, and are those measures the only possible ways of quantifying intelligence?

> I can barely tell what point, if any, they're trying to make.

The comment is highly critical of modern psychometrics, because they argue that the tests in those field have not caught up with societal shifts that impact the results on those tests, using "working memory" as an example. Interestingly enough, the Wikipedia article on g you linked above mentions the following:

"One theory holds that g is identical or nearly identical to working memory capacity. Among other evidence for this view, some studies have found factors representing g and working memory to be perfectly correlated. However, in a meta-analysis the correlation was found to be considerably lower."

So sounds like experts disagree on the specifics.

Also, their thesis is fairly straightforward:

>> The more general critique is that "intelligence research" has ossified around Cargo Cult psychometrics. At one point, "orally administered arithmetic word problems" were a fantastic proxy for economically useful mental faculties. That is no longer true. As the set of useful capacities change, so too should psychometric evaluations. Both because treatment effects are going to make cross-generational comparisons worse than useless, and also because the thing being measured has become irrelevant.

> it's still better to be smarter no matter what the average is.

Certainly, but the devil's in the details.

https://news.ycombinator.com/item?id=35514949

4. astrange ◴[] No.35522484[source]
> The g factor going down in general wouldn't change this correlation; it's still better to be smarter no matter what the average is.

Women are famously known to not be more attracted to smarter men (by which I mean, men who the women consider more intelligent, and who are emphasizing intelligence over other things.) They're probably right; if it was evolutionarily fit, we'd already have it. But we have enough trouble with childbirth as is, and populations that are considered smarter (by people who believe IQ tests are validly constructed and administered) also often have more genetic diseases.

People who actually understand statistics like Taleb don't believe that IQ is a valid measurement or that it makes you a better person, of course, because "single number go up means better" is not how real life works.