←back to thread

256 points hirundo | 1 comments | | HN request time: 0s | source
Show context
iq_throw_123 ◴[] No.35518554[source]
Imagine that, 150 years ago or whenever, some clever soul had decided to make a written test to measure niceness, and called the test score Niceness Quotient. And the first version sucked, but some other folks iterated on it and over time the test was improved until it correlated pretty well to the sorts of things you would think that niceness would correlate to. 150 years of progress later, we'd have a whole field of Niceometry and researchers trying to isolate sub-areas like charity, friendliness, etc, and trying to suss out an underlying factor of general amiability, and the whole thing would be so well embedded in to the culture that almost no one remembers that "nice" is just a regular word with no objective or scientific definition, and that we measure it with a written test not because that's a good way to measure niceness but because we can't find a better way.
replies(2): >>35519437 #>>35520589 #
QuiDortDine ◴[] No.35519437[source]
This is a terrible analogy, IQ tests measure something real and objective called the g factor : https://en.wikipedia.org/wiki/G_factor_(psychometrics)

Also, intelligence tests are but a tiny part of psychology, I would hardly call it a "whole field".

replies(2): >>35519683 #>>35522444 #
iq_throw_123 ◴[] No.35519683[source]
> IQ tests measure something real and objective called the g factor

Sure, and NQ tests do too, because look how well graciousness correlates with cheerfulness! That can't be an accident, can it?

Less snarkily, a better analogy would be athletic ability. Suppose you take a bunch of people and measure how fast they can run, how well they can shoot free throws, and how far they can throw a football. Will the results be correlated? Of course, some people are more athletic than others. Does that mean there's a quantity called 'athleticism' that we can objectively measure with a number? No; and not because all people are equally athletic, but because you're trying to take a squishy subjective English language word and pretend it's a scalar value.

> I would hardly call it a "whole field".

The problem isn't the size of the field, it's that academics work within their field, they don't refute it. There's a very uncomfortable result about IQ tests that a generation of psychologists have tried to explain away, and I maintain that the reason they haven't succeeded is because they are institutionally incapable of saying, "Hey, maybe this is pseudoscience."

replies(4): >>35519789 #>>35519954 #>>35520727 #>>35528164 #
QuiDortDine ◴[] No.35519954[source]
Respectfully, you chose the wrong hill to die on. Psychology has many squishy parts, but psychometry is basically the closest thing it has to a hard science.

The other comment adresses your NQ argument, but here's something I don't understand: "There's a very uncomfortable result about IQ tests that a generation of psychologists have tried to explain away"

This reeks of anti-intellectualism by the way ("can't trust the experts!"), but I am curious to know what you're referring to. It can't be the validity or reliability of IQ tests, surely? Both have been very solidly established for a long time.

replies(2): >>35520057 #>>35523058 #
thworp ◴[] No.35523058[source]
No, actually it is thoroughly debunked as a measure of anything useful (except scores below ~80) and its significance as a predictor is miniscule. I recommend you read this: https://medium.com/incerto/iq-is-largely-a-pseudoscientific-...
replies(1): >>35524670 #
walkhour ◴[] No.35524670{3}[source]
That article is largely a pseudoscientific swindle, and it has repeatedly been rebutted, please see https://archive.ph/PCvgk.

Overall I'd recommend not taking a single article and using it as something that can refute a whole science.

replies(2): >>35528667 #>>35537130 #
1. thworp ◴[] No.35537130{4}[source]
The most important point of Taleb's is right near the top, in particular anything with graphs. This article pretty much just ignores that entire section (especially the quiz part is a very nice illustration for the statistically challenged). It doesn't even address the point that the outcome graph with the lower tail blocked is basically an entirely random distribution.

Then it happily continues to use the graphs and averaged results, that Taleb showed contain almost no signal, as if nothing happened.

This is not a serious rebuttal.