←back to thread

231 points cachecrab | 2 comments | | HN request time: 0s | source
Show context
i_love_limes ◴[] No.31900479[source]
Epidemiologist in training here... There are quite a few comments in this thread already jumping on the 'correlation != causation' train. While that is true, I'd like to clarify a couple things:

1. The journal article didn't suggest it was causal. But such a correlation with such a large population warrants publication and further research into causation.

2. literally the first thing that any epidemiologist would consider is potential confounders. There is a big list of covariates they included into their model here: https://content.iospress.com/articles/journal-of-alzheimers-...

There are quite a few things that can be done to alleviate potential false correlations: DAGs, prior literature, removing confounders, and including covariates are all things at disposal.

3. Such a large sample size + previously reported findings + an inclusion of enough covariates still doesn't == causation, BUT it's important to publish and shout about so we can then look into the potential biological underpinnings that may cause this. Which by the way, those experiments may still use data science techniques.

4. If you are actually interested, there is a whole topic of this called 'causal inference' with one famous criteria list called the 'Bradford Hill Criteria': https://en.wikipedia.org/wiki/Bradford_Hill_criteria. This list is often argued about.

5. If all of this information was new to you, please stop spouting 'correlation != causation'. You probably don't know as much as you think

replies(6): >>31900570 #>>31900632 #>>31900640 #>>31900747 #>>31901219 #>>31901716 #
blagie ◴[] No.31900640[source]
The scientists said it was causation.

    "We found that flu vaccination in older adults reduces the risk of 
     developing Alzheimer’s disease for several years. The strength of 
     this protective effect increased with the number of years that a 
     person received an annual flu vaccine – in other words, the rate 
     of developing Alzheimer’s was lowest among those who consistently 
     received the flu vaccine every year"
Yes, that's in an interview for the article. That's the reason (1) the general public misunderstands (2) people scream about it. Scientists get points for "high-impact research," and there is strong incentive to be dishonest.

(As a footnote, personally, I do believe it is causation; I believe that as with COVID and EB, we've dramatically underestimated the long-term impact of many viral infections. But that's just a personal belief.)

replies(5): >>31900700 #>>31900731 #>>31900738 #>>31901374 #>>31903529 #
dsizzle ◴[] No.31903529[source]
This comment (and often the "correlation != causation" discussion more generally) seems to equate "causation" with "proof of causation" (in a mathematical sense), which is a flawed criteria for science IMO. The causation part (not the mere association) is the substance, so it's appropriate to use causal language.

Of course any such explanation is provisional. I might think your comment is just to complain the provisional aspect isn't mentioned in the quote (I think it'd be tiresome to say that in every statement, and the public's understanding of science being provisional is underestimated), but you seem to think it's a problem that causal language is used at all?

While quote may have been offhand, look at what the actual paper says [1]: "[the study] design prevent[s] strong conclusions regarding causation." Note that it doesn't say it prevents any conclusions regarding causation.

By the way, it seems weird that you yourself have come to believe it's causal, while seemingly denying that this paper provides any basis. How did you come to that conclusion then?

[1] In the last paragraph: https://content.iospress.com/download/journal-of-alzheimers-...

replies(1): >>31906554 #
native_samples ◴[] No.31906554[source]
The quote isn't offhand, it's directly and explicitly making claims of causality, e.g. talking about the "effect" and saying the vaccination "reduces the risk".

Yes the paper says differently. So what? We're used to this from epidemiology by now. The claims they make to the government/media/public about disease frequently don't match their actual data. To discover this you have to not only read the paper but often dig through the most obscure parts of it. The fact that their claims are wrong will only emerge in, like, table 3 of Appendix 2 which is by the way only available on GitHub if at all. Here it emerges in literally the last paragraph. Then someone blogs about this and they get kicked off Twitter for spreading "misinformation".

The public's understanding of science being provisional is actually excellent and far better than the supposedly elite decision making classes. That's why the public increasingly doesn't trust claims made by scientists, and correctly so. Scientists will make bold claims of causation whilst actually having a sketchy P=0.049 regression at best and a fictional model built on circular logic at worst.

We need to hold scientists to higher standards, and especially epidemiologists. The amount of damage their sloppy "offhand" approach has caused is astronomical. Or, quicker, just accept that they aren't going to improve, have learned nothing from COVID and cut them out of society and the public conversation entirely.

replies(1): >>31907597 #
1. dsizzle ◴[] No.31907597[source]
You missed my point. I don't actually think the quote was offhand either (another comment suggested that possibility), but the lines from the paper I cited also uses causal language. My point is that using causal language is fine (understanding that it's provisional as all science is), and I think the scientist quote is fine.

You think the scientist quote is dishonest? It seems you too conflate causality with something like proven mathematically or 100% confidence.

replies(1): >>31908722 #
2. native_samples ◴[] No.31908722[source]
If they're going to claim causality for vaccines->less Alzheimers then yes, they need pretty close to 100% confidence for that because this is the sort of thing that gets translated into mandatory government policies. What they have here is literally nothing, it's just a correlation. They don't have any evidence of a causal relation, and they don't have any suggested biological pathway either. It's malpractice to assert causality given such a total absence of evidence.

Moreover, as a killed comment elsewhere in this thread points out, it's very likely that they made a mistake somewhere. This claim is absurd on its face. A 40% effect size is enormous. Alzheimer's is tracked very closely and there has been no change in incidence over time:

https://ourworldindata.org/grapher/prevalence-of-dementias

Flu vaccines on the other hand have become far more prevalent over the last 20 years especially amongst the age groups most at risk for Alzheimers. So, where's the impact? There isn't any. If flu vaccines really reduced the risk that much then we'd see it in the actual numbers, as a 40% reduction is hard to hide.