←back to thread

246 points rntn | 1 comments | | HN request time: 0.206s | source
Show context
N_A_T_E ◴[] No.43795965[source]
Is there any path forward to fixing the current reproducibility crisis in science? Individuals can do better, but that won't solve a problem at this scale. Could we make systemic changes to how papers are validated and approved for publication in major journals?
replies(12): >>43796160 #>>43796211 #>>43796313 #>>43796358 #>>43796415 #>>43796725 #>>43796906 #>>43796908 #>>43796955 #>>43797084 #>>43797605 #>>43797627 #
1. analog31 ◴[] No.43796415[source]
Disclosure: I'm a scientist, specializing in scientific measurement equipment, so of course reproducibility is my livelihood.

But at the same time, I doubt that fields like physics and chemistry had better practices in, say, the 19th century. It would be interesting to conduct a reproducibility project on the empirical studies supporting electromagnetism or thermodynamics. There were probably a lot of crap papers!

Those fields had a backup, which was that studies and theories were interconnected, so that they tended to cross-validate one another. This also meant that individual studies were hot-pluggable. One of them could fail replication and the whole edifice wouldn't suddenly collapse.

My graduate thesis project was never replicated. For one thing, the equipment that I used had been discontinued before I finished, and cost about a million bucks in today's dollars. On the other hand, two labs built similar experiments that were considerably better, made my results obsolete, and enabled further progress. That was a much better use of resources.

I think fixing replication will have to involve fixing more than replication, but thinking about how science progresses as a whole.