←back to thread

267 points rntn | 6 comments | | HN request time: 0.673s | source | bottom
Show context
drgo ◴[] No.43801699[source]
The crisis in science can only be fixed by addressing the slew of bad incentives built into the system. We can't predicate job security, promotion and prestige of every early career scientist on publishing as many papers as possible, and on obtaining grants (which requires publishing as many papers as possible) and then expect high-quality science. We can't starve universities of public funding and expect them not to selectively hire scientists whose main skill is publishing hundreds of "exciting" papers, and not overproduce low-quality future "scientists" who were trained in the dark arts of academic survival. Reform is more urgent than ever; AI has essentially obsoleted the mental model that equates the count of published papers with productivity and quality.
replies(4): >>43802447 #>>43803117 #>>43803266 #>>43803306 #
1. constantcrying ◴[] No.43803266[source]
But why is lying so common in science?

Incentives like these exist in basically all areas of work. Perform well and you get "job security, promotion and prestige". Yet somehow there is no decade long ongoing crisis in industry of corporations lying about their products. When these cases happens (obviously they do), corporations and individuals get punished.

How would you reform the system? More funding definitely is not the answer.

replies(2): >>43804358 #>>43804774 #
2. hansvm ◴[] No.43804358[source]
> why science in particular?

Because we can't usually measure our goals directly. We want outcomes like relativity and the two-slit experiment. Those results take a lot of time to uncover and have a meaningful chance of failure. If you look at an early-career scientist who hasn't produced (m)any papers, chances are they're fully qualified _and_ doing all the right things with respect to our society-level goals. However, that's hard to distinguish from outright fraud and freeloading from the outside, so we've imposed a crappy proxy measure, used for career advancement.

That's different from many jobs, where it's easy to measure incremental progress and where the results are more certain. You can directly weed out poor performers because you can watch them perform poorly.

> no decade long ongoing crisis of corporations lying about their products

Really? Flame retardants in our "food-grade" spatulas, lead leaching out from ceramic bowls into your soup and cereal, products "sold" as physical devices with a backdoor to start requiring a subscription years later, the pattern of building a brand on quality and then gutting the bill of materials to ramp up profits while deceiving customers into thinking it's the same thing, WalMart explicitly requiring manufacturers to not have any change in product numbers for the sub-par products sold there, .... Fraud is rampant, enough so that for most products I find it quite hard to actually make a sound purchasing decision, and those corporations seem to be wildly profitable.

> individuals get punished

That's true to an extent, but how many doc jockeys exist in some unimportant department in FAANG? You can have a very comfortable career skating by on minimal productive output when cause and effect for the business operate on sufficiently long timescales and with nonlocal, diffuse connections.

replies(2): >>43807613 #>>43808742 #
3. ChromaticPanic ◴[] No.43804774[source]
You mean like how tobacco company CEO's went to Congress telling them that there is no cancer risk? Oil companies pretending they didn't know about global warming? Shrinkflation? Corporations lie all the time and the people running them are never punished.
replies(1): >>43807589 #
4. constantcrying ◴[] No.43807589[source]
>Corporations lie all the time and the people running them are never punished.

Then why is the ex-VW CEO currently in court?

I did not deny that fraud exists in corporation, but it is not committed by the rank and file. Most employees actually perform their duties. Examples of fraud seem rare, the VW scandal maybe.

In science a good part of the rank and file is either incompetent and malicious.

5. constantcrying ◴[] No.43807613[source]
>You can directly weed out poor performers because you can watch them perform poorly.

Why don't we fire researchers who committed fraud or who are incompetent?

Some studies will fail replication, even though the researchers did everything right. But in many cases the methodology is flawed, statistics are misused or the data is massages. In industry this would be grounds of termination and this isn't even the outright fraud, which also happens. For most of these no serious punishment is expected.

6. LorenPechtel ◴[] No.43808742[source]
That flame retardant bit was bad research, they misplaced the decimal point and concluded that the contamination could reach the safety limit. And it wasn't like they put it there deliberately, that was the result of recycling stuff that can't be heated to the point of burning off impurities.