←back to thread

903 points tux3 | 1 comments | | HN request time: 0.319s | source
Show context
jerf ◴[] No.43546861[source]
One of my Core Memories when it comes to science, science education, and education in general was in my high school physics class, where we had to do an experiment to determine the gravitational acceleration of Earth. This was done via the following mechanism: Roll a ball off of a standard classroom table. Use a 1990s wristwatch's stopwatch mechanism to start the clock when the ball rolls of the table. Stop the stopwatch when the ball hits the floor.

Anyone who has ever had a wristwatch of similar tech should know how hard it is to get anything like precision out of those things. It's a millimeter sized button with a millimeter depth of press and could easily need half a second of jabbing at it to get it to trigger. It's for measuring your mile times in minutes, not fractions of a second fall times.

Naturally, our data was total, utter crap. Any sensible analysis would have error bars that, if you treat the problem linearly, would have put 0 and negative numbers within our error bars. I dutifully crunched the numbers and determined that the gravitational constant was something like 6.8m/s^2 and turned it in.

Naturally, I got a failing grade, because that's not particularly close, and no matter how many times you are solemnly assured otherwise, you are never graded on whether you did your best and honestly report what you observe. From grade school on, you are graded on whether or not the grading authority likes the results you got. You might hope that there comes some point in your career where that stops being the case, but as near as I can tell, it literally never does. Right on up to professorships, this is how science really works.

The lesson is taught early and often. It often sort of baffles me when other people are baffled at how often this happens in science, because it more-or-less always happens. Science proceeds despite this, not because of it.

(But jerf, my teacher... Yes, you had a wonderful teacher who didn't only give you an A for the equivalent but called you out in class for your honesty and I dunno, flunked everyone who claimed they got the supposed "correct" answer to three significant digits because that was impossible. There are a few shining lights in the field and I would never dream of denying that. Now tell me how that idealism worked for you going forward the next several years.)

replies(46): >>43546960 #>>43547056 #>>43547079 #>>43547302 #>>43547336 #>>43547355 #>>43547446 #>>43547723 #>>43547735 #>>43547819 #>>43547923 #>>43548145 #>>43548274 #>>43548463 #>>43548511 #>>43548631 #>>43548831 #>>43549160 #>>43549199 #>>43549233 #>>43549287 #>>43549330 #>>43549336 #>>43549418 #>>43549581 #>>43549631 #>>43549681 #>>43549726 #>>43549824 #>>43550069 #>>43550308 #>>43550776 #>>43550923 #>>43551016 #>>43551519 #>>43552066 #>>43552407 #>>43552473 #>>43552498 #>>43553305 #>>43554349 #>>43554595 #>>43555018 #>>43555061 #>>43555827 #>>43676296 #
TeMPOraL ◴[] No.43550308[source]
> no matter how many times you are solemnly assured otherwise, you are never graded on whether you did your best and honestly report what you observe. From grade school on, you are graded on whether or not the grading authority likes the results you got.

Wouldnt've helped me before late high school, but that "whether or not the grading authority likes the results you got" part cuts both ways. That is, if you put some extra effort into presentation, you can get at least some of authorities to recognize your effort. Or, if you're really good, you can even bullshit wrong results past them, as long as you give a strong impression of competence.

Or at least that's what undergrad studies taught me; for random reason I went into overkill for some assignments, and I quickly discovered this worked regardless of the validity of my results.

I guess a big part of it is that most other people a) don't really put in much effort, and b) don't see any importance of the work in larger context. So I found that if I showed (or faked) either, I was set; show both, even better.

(Though it didn't work 100% well. I distinctly remember spending a lot of time figuring out how to simulate lexical scope and lambdas with strings & eval in Lotus notes. My professor was impressed, even suggesting I write the details up, but then she proceeded to fail me on the exercise anyway, because I didn't actually do half of the boring things I was supposed to.)

(It also taught me to recognize when someone else's deploying smokescreens of competence to pass lazy or bad results.)

replies(1): >>43550891 #
1. jerf ◴[] No.43550891[source]
Well, on the flip side, I had a couple of classes in which we were supposed to "critique" papers, for the laudable purpose of learning critical thinking skills and how to evaluate papers.

We also were supposed to read the greatest papers in the field to learn about the field from the primary sources, also a laudable purpose.

Unfortunately, these two things were put together, and we were expected to produce "critiques" of the greatest papers in the field.

Now, I've told this story a couple of times, and always some anklebiter jumps up from the replies to point out that even the greatest papers can have mistakes or be improved or whatever. Which is in principle true. But when Einstein comes up to you and for the first time in world history explicates his new theory of relativity, you aren't doing him, yourself, or the world a favor by "critiquing" his choice of variable names, quibbling about his phrasing, or criticizing him for not immediately knowing how to explain it the way physicists will explain it after over 120 years of chewing on it.

In practice, there is no practical way to "critique" these papers. They are the ones that have slugged it out with hundreds of thousands of other papers to be getting recommended to undergraduate students 20-40 years later. There is no reason to believe that anything a college junior, even one from decades down the line, is going to give any suggestions that can improve such papers.

So what I learned is that I can just deploy a formula: 1. Summarize the paper quickly, ideally with some tidbit in it that proves you really read it 2. Use my decades of foresight to complain that the author didn't do in this paper something the field built on it later, quite possibly led by the same author (I dunno, I didn't check of course, I'm just complaining) 3. Say "more research is needed"... it's a cliche for a reason -> Get an A every single time, despite putting no real cognitive effort into the critique.

I did at least read the papers for real, and that was fine, but my "critique" was 100% presentation, 100% genuflection of the ritual words of science, knowingly shorn of meaning. Heck, even now I don't think I feel bad about that; I just delivered what was asked for, after raising the objection once. At least we read some of the literature, and that is a skill that has served me for real, in real life, even though I did not go into academia proper.