←back to thread

399 points seanhunter | 2 comments | | HN request time: 0.406s | source
Show context
fbartos ◴[] No.42187911[source]
Hi, I'm the first author of the manuscript, so I thought I could answer some of the questions and clarify some issues (all details are in the manuscript, but who has the time to read it ;)

Low RPM tosses: Most of the recordings are on crapy webcams with ~ 30FPS. The coin spin usually much faster than the sensor can record which results in often non-spinning-looking flips. Why did we take the videos in the first place? To check that everyone collected the data and to audit the results.

Building a flipping matching: The study is concerned with human coin flips. Diaconis, Holmes, and Montgomery's (DHM, 2007) paper theorize that the imperfection of human flips causes the same-side bias. Building a machine completely defeats the purpose of the experiment.

Many authors and wasted public funding: We did the experiment in our free time and we had no funding for the study = no money was wasted. Also, I don't understand why are so many people angry that students who contributed their free time and spent the whole day flipping coins with us were rewarded with co-authorship. The experiment would be impossible to do without them.

Improper tosses: Not everyone flips coin perfectly and some people are much worse at flipping than others. We instructed everyone to flip the coin as if they were to settle a bet and that the coin has to flip at least once (at least one flip would create bias for the opposite side). We find that for most people, the bias decreased over time which suggests that people might get better at flipping by practice = decrease the bias and it also discredits the theory that they learned how to be biased on purpose. From my own experience - I flipped coins more than 20,000 times and I have no clue how to bias it. Also, we did a couple of sensitivity analyses excluding outliers - the effect decreased a bit but we still found plentiful evidence for DHM.

If you doubt my stats background, you are more than welcome to re-analyze the data on your own. They are available on OSF: https://osf.io/mhvp7/ (including cleaning scripts etc).

Frantisek Bartos

replies(7): >>42188179 #>>42188219 #>>42188626 #>>42190222 #>>42190974 #>>42191716 #>>42197712 #
ineptech ◴[] No.42188179[source]
Hi, thanks for replying. I have no complaints about your analysis, and agree that your results strongly support the D-H-M model (that there is a slight bias in coin-flipping over all and that it is caused by precession). However, it looks like about a third of your volunteers had little or no bias, presumably due to flipping end-over-end with no precession, and about a third had a lot of precession and a lot of bias.

Your paper draws the conclusion that coin-flipping inherently has a small-but-significant bias, but looking at table 2 it seems like an equally valid conclusion would be that some people flip a coin with no bias and others don't. Did you investigate this at all? In particular, I'd expect that if you took the biggest outliers, explained what precession is and asked them to intentionally minimize it, that the bias would shrink or disappear.

replies(1): >>42188371 #
1. fbartos ◴[] No.42188371[source]
Yes, there is indeed a lot of heterogeneity in the bias between flippers and we are going to put more emphasis on it in an upcoming revision. However, it's hard to tell whether there are two groups or a continuous scale of increasing bias. From our examination of the data, and continuum seem to be the more likely case, but we would need many many more people flipping a lot of coins to test this properly.

Yes, training the most wobbly flippers sounds like a very interesting idea. It might indeed answer additional questions but it's not really something I wanna run more studies on :)

replies(2): >>42189323 #>>42189904 #
2. ineptech ◴[] No.42189323[source]
Understandable, but I guess it's hard to put much weight on this data given how easy it is to introduce the effect being studied intentionally. Were the subjects aware of D-H-M beforehand? I wasn't before today, but I've been able to fake a coin flip with precession for many years (a very useful skill for parents of two small children) and if I was participating in a study like this I would be pretty hyper-aware of how much "sideways" I was giving it.