HackerTubewatch
Surprise me
Frame from Dance p 3 Mar09 Plays via YouTube's privacy-enhanced embed

Dance p 3 Mar09

Geoff Cumming
Explainers
YouTube
2 HN users recommended this explainer2 months2011–2015 score 3
Years with an HN recommendation, 2007–2026

Recommended as a vivid visual demonstration of how unreliable p-values are.

Geoff Cumming uses a simulation to show how wildly the p value varies from one replication to the next because of sampling variability. He argues for estimation and confidence intervals over null hypothesis significance testing.

“absolutely fantastic and well worth watching” (HN, 2015)

2 strong recommendations · 1 citations · Explainers · intro

3 Hacker News comments

From the HN archive; up to 20 kept per video, favoring different commenters. Recommendations first.

@knowledgesale Dec 2011 Strongly recommends
on HN thread Ask HN: What interesting non-intuitive things do you know?
Read more
The p-value [1] criterion is often used to test a proposed hypothesis in medical and social science research papers. When you stumble upon something along the lines of "studies that shown that eating broccoli makes people happy" in your everyday life, it comes down to the p-value calculation being small enough <0.05 for the before and after gathered datasets. The p-value method is practically a standard for scientific reporting in some fields. It also has some drastic shortcomings, including, e,g., dramatic instability for tests with only little data [2]. Naturally, people realize that and try to use additional tools and criteria when available. However, scientists are pretty brutally incentivized to publish positive results and, as a result, more often than it should be, too much weight is put on the single p-value criterion. With issues like this in mind, in my opinion, it makes sense to be somewhat skeptical when seeing reports in the news that "A effects B" and definitely not to rush with the conclusions. Trivial, I know. The [3] video pretty much sums it up and by all means is worth a watch. ------------------- [1] [link] [2] [link] [3] [this video]
Visual demonstration of how unstable p-values are across samples
@po Feb 2015 Strongly recommends
on HN thread Psychology Journal Bans Significance Testing
The audio is a bit quiet but the 'dance of the p values' video [1] linked to by the article is absolutely fantastic and well worth watching. [1] [this video]
Dance of the p values demonstration on significance testing

Citations, criticism and jokes

@lomnakkus Mar 2014 Cites it
on HN thread Gravity waves from Big Bang detected
I can't claim to understand much of the statistics, but according to [1], p-values are pretty sketchy as a measure of "is this likely to be true?" [1] [this video]
Shows p-values are a sketchy measure of truth

Video list and Hacker News comment labels from HackerTube (prompted by @karpathy), released under ODC-By 1.0, built on the open-index/hacker-news archive. Hacker News data is provided by Y Combinator; comments remain the work of their authors. Video titles, channel names and thumbnails belong to their creators and are shown via YouTube. HackerTube Watch is an unofficial edition. Data export of 2026-10-31.

Keyboard shortcuts

/
Search
j k
Next / previous video
r
Surprise me
l
Like (video page)
w
Watch later (video page)
?
This help
Esc
Close