Lesson plan
GRIM test
The granularity-related inconsistency of means (GRIM) test is a simple statistical test used to identify inconsistencies in the analysis of data sets. The test relies on the fact that, given a dataset containing N integer values, the arithmetic mean (commonly called simply the average) is restricted to a few possible values: it must always be expressible as a fraction whose denominator is N and whose numerator is an integer. If the reported mean does not fit this description, there must be an error somewhere; the preferred term for such errors is "inconsistencies", to emphasise that their origin is, on first discovery, typically unknown. GRIM inconsistencies can result from inadvertent data-entry or typographical errors, or from scientific fraud. The GRIM test is most useful in fields such as psychology where researchers typically use small groups and measurements are often integers. The GRIM test was proposed by and James Heathers in 2016, following increased awareness of the replication crisis in some fields of science.
Article summary
The granularity-related inconsistency of means (GRIM) test is a simple statistical test used to identify inconsistencies in the analysis of data sets. The test relies on the fact that, given a dataset containing N integer values, the arithmetic mean (commonly called simply the average) is restricted to a few possible values: it must always be expressible as a fraction whose denominator is N and whose numerator is an integer. If the reported mean does not fit this description, there must be an error somewhere; the preferred term for such errors is "inconsistencies", to emphasise that their origin is, on first discovery, typically unknown. GRIM inconsistencies can result from inadvertent data-entry or typographical errors, or from scientific fraud. The GRIM test is most useful in fields such as psychology where researchers typically use small groups and measurements are often integers. The GRIM test was proposed by and James Heathers in 2016, following increased awareness of the replication crisis in some fields of science.
Key claims
No claims recorded.
Discussion questions
- Summarise the article in your own words. Which single claim would you verify first, and why?
- Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
- If two sources disagreed about one of these facts, what would you need in order to trust one over the other?
Bibliography
No sources recorded.
Key claims and bibliography are generated from the same tracked claims and sources as the article page.