Cognitive reflection test
≈ 4 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In psychology, the cognitive reflection test (CRT) is a task designed to measure a person's tendency to override an incorrect "gut" response and engage in further reflection to find a correct answer. However, the validity of the assessment as a measure of "cognitive reflection" or "intuitive thinking" is under question. It was first described in 2005 by Shane Frederick. The CRT has a moderate positive correlation with measures of intelligence, such as the IQ test, and it correlates highly with various measures of mental heuristics.
Some researchers argue that the CRT is actually measuring cognitive abilities (colloquially known as intelligence). Later research has shown that the CRT is a multifaceted construct: many start their response with the correct answer, while others fail to solve the test even if they reflect on their intuitive first answer. It has also been argued that suppression of the first answer is not the only factor behind the successful performance on the CRT; numeracy and reflectivity both account for performance.
In psychology, the cognitive reflection test (CRT) is a task designed to measure a person's tendency to override an incorrect "gut" response and engage in further reflection to find a correct answer. However, the validity of the assessment as a measure of "cognitive reflection" or "intuitive thinking" is under question. It was first described in 2005 by Shane Frederick. The CRT has a moderate positive correlation with measures of intelligence, such as the IQ test, and it correlates highly with various measures of mental heuristics.
Some researchers argue that the CRT is actually measuring cognitive abilities (colloquially known as intelligence). Later research has shown that the CRT is a multifaceted construct: many start their response with the correct answer, while others fail to solve the test even if they reflect on their intuitive first answer. It has also been argued that suppression of the first answer is not the only factor behind the successful performance on the CRT; numeracy and reflectivity both account for performance.
Basis of test
According to Frederick, there are two general types of cognitive activity called "system 1" and "system 2" (these terms have been first used by Keith Stanovich and Richard West ). System 1 is executed quickly without reflection, while system 2 requires conscious thought and effort. The cognitive reflection test has three questions that each have an obvious but incorrect response given by system 1. The correct response requires the activation of system 2. For system 2 to be activated, a person must note that their first answer is incorrect, which requires reflection on their own cognition.
Correlating measures
The test has been found to correlate with many measures of economic thinking, such as numeracy, temporal discounting, risk preference, and gambling preference. It has also been correlated with measures of mental heuristics, such as the gambler's fallacy, understanding of regression to the mean, the sunk cost fallacy, and others. Keith Stanovich found that cognitive ability is not strongly correlated with CRT scores because it will only lead to better CRT performance under certain conditions.
First, the test-taker must recognize the need to override their system 1 response, and then they must have available cognitive resources to carry out the override. If the test-taker does not need to inhibit system 1 for the override, then the system 2 response immediately follows. Otherwise, they must have the capacity to sustain inhibition of system 1 in order to engage the system 2 response.
Contrarily, some researchers have assessed the validity of the assessment, using an advanced item response theory method, and found that the CRT likely measures cognitive ability. The authors of the study explain the validity of the CRT has been questioned due to the lack of validity studies and the lack of a psychometric approach.
References
Text derived from https://en.wikipedia.org/w/index.php?oldid=1373254931 under CC BY-SA 4.0; modifications have been made.