The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT

Abstract : Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task.
Document type :
Journal articles
Complete list of metadatas

Cited literature [45 references]  Display  Hide  Download

https://hal.univ-rennes2.fr/hal-01724680
Contributor : Laurence Leroux <>
Submitted on : Tuesday, March 6, 2018 - 4:50:57 PM
Last modification on : Saturday, May 4, 2019 - 4:44:02 PM
Long-term archiving on : Thursday, June 7, 2018 - 2:27:29 PM

File

The role of psychometrics in i...
Publisher files allowed on an open archive

Identifiers

Citation

Shelly Cooper, Corentin Gonthier, Deanna Barch, Todd Braver. The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT. Frontiers in Psychology, Frontiers, 2017, 8, pp.1482. ⟨10.3389/fpsyg.2017.01482⟩. ⟨hal-01724680⟩

Share

Metrics

Record views

169

Files downloads

168