Continuous norming of psychometric tests: A simulation study of parametric and semi-parametric approaches
Please always quote using this URN: urn:nbn:de:bvb:20-opus-200480
- Continuous norming methods have seldom been subjected to scientific review. In this simulation study, we compared parametric with semi-parametric continuous norming methods in psychometric tests by constructing a fictitious population model within which a latent ability increases with age across seven age groups. We drew samples of different sizes (n = 50, 75, 100, 150, 250, 500 and 1,000 per age group) and simulated the results of an easy, medium, and difficult test scale based on Item Response Theory (IRT). We subjected the resulting data toContinuous norming methods have seldom been subjected to scientific review. In this simulation study, we compared parametric with semi-parametric continuous norming methods in psychometric tests by constructing a fictitious population model within which a latent ability increases with age across seven age groups. We drew samples of different sizes (n = 50, 75, 100, 150, 250, 500 and 1,000 per age group) and simulated the results of an easy, medium, and difficult test scale based on Item Response Theory (IRT). We subjected the resulting data to different continuous norming methods and compared the data fit under the different test conditions with a representative cross-validation dataset of n = 10,000 per age group. The most significant differences were found in suboptimal (i.e., too easy or too difficult) test scales and in ability levels that were far from the population mean. We discuss the results with regard to the selection of the appropriate modeling techniques in psychometric test construction, the required sample sizes, and the requirement to report appropriate quantitative and qualitative test quality criteria for continuous norming methods in test manuals.…
Author: | Alexandra Lenhard, Wolfgang LenhardORCiD, Sebastian Gary |
---|---|
URN: | urn:nbn:de:bvb:20-opus-200480 |
Document Type: | Journal article |
Faculties: | Fakultät für Humanwissenschaften (Philos., Psycho., Erziehungs- u. Gesell.-Wissensch.) / Institut für Psychologie |
Language: | English |
Parent Title (English): | PLoS ONE |
Year of Completion: | 2019 |
Volume: | 14 |
Issue: | 9 |
Pagenumber: | e0222279 |
Source: | PLoS ONE 14(9):e0222279 (2019). DOI: 10.1371/journal. pone.0222279 |
DOI: | https://doi.org/10.1371/journal.pone.0222279 |
Dewey Decimal Classification: | 1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie |
Tag: | age groups; normal distribution; polynomials; psychometrics; simulation and modeling; skewness; statistical distributions; statistical models |
Release Date: | 2020/03/30 |
Collections: | Open-Access-Publikationsfonds / Förderzeitraum 2019 |
Licence (German): | CC BY: Creative-Commons-Lizenz: Namensnennung 4.0 International |