A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons With Misfitting Responses

Type: Article

Publication Date: 2009-12-16

Citations: 11

DOI: https://doi.org/10.1177/0146621609349802

View Chat PDF

Abstract

This simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four content-balancing procedures were (a) no content balancing, (b) screener-based, (c) mixed (screener plus content balancing), and (d) full content balancing. In full content balancing and in mixed content balancing following administration of the screener items, item selection was based on (a) whether the target number of items for the item’s subscale was reached and (b) the item’s information function. Mixed and full content balancing provided the best representation of items from each of the main subscales of the Internal Mental Distress Scale. These procedures also resulted in higher CAT to full-scale correlations for the Trauma and Homicidal/Suicidal Thought subscales and improved detection of atypical responding.

Locations

  • PubMed Central - View
  • Europe PMC (PubMed Central) - View - PDF
  • PubMed - View
  • Applied Psychological Measurement - View

Similar Works

Action Title Year Authors
+ PDF Chat Improving Accuracy and Usage by Correctly Selecting: The Effects of Model Selection in Cognitive Diagnosis Computerized Adaptive Testing 2020 Miguel A. Sorrel
Francisco Abad
Pablo Nájera
+ Detecting uniform differential item functioning for continuous response computerized adaptive testing 2024 Chun Wang
Ruoyi Zhu
+ Computerized Adaptive Testing: A Comparison of Three Content Balancing Methods 2003 Chi Keung Eddie Leung
Hua Hua Chang
Kit‐Tai Hau
+ PDF Chat The Accuracy of Computerized Adaptive Testing in Heterogeneous Populations: A Mixture Item-Response Theory Analysis 2016 Richard Sawatzky
Pamela A. Ratner
Jacek A. Kopec
Amery D. Wu
Bruno D. Zumbo
+ PDF Chat Stratified Item Selection and Exposure Control in Unidimensional Adaptive Testing in the Presence of Two-Dimensional Data 2014 Kevin Kalinowski
Prathiba Natesan
Richard N. Henson
+ Relative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: the GAIN substance problem scale. 2007 Barth Riley
Kendon J. Conrad
Nikolaus Bezruczko
Michael L. Dennis
+ PDF Chat Commentary: Are We Ready for Computerized Adaptive Testing? 2008 George J. Unick
Martha Shumway
William A. Hargreaves
+ PDF Chat Multidimensional Computerized Adaptive Testing Simulations in R 2022 Fazilet Gül İNCE ARACI
Şeref Tan
+ PDF Chat Dependencies in Item-Adaptive CAT Data and Differential Item Functioning Detection: A Multilevel Framework 2024 Dandan Chen Kaptur
Justin L. Kern
Chingwei David Shin
Jinming Zhang
+ PDF Chat Ancillary Data for Refining Computer Adaptive Algorithms for the Assessment of Anomia 2021 Emily Tudorache
+ PDF Chat Modeling Response Time and Responses in Multidimensional Health Measurement 2019 Chun Wang
David J. Weiss
Shiyang Su
+ Diagnostic Classification Models and Multidimensional Adaptive Testing: A Commentary on Rupp and Templin 2009 Andreas Frey
Claus H. Carstensen
+ PDF Chat Survey of Computerized Adaptive Testing: A Machine Learning Perspective 2024 Qi Liu
Yan Zhuang
Haoyang Bi
Zhenya Huang
Weizhe Huang
Jiatong Li
Junhao Yu
Zirui Liu
Zirui Hu
Yuting Hong
+ Treading Carefully: Agnostic Identification as the First Step of Detecting Differential Item Functioning 2021 Ben Stenhaug
Michael C. Frank
Benjamin W. Domingue
+ Computer‐Adaptive Testing 2014 Richard M. Luecht
+ Combining Item Response Theory and Diagnostic Classification Models: A Psychometric Model for Scaling Ability and Diagnosing Misconceptions 2013 Laine Bradshaw
Jonathan Templin
+ A Fair Comparison of the Performance of Computerized Adaptive Testing snd Multistage Adaptive Testing 2017 Keyin Wang
+ PDF Chat A two‐step item bank calibration strategy based on 1‐bit matrix completion for small‐scale computerized adaptive testing 2024 Yawei Shen
Shiyu Wang
Houping Xiao
+ PDF Chat Computerized adaptive testing of population psychological distress: simulation-based evaluation of GHQ-30 2015 Jan Štochl
Jan R. Böhnke
Kate E. Pickett
Tim Croudace
+ A comparison of computerized classification testing and computerized adaptive testing in clinical psychology 2013 Niels Smits
Matthew Finkelman