Evaluating the Criterion Validity and Classification Accuracy of Universal Screening Measures in Reading
Document Type
Article
Publication Date
2022
Keywords
universal screening, reading, Measures of Academic Progress, Strategic Teaching Evaluation of Progress, multi-tiered systems of support, validity
Digital Object Identifier (DOI)
https://doi.org/10.1177/1534508419857232
Abstract
Educators use universal screening to identify students who may be at risk for not meeting proficiency on the state assessment. Given the potential high-stakes of state tests, using accurate screeners is critical. Independent research is emerging on screeners such as the Measures of Academic Progress (MAP), a computer adaptive test, and the Strategic Teaching Evaluation of Progress (STEP), a developmental reading assessment. This study evaluated the criterion-related validity of MAP and STEP with a state assessment. Additionally, the utility of each screener to distinguish between students at risk and not at risk was evaluated using multiple screening approaches. Participants were two cohorts (Cohort 1 N = 255; Cohort 2 N = 122) of children enrolled in two public charter schools. MAP and STEP were administered in spring of second grade and fall of third grade. Results suggested MAP and STEP scores were significant strong predictors of third-grade state assessment scores. STEP scores explained a small amount of variance in state assessment scores beyond MAP scores alone. Findings support using MAP and STEP to identify students who may be at risk; however, MAP is sufficient as a single screener, using locally derived cut-scores or cut-scores linked to the state assessment.
Was this content written or created while at USF?
Yes
Citation / Publisher Attribution
Assessment for Effective Intervention, v. 46, issue 2, p. 110-120
Scholar Commons Citation
Thomas, Asia S. and January, Stacy-Ann A., "Evaluating the Criterion Validity and Classification Accuracy of Universal Screening Measures in Reading" (2022). Educational and Psychological Studies Faculty Publications. 253.
https://digitalcommons.usf.edu/esf_facpub/253
