Developing local oral reading fluency cut scores for predicting high-stakes test performance

Sally Grapin, John H. Kranzler, Nancy Waldron, Diana Joyce-Beaulieu, James Algina

Research output: Contribution to journalArticleResearchpeer-review

Abstract

This study evaluated the classification accuracy of a second grade oral reading fluency curriculum-based measure (R-CBM) in predicting third grade state test performance. It also compared the long-term classification accuracy of local and publisher-recommended R-CBM cut scores. Participants were 266 students who were divided into a calibration sample (n = 170) and two cross-validation samples (n = 46; n = 50), respectively. Using calibration sample data, local fall, winter, and spring R-CBM cut scores for predicting students’ state test performance were developed using three methods: discriminant analysis (DA), logistic regression (LR), and receiver operating characteristic curve analysis (ROC). The classification accuracy of local and publisher-recommended cut scores was evaluated across subsamples. Only DA and ROC produced cut scores that maintained adequate sensitivity (≥.70) across cohorts; however, LR and publisher-recommended scores had higher levels of specificity and overall correct classification. Implications for developing local cut scores are discussed.

Original languageEnglish
Pages (from-to)932-946
Number of pages15
JournalPsychology in the Schools
Volume54
Issue number9
DOIs
StatePublished - 1 Nov 2017

Fingerprint

Reading
ROC Curve
Curriculum
Discriminant Analysis
Calibration
performance
Logistic Models
discriminant analysis
Students
curriculum
logistics
regression
recipient
student
school grade

Keywords

  • curriculum-based measurement
  • local benchmarks
  • universal screening

Cite this

Grapin, Sally ; Kranzler, John H. ; Waldron, Nancy ; Joyce-Beaulieu, Diana ; Algina, James. / Developing local oral reading fluency cut scores for predicting high-stakes test performance. In: Psychology in the Schools. 2017 ; Vol. 54, No. 9. pp. 932-946.
@article{27e8855116c341bfbdd9a581652fe523,
title = "Developing local oral reading fluency cut scores for predicting high-stakes test performance",
abstract = "This study evaluated the classification accuracy of a second grade oral reading fluency curriculum-based measure (R-CBM) in predicting third grade state test performance. It also compared the long-term classification accuracy of local and publisher-recommended R-CBM cut scores. Participants were 266 students who were divided into a calibration sample (n = 170) and two cross-validation samples (n = 46; n = 50), respectively. Using calibration sample data, local fall, winter, and spring R-CBM cut scores for predicting students’ state test performance were developed using three methods: discriminant analysis (DA), logistic regression (LR), and receiver operating characteristic curve analysis (ROC). The classification accuracy of local and publisher-recommended cut scores was evaluated across subsamples. Only DA and ROC produced cut scores that maintained adequate sensitivity (≥.70) across cohorts; however, LR and publisher-recommended scores had higher levels of specificity and overall correct classification. Implications for developing local cut scores are discussed.",
keywords = "curriculum-based measurement, local benchmarks, universal screening",
author = "Sally Grapin and Kranzler, {John H.} and Nancy Waldron and Diana Joyce-Beaulieu and James Algina",
year = "2017",
month = "11",
day = "1",
doi = "10.1002/pits.22035",
language = "English",
volume = "54",
pages = "932--946",
journal = "Psychology in the Schools",
issn = "0033-3085",
publisher = "Wiley-Liss Inc.",
number = "9",

}

Developing local oral reading fluency cut scores for predicting high-stakes test performance. / Grapin, Sally; Kranzler, John H.; Waldron, Nancy; Joyce-Beaulieu, Diana; Algina, James.

In: Psychology in the Schools, Vol. 54, No. 9, 01.11.2017, p. 932-946.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Developing local oral reading fluency cut scores for predicting high-stakes test performance

AU - Grapin, Sally

AU - Kranzler, John H.

AU - Waldron, Nancy

AU - Joyce-Beaulieu, Diana

AU - Algina, James

PY - 2017/11/1

Y1 - 2017/11/1

N2 - This study evaluated the classification accuracy of a second grade oral reading fluency curriculum-based measure (R-CBM) in predicting third grade state test performance. It also compared the long-term classification accuracy of local and publisher-recommended R-CBM cut scores. Participants were 266 students who were divided into a calibration sample (n = 170) and two cross-validation samples (n = 46; n = 50), respectively. Using calibration sample data, local fall, winter, and spring R-CBM cut scores for predicting students’ state test performance were developed using three methods: discriminant analysis (DA), logistic regression (LR), and receiver operating characteristic curve analysis (ROC). The classification accuracy of local and publisher-recommended cut scores was evaluated across subsamples. Only DA and ROC produced cut scores that maintained adequate sensitivity (≥.70) across cohorts; however, LR and publisher-recommended scores had higher levels of specificity and overall correct classification. Implications for developing local cut scores are discussed.

AB - This study evaluated the classification accuracy of a second grade oral reading fluency curriculum-based measure (R-CBM) in predicting third grade state test performance. It also compared the long-term classification accuracy of local and publisher-recommended R-CBM cut scores. Participants were 266 students who were divided into a calibration sample (n = 170) and two cross-validation samples (n = 46; n = 50), respectively. Using calibration sample data, local fall, winter, and spring R-CBM cut scores for predicting students’ state test performance were developed using three methods: discriminant analysis (DA), logistic regression (LR), and receiver operating characteristic curve analysis (ROC). The classification accuracy of local and publisher-recommended cut scores was evaluated across subsamples. Only DA and ROC produced cut scores that maintained adequate sensitivity (≥.70) across cohorts; however, LR and publisher-recommended scores had higher levels of specificity and overall correct classification. Implications for developing local cut scores are discussed.

KW - curriculum-based measurement

KW - local benchmarks

KW - universal screening

UR - http://www.scopus.com/inward/record.url?scp=85018987466&partnerID=8YFLogxK

U2 - 10.1002/pits.22035

DO - 10.1002/pits.22035

M3 - Article

VL - 54

SP - 932

EP - 946

JO - Psychology in the Schools

JF - Psychology in the Schools

SN - 0033-3085

IS - 9

ER -