Customized computer-based administration of the PCL-5 for the efficient assessment of PTSD

A proof-of-principle study

Matthew D. Finkelman, Sarah Lowe, Wonsuk Kim, Oliver Gruebner, Niels Smits, Sandro Galea

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)

Abstract

Objective: To investigate the potential of customized computer-based testing procedures to reduce the mean test length of the Posttraumatic Stress Checklist for DSM-5 (PCL-5). Method: A retrospective analysis was conducted using responses from 942 adults who had completed the full-length (20-item) PCL-5 in the aftermath of Hurricane Sandy. The abilities of 2 testing procedures, curtailment and stochastic curtailment, to lessen the instrument's mean test length while maintaining the same result as the full-length PCL-5 ("positive" or "negative") were evaluated in a post hoc simulation. Curtailment and stochastic curtailment track a respondent's answers as she takes the instrument and stop the test if future items are unable or unlikely to change the result. The performance of each procedure was recorded under 2 scoring methods: a total-score-based method and a cluster-based method. Each procedure's sensitivity, specificity, and overall agreement with the full-length PCL-5 were computed. Results: Curtailment reduced the mean test length by 40% under the total-score-based method, and by more than 70% under the cluster-based method, while exhibiting 100% sensitivity, specificity, and overall agreement with the full-length PCL-5. Stochastic curtailment reduced the mean test length by up to 88% under the total-score-based method, and up to 84% under the cluster-based method, while always exhibiting at least 92% sensitivity and 99.8% overall agreement, as well as 100% specificity, for the full-length PCL-5. Conclusions: Curtailment and stochastic curtailment have potential to enhance the efficiency of the PCL-5 when this assessment is administered by computer. The 2 procedures should be evaluated in future prospective studies.

Original languageEnglish
Pages (from-to)379-389
Number of pages11
JournalPsychological Trauma: Theory, Research, Practice, and Policy
Volume9
Issue number3
DOIs
StatePublished - 1 May 2017

Fingerprint

Post-Traumatic Stress Disorders
Checklist
Cyclonic Storms
Sensitivity and Specificity
Aptitude
Research Design
Prospective Studies
Efficiency

Keywords

  • PCL-5
  • PTSD
  • curtailment
  • respondent burden
  • stochastic curtailment

Cite this

Finkelman, Matthew D. ; Lowe, Sarah ; Kim, Wonsuk ; Gruebner, Oliver ; Smits, Niels ; Galea, Sandro. / Customized computer-based administration of the PCL-5 for the efficient assessment of PTSD : A proof-of-principle study. In: Psychological Trauma: Theory, Research, Practice, and Policy. 2017 ; Vol. 9, No. 3. pp. 379-389.
@article{e35d348702914b20a96641760d7d5000,
title = "Customized computer-based administration of the PCL-5 for the efficient assessment of PTSD: A proof-of-principle study",
abstract = "Objective: To investigate the potential of customized computer-based testing procedures to reduce the mean test length of the Posttraumatic Stress Checklist for DSM-5 (PCL-5). Method: A retrospective analysis was conducted using responses from 942 adults who had completed the full-length (20-item) PCL-5 in the aftermath of Hurricane Sandy. The abilities of 2 testing procedures, curtailment and stochastic curtailment, to lessen the instrument's mean test length while maintaining the same result as the full-length PCL-5 ({"}positive{"} or {"}negative{"}) were evaluated in a post hoc simulation. Curtailment and stochastic curtailment track a respondent's answers as she takes the instrument and stop the test if future items are unable or unlikely to change the result. The performance of each procedure was recorded under 2 scoring methods: a total-score-based method and a cluster-based method. Each procedure's sensitivity, specificity, and overall agreement with the full-length PCL-5 were computed. Results: Curtailment reduced the mean test length by 40{\%} under the total-score-based method, and by more than 70{\%} under the cluster-based method, while exhibiting 100{\%} sensitivity, specificity, and overall agreement with the full-length PCL-5. Stochastic curtailment reduced the mean test length by up to 88{\%} under the total-score-based method, and up to 84{\%} under the cluster-based method, while always exhibiting at least 92{\%} sensitivity and 99.8{\%} overall agreement, as well as 100{\%} specificity, for the full-length PCL-5. Conclusions: Curtailment and stochastic curtailment have potential to enhance the efficiency of the PCL-5 when this assessment is administered by computer. The 2 procedures should be evaluated in future prospective studies.",
keywords = "PCL-5, PTSD, curtailment, respondent burden, stochastic curtailment",
author = "Finkelman, {Matthew D.} and Sarah Lowe and Wonsuk Kim and Oliver Gruebner and Niels Smits and Sandro Galea",
year = "2017",
month = "5",
day = "1",
doi = "10.1037/tra0000226",
language = "English",
volume = "9",
pages = "379--389",
journal = "Psychological Trauma: Theory, Research, Practice, and Policy",
issn = "1942-9681",
publisher = "American Psychological Association Inc.",
number = "3",

}

Customized computer-based administration of the PCL-5 for the efficient assessment of PTSD : A proof-of-principle study. / Finkelman, Matthew D.; Lowe, Sarah; Kim, Wonsuk; Gruebner, Oliver; Smits, Niels; Galea, Sandro.

In: Psychological Trauma: Theory, Research, Practice, and Policy, Vol. 9, No. 3, 01.05.2017, p. 379-389.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Customized computer-based administration of the PCL-5 for the efficient assessment of PTSD

T2 - A proof-of-principle study

AU - Finkelman, Matthew D.

AU - Lowe, Sarah

AU - Kim, Wonsuk

AU - Gruebner, Oliver

AU - Smits, Niels

AU - Galea, Sandro

PY - 2017/5/1

Y1 - 2017/5/1

N2 - Objective: To investigate the potential of customized computer-based testing procedures to reduce the mean test length of the Posttraumatic Stress Checklist for DSM-5 (PCL-5). Method: A retrospective analysis was conducted using responses from 942 adults who had completed the full-length (20-item) PCL-5 in the aftermath of Hurricane Sandy. The abilities of 2 testing procedures, curtailment and stochastic curtailment, to lessen the instrument's mean test length while maintaining the same result as the full-length PCL-5 ("positive" or "negative") were evaluated in a post hoc simulation. Curtailment and stochastic curtailment track a respondent's answers as she takes the instrument and stop the test if future items are unable or unlikely to change the result. The performance of each procedure was recorded under 2 scoring methods: a total-score-based method and a cluster-based method. Each procedure's sensitivity, specificity, and overall agreement with the full-length PCL-5 were computed. Results: Curtailment reduced the mean test length by 40% under the total-score-based method, and by more than 70% under the cluster-based method, while exhibiting 100% sensitivity, specificity, and overall agreement with the full-length PCL-5. Stochastic curtailment reduced the mean test length by up to 88% under the total-score-based method, and up to 84% under the cluster-based method, while always exhibiting at least 92% sensitivity and 99.8% overall agreement, as well as 100% specificity, for the full-length PCL-5. Conclusions: Curtailment and stochastic curtailment have potential to enhance the efficiency of the PCL-5 when this assessment is administered by computer. The 2 procedures should be evaluated in future prospective studies.

AB - Objective: To investigate the potential of customized computer-based testing procedures to reduce the mean test length of the Posttraumatic Stress Checklist for DSM-5 (PCL-5). Method: A retrospective analysis was conducted using responses from 942 adults who had completed the full-length (20-item) PCL-5 in the aftermath of Hurricane Sandy. The abilities of 2 testing procedures, curtailment and stochastic curtailment, to lessen the instrument's mean test length while maintaining the same result as the full-length PCL-5 ("positive" or "negative") were evaluated in a post hoc simulation. Curtailment and stochastic curtailment track a respondent's answers as she takes the instrument and stop the test if future items are unable or unlikely to change the result. The performance of each procedure was recorded under 2 scoring methods: a total-score-based method and a cluster-based method. Each procedure's sensitivity, specificity, and overall agreement with the full-length PCL-5 were computed. Results: Curtailment reduced the mean test length by 40% under the total-score-based method, and by more than 70% under the cluster-based method, while exhibiting 100% sensitivity, specificity, and overall agreement with the full-length PCL-5. Stochastic curtailment reduced the mean test length by up to 88% under the total-score-based method, and up to 84% under the cluster-based method, while always exhibiting at least 92% sensitivity and 99.8% overall agreement, as well as 100% specificity, for the full-length PCL-5. Conclusions: Curtailment and stochastic curtailment have potential to enhance the efficiency of the PCL-5 when this assessment is administered by computer. The 2 procedures should be evaluated in future prospective studies.

KW - PCL-5

KW - PTSD

KW - curtailment

KW - respondent burden

KW - stochastic curtailment

UR - http://www.scopus.com/inward/record.url?scp=85001079062&partnerID=8YFLogxK

U2 - 10.1037/tra0000226

DO - 10.1037/tra0000226

M3 - Article

VL - 9

SP - 379

EP - 389

JO - Psychological Trauma: Theory, Research, Practice, and Policy

JF - Psychological Trauma: Theory, Research, Practice, and Policy

SN - 1942-9681

IS - 3

ER -