Stability of word-retrieval errors with the Aphasiabank stimuli

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Purpose: This study examined the test-retest reliability of select measures of word-retrieval errors in narrative discourses of individuals with aphasia assessed with the AphasiaBank stimuli. Method: Ten participants with aphasia were video recorded during 2 sessions producing narratives elicited with pictures. Discourses were transcribed and coded using AphasiaBank procedures, then analyzed for the stability of rates of phonological errors, semantic errors, false starts, time fillers, and repetitions per minute. Values for correlation coefficients and the minimal detectable change score were used to assess stability for research and clinical decision making. Results: There was poor test-retest reliability when the discourses were analyzed by each narrative subgenre. When the narrative discourses were combined for analysis, several measures appeared to be sufficiently stable across sessions for use in group studies, and 1 could be adequately stable for making clinical decisions about an individual. Conclusions: Because the short speech samples yielded by the subgenre narrative analyses demonstrated poor test-retest reliability, it is recommended that all of the picturebased narrative discourse tasks be combined for analysis of word-retrieval impairments when the AphasiaBank stimuli are used. However, the confidence intervals associated with the reliability coefficients obtained in this study suggest caution in using the measures if they are based on performance in a single session. More investigations of the test-retest reliability of measures used to study language impairment in discourse contexts are essential.

Original languageEnglish
Pages (from-to)S953-S960
JournalAmerican Journal of Speech-Language Pathology
Volume24
Issue number4
DOIs
StatePublished - 1 Nov 2015

Fingerprint

Reproducibility of Results
stimulus
narrative
discourse
Aphasia
speech disorder
Semantics
Language
Confidence Intervals
study group
video
confidence
Research
semantics
decision making
language
performance
Clinical Decision-Making
Values

Cite this

@article{b36437e301b643cf89978244566b4a95,
title = "Stability of word-retrieval errors with the Aphasiabank stimuli",
abstract = "Purpose: This study examined the test-retest reliability of select measures of word-retrieval errors in narrative discourses of individuals with aphasia assessed with the AphasiaBank stimuli. Method: Ten participants with aphasia were video recorded during 2 sessions producing narratives elicited with pictures. Discourses were transcribed and coded using AphasiaBank procedures, then analyzed for the stability of rates of phonological errors, semantic errors, false starts, time fillers, and repetitions per minute. Values for correlation coefficients and the minimal detectable change score were used to assess stability for research and clinical decision making. Results: There was poor test-retest reliability when the discourses were analyzed by each narrative subgenre. When the narrative discourses were combined for analysis, several measures appeared to be sufficiently stable across sessions for use in group studies, and 1 could be adequately stable for making clinical decisions about an individual. Conclusions: Because the short speech samples yielded by the subgenre narrative analyses demonstrated poor test-retest reliability, it is recommended that all of the picturebased narrative discourse tasks be combined for analysis of word-retrieval impairments when the AphasiaBank stimuli are used. However, the confidence intervals associated with the reliability coefficients obtained in this study suggest caution in using the measures if they are based on performance in a single session. More investigations of the test-retest reliability of measures used to study language impairment in discourse contexts are essential.",
author = "Mary Boyle",
year = "2015",
month = "11",
day = "1",
doi = "10.1044/2015_AJSLP-14-0152",
language = "English",
volume = "24",
pages = "S953--S960",
journal = "American Journal of Speech-Language Pathology",
issn = "1058-0360",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "4",

}

Stability of word-retrieval errors with the Aphasiabank stimuli. / Boyle, Mary.

In: American Journal of Speech-Language Pathology, Vol. 24, No. 4, 01.11.2015, p. S953-S960.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Stability of word-retrieval errors with the Aphasiabank stimuli

AU - Boyle, Mary

PY - 2015/11/1

Y1 - 2015/11/1

N2 - Purpose: This study examined the test-retest reliability of select measures of word-retrieval errors in narrative discourses of individuals with aphasia assessed with the AphasiaBank stimuli. Method: Ten participants with aphasia were video recorded during 2 sessions producing narratives elicited with pictures. Discourses were transcribed and coded using AphasiaBank procedures, then analyzed for the stability of rates of phonological errors, semantic errors, false starts, time fillers, and repetitions per minute. Values for correlation coefficients and the minimal detectable change score were used to assess stability for research and clinical decision making. Results: There was poor test-retest reliability when the discourses were analyzed by each narrative subgenre. When the narrative discourses were combined for analysis, several measures appeared to be sufficiently stable across sessions for use in group studies, and 1 could be adequately stable for making clinical decisions about an individual. Conclusions: Because the short speech samples yielded by the subgenre narrative analyses demonstrated poor test-retest reliability, it is recommended that all of the picturebased narrative discourse tasks be combined for analysis of word-retrieval impairments when the AphasiaBank stimuli are used. However, the confidence intervals associated with the reliability coefficients obtained in this study suggest caution in using the measures if they are based on performance in a single session. More investigations of the test-retest reliability of measures used to study language impairment in discourse contexts are essential.

AB - Purpose: This study examined the test-retest reliability of select measures of word-retrieval errors in narrative discourses of individuals with aphasia assessed with the AphasiaBank stimuli. Method: Ten participants with aphasia were video recorded during 2 sessions producing narratives elicited with pictures. Discourses were transcribed and coded using AphasiaBank procedures, then analyzed for the stability of rates of phonological errors, semantic errors, false starts, time fillers, and repetitions per minute. Values for correlation coefficients and the minimal detectable change score were used to assess stability for research and clinical decision making. Results: There was poor test-retest reliability when the discourses were analyzed by each narrative subgenre. When the narrative discourses were combined for analysis, several measures appeared to be sufficiently stable across sessions for use in group studies, and 1 could be adequately stable for making clinical decisions about an individual. Conclusions: Because the short speech samples yielded by the subgenre narrative analyses demonstrated poor test-retest reliability, it is recommended that all of the picturebased narrative discourse tasks be combined for analysis of word-retrieval impairments when the AphasiaBank stimuli are used. However, the confidence intervals associated with the reliability coefficients obtained in this study suggest caution in using the measures if they are based on performance in a single session. More investigations of the test-retest reliability of measures used to study language impairment in discourse contexts are essential.

UR - http://www.scopus.com/inward/record.url?scp=84981731070&partnerID=8YFLogxK

U2 - 10.1044/2015_AJSLP-14-0152

DO - 10.1044/2015_AJSLP-14-0152

M3 - Article

C2 - 26151900

AN - SCOPUS:84981731070

VL - 24

SP - S953-S960

JO - American Journal of Speech-Language Pathology

JF - American Journal of Speech-Language Pathology

SN - 1058-0360

IS - 4

ER -