Percent grammatical responses as a general outcome measure: Initial validity

Sarita Eisenberg, Ling Yu Guo

Research output: Contribution to journalComment/debate

Abstract

Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of PGR with a previously validated measure of grammaticality, percent grammatical utterances (PGU), and examined the extent to which PGR and PGU agreed upon pass/fail decisions for children. Method: Participants included 79 3-year-olds from mostly middle socioeconomic status homes. Language samples were elicited by asking children to describe 15 pictures in response to 4 questions per picture. To calculate PGU, children’s responses to all 4 questions were segmented into communication units, and each communication unit was evaluated for grammatical errors. To calculate PGR, the entire response to just the first question was evaluated for grammatical errors. Results: PGR scores significantly correlated with a standardized test of grammar (r =.70), but not with a measure of vocabulary (i.e., type–token ratio; r =.11). In addition, PGR scores were significantly correlated with PGU scores (r =.88). Agreement between PGR and PGU was 92% for pass decisions and 94% for fail decisions. Conclusions: The current study establishes the construct validity of PGR as a measure of grammar and supports the use of PGR as a measure to assess grammaticality.

Original languageEnglish
Pages (from-to)98-107
Number of pages10
JournalLanguage, Speech, and Hearing Services in Schools
Volume49
Issue number1
DOIs
StatePublished - 1 Jan 2018

Fingerprint

grammar
Communication
Outcome Assessment (Health Care)
construct validity
Vocabulary
Social Class
Language
communication
social status
vocabulary
language
Utterance

Cite this

@article{3e0afe8defc641378911551259178989,
title = "Percent grammatical responses as a general outcome measure: Initial validity",
abstract = "Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of PGR with a previously validated measure of grammaticality, percent grammatical utterances (PGU), and examined the extent to which PGR and PGU agreed upon pass/fail decisions for children. Method: Participants included 79 3-year-olds from mostly middle socioeconomic status homes. Language samples were elicited by asking children to describe 15 pictures in response to 4 questions per picture. To calculate PGU, children’s responses to all 4 questions were segmented into communication units, and each communication unit was evaluated for grammatical errors. To calculate PGR, the entire response to just the first question was evaluated for grammatical errors. Results: PGR scores significantly correlated with a standardized test of grammar (r =.70), but not with a measure of vocabulary (i.e., type–token ratio; r =.11). In addition, PGR scores were significantly correlated with PGU scores (r =.88). Agreement between PGR and PGU was 92{\%} for pass decisions and 94{\%} for fail decisions. Conclusions: The current study establishes the construct validity of PGR as a measure of grammar and supports the use of PGR as a measure to assess grammaticality.",
author = "Sarita Eisenberg and Guo, {Ling Yu}",
year = "2018",
month = "1",
day = "1",
doi = "10.1044/2017_LSHSS-16-0070",
language = "English",
volume = "49",
pages = "98--107",
journal = "Language, Speech, and Hearing Services in Schools",
issn = "0161-1461",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "1",

}

Percent grammatical responses as a general outcome measure : Initial validity. / Eisenberg, Sarita; Guo, Ling Yu.

In: Language, Speech, and Hearing Services in Schools, Vol. 49, No. 1, 01.01.2018, p. 98-107.

Research output: Contribution to journalComment/debate

TY - JOUR

T1 - Percent grammatical responses as a general outcome measure

T2 - Initial validity

AU - Eisenberg, Sarita

AU - Guo, Ling Yu

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of PGR with a previously validated measure of grammaticality, percent grammatical utterances (PGU), and examined the extent to which PGR and PGU agreed upon pass/fail decisions for children. Method: Participants included 79 3-year-olds from mostly middle socioeconomic status homes. Language samples were elicited by asking children to describe 15 pictures in response to 4 questions per picture. To calculate PGU, children’s responses to all 4 questions were segmented into communication units, and each communication unit was evaluated for grammatical errors. To calculate PGR, the entire response to just the first question was evaluated for grammatical errors. Results: PGR scores significantly correlated with a standardized test of grammar (r =.70), but not with a measure of vocabulary (i.e., type–token ratio; r =.11). In addition, PGR scores were significantly correlated with PGU scores (r =.88). Agreement between PGR and PGU was 92% for pass decisions and 94% for fail decisions. Conclusions: The current study establishes the construct validity of PGR as a measure of grammar and supports the use of PGR as a measure to assess grammaticality.

AB - Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of PGR with a previously validated measure of grammaticality, percent grammatical utterances (PGU), and examined the extent to which PGR and PGU agreed upon pass/fail decisions for children. Method: Participants included 79 3-year-olds from mostly middle socioeconomic status homes. Language samples were elicited by asking children to describe 15 pictures in response to 4 questions per picture. To calculate PGU, children’s responses to all 4 questions were segmented into communication units, and each communication unit was evaluated for grammatical errors. To calculate PGR, the entire response to just the first question was evaluated for grammatical errors. Results: PGR scores significantly correlated with a standardized test of grammar (r =.70), but not with a measure of vocabulary (i.e., type–token ratio; r =.11). In addition, PGR scores were significantly correlated with PGU scores (r =.88). Agreement between PGR and PGU was 92% for pass decisions and 94% for fail decisions. Conclusions: The current study establishes the construct validity of PGR as a measure of grammar and supports the use of PGR as a measure to assess grammaticality.

UR - http://www.scopus.com/inward/record.url?scp=85040990715&partnerID=8YFLogxK

U2 - 10.1044/2017_LSHSS-16-0070

DO - 10.1044/2017_LSHSS-16-0070

M3 - Comment/debate

C2 - 29209729

AN - SCOPUS:85040990715

VL - 49

SP - 98

EP - 107

JO - Language, Speech, and Hearing Services in Schools

JF - Language, Speech, and Hearing Services in Schools

SN - 0161-1461

IS - 1

ER -