Assessment of the relationship between a written measure of empathy and an independently rated interview of Motivational Interviewing

J. L. Smith, P. Bertone, K. M. Carpenter, R. M. Wain, M. C. Hu, Paul Amrhein, E. V. Nunes

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Motivational Interviewing (MI) is an evidence-based practice shown to be effective when working with people in treatment for substance use disorders. However, MI is a complex treatment modality optimized by training with feedback. Feedback, assessment and monitoring of treatment fidelity require measurement, which is typically done using audiotaped sessions. The gold standard for such measurement of MI skill has been an audiotaped interview, scored by a rater with a detailed structured instrument such as the Motivational Interviewing Treatment Integrity 2.0 (MITI 2.0) Coding System (Moyers, et al., 2005). The Helpful Responses Questionnaire (HRQ) (Miller, Hedrick, & Orlofsky, 1991) is a pen-and-paper test of empathy (a foundational MI skill) that does not require an audiotaped session. A randomized trial of three different regimens for training counselors in MI (live supervision using Teleconferencing, Tape-based supervision and Workshop only) (Smith et al., 2012) offered the opportunity to evaluate the performance of the HRQ as a measure of MI ability, compared to the several MITI 2.0 global scores and subscales. Participants were counselors (N = 97) working at community-based substance use treatment programs, whose MI proficiency was measured at four time points: baseline (before an initial 2-day MI workshop), post-workshop, 8 weeks post-workshop (i.e., post-supervision), and 20 weeks post-workshop with both MITI 2.0 and HRQ. HRQ total scores correlated significantly with the Reflection to Question Ratio from the MITI 2.0 at post-workshop (r = 0.33), week 8 (r = 0.34), and week 20 (r = 0.38), and with the Spirit (r = 0.32) and Empathy (r = 0.32) global scores at week 20. Correlations of HRQ with other MITI 2.0 subscales and time points after workshop were small and not significant. As predicted, HRQ scores differed between training conditions (X2(2) = 7.88, p = 0.02), with counselors assigned to live supervision achieving better HRQ scores than those in Workshop only. In summary, HRQ is a modestly accurate measure, mainly of the Reflection to Question Ratio, considered a core marker of MI skill. It is sensitive to training effects and may help identify counselors needing more intensive supervision. Given its ease of administration and scoring, HRQ may be a useful marker of MI skill during training efforts.

Original languageEnglish
Pages (from-to)56-63
Number of pages8
JournalJournal of Substance Abuse Treatment
Volume87
DOIs
StatePublished - 1 Apr 2018

Fingerprint

Motivational Interviewing
Interviews
Education
Therapeutics
Surveys and Questionnaires
Aptitude
Evidence-Based Practice

Cite this

@article{a2ecc25e38b848849b0b181b1c90927b,
title = "Assessment of the relationship between a written measure of empathy and an independently rated interview of Motivational Interviewing",
abstract = "Motivational Interviewing (MI) is an evidence-based practice shown to be effective when working with people in treatment for substance use disorders. However, MI is a complex treatment modality optimized by training with feedback. Feedback, assessment and monitoring of treatment fidelity require measurement, which is typically done using audiotaped sessions. The gold standard for such measurement of MI skill has been an audiotaped interview, scored by a rater with a detailed structured instrument such as the Motivational Interviewing Treatment Integrity 2.0 (MITI 2.0) Coding System (Moyers, et al., 2005). The Helpful Responses Questionnaire (HRQ) (Miller, Hedrick, & Orlofsky, 1991) is a pen-and-paper test of empathy (a foundational MI skill) that does not require an audiotaped session. A randomized trial of three different regimens for training counselors in MI (live supervision using Teleconferencing, Tape-based supervision and Workshop only) (Smith et al., 2012) offered the opportunity to evaluate the performance of the HRQ as a measure of MI ability, compared to the several MITI 2.0 global scores and subscales. Participants were counselors (N = 97) working at community-based substance use treatment programs, whose MI proficiency was measured at four time points: baseline (before an initial 2-day MI workshop), post-workshop, 8 weeks post-workshop (i.e., post-supervision), and 20 weeks post-workshop with both MITI 2.0 and HRQ. HRQ total scores correlated significantly with the Reflection to Question Ratio from the MITI 2.0 at post-workshop (r = 0.33), week 8 (r = 0.34), and week 20 (r = 0.38), and with the Spirit (r = 0.32) and Empathy (r = 0.32) global scores at week 20. Correlations of HRQ with other MITI 2.0 subscales and time points after workshop were small and not significant. As predicted, HRQ scores differed between training conditions (X2(2) = 7.88, p = 0.02), with counselors assigned to live supervision achieving better HRQ scores than those in Workshop only. In summary, HRQ is a modestly accurate measure, mainly of the Reflection to Question Ratio, considered a core marker of MI skill. It is sensitive to training effects and may help identify counselors needing more intensive supervision. Given its ease of administration and scoring, HRQ may be a useful marker of MI skill during training efforts.",
author = "Smith, {J. L.} and P. Bertone and Carpenter, {K. M.} and Wain, {R. M.} and Hu, {M. C.} and Paul Amrhein and Nunes, {E. V.}",
year = "2018",
month = "4",
day = "1",
doi = "10.1016/j.jsat.2017.12.004",
language = "English",
volume = "87",
pages = "56--63",
journal = "Journal of Substance Abuse Treatment",
issn = "0740-5472",
publisher = "Elsevier Inc.",

}

Assessment of the relationship between a written measure of empathy and an independently rated interview of Motivational Interviewing. / Smith, J. L.; Bertone, P.; Carpenter, K. M.; Wain, R. M.; Hu, M. C.; Amrhein, Paul; Nunes, E. V.

In: Journal of Substance Abuse Treatment, Vol. 87, 01.04.2018, p. 56-63.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Assessment of the relationship between a written measure of empathy and an independently rated interview of Motivational Interviewing

AU - Smith, J. L.

AU - Bertone, P.

AU - Carpenter, K. M.

AU - Wain, R. M.

AU - Hu, M. C.

AU - Amrhein, Paul

AU - Nunes, E. V.

PY - 2018/4/1

Y1 - 2018/4/1

N2 - Motivational Interviewing (MI) is an evidence-based practice shown to be effective when working with people in treatment for substance use disorders. However, MI is a complex treatment modality optimized by training with feedback. Feedback, assessment and monitoring of treatment fidelity require measurement, which is typically done using audiotaped sessions. The gold standard for such measurement of MI skill has been an audiotaped interview, scored by a rater with a detailed structured instrument such as the Motivational Interviewing Treatment Integrity 2.0 (MITI 2.0) Coding System (Moyers, et al., 2005). The Helpful Responses Questionnaire (HRQ) (Miller, Hedrick, & Orlofsky, 1991) is a pen-and-paper test of empathy (a foundational MI skill) that does not require an audiotaped session. A randomized trial of three different regimens for training counselors in MI (live supervision using Teleconferencing, Tape-based supervision and Workshop only) (Smith et al., 2012) offered the opportunity to evaluate the performance of the HRQ as a measure of MI ability, compared to the several MITI 2.0 global scores and subscales. Participants were counselors (N = 97) working at community-based substance use treatment programs, whose MI proficiency was measured at four time points: baseline (before an initial 2-day MI workshop), post-workshop, 8 weeks post-workshop (i.e., post-supervision), and 20 weeks post-workshop with both MITI 2.0 and HRQ. HRQ total scores correlated significantly with the Reflection to Question Ratio from the MITI 2.0 at post-workshop (r = 0.33), week 8 (r = 0.34), and week 20 (r = 0.38), and with the Spirit (r = 0.32) and Empathy (r = 0.32) global scores at week 20. Correlations of HRQ with other MITI 2.0 subscales and time points after workshop were small and not significant. As predicted, HRQ scores differed between training conditions (X2(2) = 7.88, p = 0.02), with counselors assigned to live supervision achieving better HRQ scores than those in Workshop only. In summary, HRQ is a modestly accurate measure, mainly of the Reflection to Question Ratio, considered a core marker of MI skill. It is sensitive to training effects and may help identify counselors needing more intensive supervision. Given its ease of administration and scoring, HRQ may be a useful marker of MI skill during training efforts.

AB - Motivational Interviewing (MI) is an evidence-based practice shown to be effective when working with people in treatment for substance use disorders. However, MI is a complex treatment modality optimized by training with feedback. Feedback, assessment and monitoring of treatment fidelity require measurement, which is typically done using audiotaped sessions. The gold standard for such measurement of MI skill has been an audiotaped interview, scored by a rater with a detailed structured instrument such as the Motivational Interviewing Treatment Integrity 2.0 (MITI 2.0) Coding System (Moyers, et al., 2005). The Helpful Responses Questionnaire (HRQ) (Miller, Hedrick, & Orlofsky, 1991) is a pen-and-paper test of empathy (a foundational MI skill) that does not require an audiotaped session. A randomized trial of three different regimens for training counselors in MI (live supervision using Teleconferencing, Tape-based supervision and Workshop only) (Smith et al., 2012) offered the opportunity to evaluate the performance of the HRQ as a measure of MI ability, compared to the several MITI 2.0 global scores and subscales. Participants were counselors (N = 97) working at community-based substance use treatment programs, whose MI proficiency was measured at four time points: baseline (before an initial 2-day MI workshop), post-workshop, 8 weeks post-workshop (i.e., post-supervision), and 20 weeks post-workshop with both MITI 2.0 and HRQ. HRQ total scores correlated significantly with the Reflection to Question Ratio from the MITI 2.0 at post-workshop (r = 0.33), week 8 (r = 0.34), and week 20 (r = 0.38), and with the Spirit (r = 0.32) and Empathy (r = 0.32) global scores at week 20. Correlations of HRQ with other MITI 2.0 subscales and time points after workshop were small and not significant. As predicted, HRQ scores differed between training conditions (X2(2) = 7.88, p = 0.02), with counselors assigned to live supervision achieving better HRQ scores than those in Workshop only. In summary, HRQ is a modestly accurate measure, mainly of the Reflection to Question Ratio, considered a core marker of MI skill. It is sensitive to training effects and may help identify counselors needing more intensive supervision. Given its ease of administration and scoring, HRQ may be a useful marker of MI skill during training efforts.

UR - http://www.scopus.com/inward/record.url?scp=85041636746&partnerID=8YFLogxK

U2 - 10.1016/j.jsat.2017.12.004

DO - 10.1016/j.jsat.2017.12.004

M3 - Article

VL - 87

SP - 56

EP - 63

JO - Journal of Substance Abuse Treatment

JF - Journal of Substance Abuse Treatment

SN - 0740-5472

ER -