Fidelity at a distance

Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial

Chih-Yuan Lee, Gerald J. August, George M. Realmuto, Jason L. Horowitz, Michael L. Bloomquist, Bonnie Klimes-Dougan

Research output: Contribution to journalArticleResearchpeer-review

34 Citations (Scopus)

Abstract

The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100% compliance in completion of their required on-line reporting and on average over 80% of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.

Original languageEnglish
Pages (from-to)215-229
Number of pages15
JournalPrevention Science
Volume9
Issue number3
DOIs
StatePublished - 1 Sep 2008

Fingerprint

Technology
Interviews
Telecommunications
Feasibility Studies
Documentation
Compliance

Keywords

  • Adherence
  • Exposure
  • Implementation fidelity
  • Prevention
  • Quality of delivery

Cite this

Lee, Chih-Yuan ; August, Gerald J. ; Realmuto, George M. ; Horowitz, Jason L. ; Bloomquist, Michael L. ; Klimes-Dougan, Bonnie. / Fidelity at a distance : Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial. In: Prevention Science. 2008 ; Vol. 9, No. 3. pp. 215-229.
@article{1539b649423a4ffebd630bfa029c84af,
title = "Fidelity at a distance: Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial",
abstract = "The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100{\%} compliance in completion of their required on-line reporting and on average over 80{\%} of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.",
keywords = "Adherence, Exposure, Implementation fidelity, Prevention, Quality of delivery",
author = "Chih-Yuan Lee and August, {Gerald J.} and Realmuto, {George M.} and Horowitz, {Jason L.} and Bloomquist, {Michael L.} and Bonnie Klimes-Dougan",
year = "2008",
month = "9",
day = "1",
doi = "10.1007/s11121-008-0097-6",
language = "English",
volume = "9",
pages = "215--229",
journal = "Prevention Science",
issn = "1389-4986",
publisher = "Springer New York",
number = "3",

}

Fidelity at a distance : Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial. / Lee, Chih-Yuan; August, Gerald J.; Realmuto, George M.; Horowitz, Jason L.; Bloomquist, Michael L.; Klimes-Dougan, Bonnie.

In: Prevention Science, Vol. 9, No. 3, 01.09.2008, p. 215-229.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Fidelity at a distance

T2 - Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial

AU - Lee, Chih-Yuan

AU - August, Gerald J.

AU - Realmuto, George M.

AU - Horowitz, Jason L.

AU - Bloomquist, Michael L.

AU - Klimes-Dougan, Bonnie

PY - 2008/9/1

Y1 - 2008/9/1

N2 - The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100% compliance in completion of their required on-line reporting and on average over 80% of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.

AB - The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100% compliance in completion of their required on-line reporting and on average over 80% of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.

KW - Adherence

KW - Exposure

KW - Implementation fidelity

KW - Prevention

KW - Quality of delivery

UR - http://www.scopus.com/inward/record.url?scp=51749122662&partnerID=8YFLogxK

U2 - 10.1007/s11121-008-0097-6

DO - 10.1007/s11121-008-0097-6

M3 - Article

VL - 9

SP - 215

EP - 229

JO - Prevention Science

JF - Prevention Science

SN - 1389-4986

IS - 3

ER -