Relationships Between Quantitative Measures of Evaluation Plan and Program Model Quality and a Qualitative Measure of Participant Perceptions of an Evaluation Capacity Building Approach

Jennifer Brown Urban, Marissa Burgermaster, Thomas Archibald, Alyssa Byrne

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Despite a heightened emphasis on building evaluation capacity and evaluation quality, there is a lack of tools available to identify high-quality evaluation. In the context of testing the Systems Evaluation Protocol (SEP), quantitative rubrics were designed and tested to assess the quality of evaluation plans and models. Interview data were also collected and analyzed using a priori codes. A mixed methods approach was used to synthesize quantitative and qualitative data and explore trends. Consistencies between data types were found for attitude and capacity, and disconnects were found for knowledge, cyberinfrastructure, time, and quality. This approach to data integration represents a novel way to tap the generative potential of divergence that arises when different methods produce contradictory results.

Original languageEnglish
Pages (from-to)154-177
Number of pages24
JournalJournal of Mixed Methods Research
Volume9
Issue number2
DOIs
StatePublished - 15 Apr 2015

Keywords

  • evaluation capacity building
  • evaluation plan quality
  • logic model quality
  • mixed methods
  • systems evaluation

Fingerprint Dive into the research topics of 'Relationships Between Quantitative Measures of Evaluation Plan and Program Model Quality and a Qualitative Measure of Participant Perceptions of an Evaluation Capacity Building Approach'. Together they form a unique fingerprint.

Cite this