Evolutionary Evaluation

Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate

Jennifer Urban, Monica Hargraves, William M. Trochim

Research output: Contribution to journalArticleResearchpeer-review

21 Citations (Scopus)

Abstract

Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.

Original languageEnglish
Pages (from-to)127-139
Number of pages13
JournalEvaluation and Program Planning
Volume45
DOIs
StatePublished - 1 Jan 2014

Fingerprint

Research Personnel
Program Evaluation
evaluation
evidence
Systems Theory
Program Development
Evolutionary
Evidence-based
Evaluator
Mandate
Evaluation
mandate
programme
Randomized Controlled Trials
evolutionary theory
system theory
epistemology
interpretation
management

Keywords

  • Developmental systems theory
  • Evaluation design
  • Evidence-based program (EBP)
  • Evolutionary Evaluation
  • Evolutionary epistemology
  • Evolutionary theory
  • Experimental design
  • Lifecycles
  • Program evolution
  • Randomized controlled trial (RCT)
  • Systems evaluation
  • Validity

Cite this

@article{9fe085c81b8e440a8277c3869d673ffb,
title = "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate",
abstract = "Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of {"}evidence-based programs{"}. From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.",
keywords = "Developmental systems theory, Evaluation design, Evidence-based program (EBP), Evolutionary Evaluation, Evolutionary epistemology, Evolutionary theory, Experimental design, Lifecycles, Program evolution, Randomized controlled trial (RCT), Systems evaluation, Validity",
author = "Jennifer Urban and Monica Hargraves and Trochim, {William M.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1016/j.evalprogplan.2014.03.011",
language = "English",
volume = "45",
pages = "127--139",
journal = "Evaluation and Program Planning",
issn = "0149-7189",
publisher = "Elsevier Ltd",

}

Evolutionary Evaluation : Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate. / Urban, Jennifer; Hargraves, Monica; Trochim, William M.

In: Evaluation and Program Planning, Vol. 45, 01.01.2014, p. 127-139.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Evolutionary Evaluation

T2 - Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate

AU - Urban, Jennifer

AU - Hargraves, Monica

AU - Trochim, William M.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.

AB - Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.

KW - Developmental systems theory

KW - Evaluation design

KW - Evidence-based program (EBP)

KW - Evolutionary Evaluation

KW - Evolutionary epistemology

KW - Evolutionary theory

KW - Experimental design

KW - Lifecycles

KW - Program evolution

KW - Randomized controlled trial (RCT)

KW - Systems evaluation

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=84899847165&partnerID=8YFLogxK

U2 - 10.1016/j.evalprogplan.2014.03.011

DO - 10.1016/j.evalprogplan.2014.03.011

M3 - Article

VL - 45

SP - 127

EP - 139

JO - Evaluation and Program Planning

JF - Evaluation and Program Planning

SN - 0149-7189

ER -