TY - JOUR
T1 - Evolutionary Evaluation
T2 - Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate
AU - Urban, Jennifer Brown
AU - Hargraves, Monica
AU - Trochim, William M.
PY - 2014/8
Y1 - 2014/8
N2 - Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.
AB - Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.
KW - Developmental systems theory
KW - Evaluation design
KW - Evidence-based program (EBP)
KW - Evolutionary Evaluation
KW - Evolutionary epistemology
KW - Evolutionary theory
KW - Experimental design
KW - Lifecycles
KW - Program evolution
KW - Randomized controlled trial (RCT)
KW - Systems evaluation
KW - Validity
UR - http://www.scopus.com/inward/record.url?scp=84899847165&partnerID=8YFLogxK
U2 - 10.1016/j.evalprogplan.2014.03.011
DO - 10.1016/j.evalprogplan.2014.03.011
M3 - Article
C2 - 24780281
AN - SCOPUS:84899847165
SN - 0149-7189
VL - 45
SP - 127
EP - 139
JO - Evaluation and Program Planning
JF - Evaluation and Program Planning
ER -