Image

Program Evaluation

What is program evaluation? Program evaluation is a way of assessing a program to better understand its implementation and measure outcomes and ultimately improve its operation or outcomes.

What are different types of program evaluation? There are many different types of or methods for program evaluation used in workforce programs:

  • Experimental evaluation, often called randomized controlled trial evaluation, experimental evaluation compares outcomes of “treatment” groups (those in the program or receiving services) and “control” groups (often those receiving whatever services would exist in the absence of the program) to analyze the effect of the program. This requires randomly selecting whether a person participates in the program or not. This type of evaluation is considered the gold standard, as one can fully attribute effects on participants to the program, but it can be resource-intensive to implement. 
  • Quasi-experimental evaluation uses statistical methods to assess the effects of programs, using methods to select a plausible comparison group not in the program (for example, synthetic comparison groups or propensity score matching). This type of evaluation may not be as resource-intensive as experimental design, but it is less rigorous than experimental evaluation. 
  • Outcomes evaluation describes the outcomes of program participants, without a control or comparison group. While not as rigorous as experimental or quasi-experimental evaluation, it can be useful for understanding how well participants did in the program, especially if it is a newer program. 
  • Implementation evaluation uses qualitative methods (including interviews, focus groups, and observational study) to understand the operation of a program. This is sometimes used to assess the fidelity of the program implementation to the intended program model.
  • Return on investment or cost-benefit analyses are ways of using the results of evaluation with cost information to compare the value of program outcomes relative to the cost of producing those outcomes.