"Are we doing what we said we would do?"
In your logic model, assumptions are made about the impact of certain activities and practices. Before you can evaluate student and teacher outcomes, you must assess the activities themselves: Which elements of the program are being implemented? To what extent? Are participants being reached as intended? Are there any unintended consequences?
Resources
VIGNETTE
Evaluation Lessons From One Cancelled Program (.pdf 115.3 KB)
Use this case to understand the need for both implementation and outcome evaluations.
TOOL
Questions, Methods, and Indicators for Implementation Evaluation (.doc 75 KB)
Identify methods and indicators that are most closely aligned with your implementation questions and goals.
SAMPLE MATERIAL
Planning That Connects Objectives, Activities, and Evaluation (.pdf 194.8 KB)
Review two approaches for coordinating implementation and evaluation planning.
TOOL
Differentiating Outputs From Outcomes (.doc 70.5 KB)
Distinguish the activities you implement from the direct and measurable products you intend as results.
SAMPLE MATERIAL
25 Essential Components for Magnet Program Implementation (.pdf 133.6 KB)
Review these indicators to help you determine what’s necessary for successful implementation of a magnet program in your district.
Extra Resources for MSAP Rigorous Evaluation
-
Remember to document implementation activities not just for magnet schools, but for control and comparison schools to ensure they aren’t engaging in similar program activities or treatment. It is important to budget time and resources to conduct this critical step in a rigorous evaluation.
-
Make sure your MSAP regular and rigorous evaluators communicate with each other so they do not duplicate or contradict each other’s documentation efforts.
