In selecting instruments to document implementation, you must balance your need for useful and trustworthy data with the need to minimize data collection burden on the evaluation team and program participants. Make sure your instruments match your budget, time frame, and staff capacity, but also focus your efforts on what will be most useful to your evaluation.
Resources
TOOL
Selecting Data Collection Methods (.doc 95 KB)
Identify the most appropriate and practical instruments for your evaluation given your context (needs, budget, etc.).
TOOL
Taking Inventory of Existing Data (.doc 119 KB)
Identify what data are currently available, what formats they are in, and any data gaps that need to be filled.
SAMPLE MATERIAL
Magnet Program Implementation Interview Protocol (.pdf 184.7 KB)
Review this sample interview protocol to see how an evaluator tailored questions to gather implementation information about a school site.
SAMPLE MATERIAL
Magnet Program Documentation and Logs (.pdf 177.3 KB)
Check out these materials used by school staff to document key magnet program activities for an evaluation.
SAMPLE MATERIAL
Professional Development Questions From State Teacher Working Conditions Survey (.pdf 155.9 KB)
See how an existing survey can be used to reduce data collection burden while providing valid, reliable, and relevant data for an evaluation.
Extra Resources for MSAP Rigorous Evaluation
-
Choose instruments that help you measure implementation of program elements in comparison sites.
-
Watch for new programs that may change conditions in comparison schools. Know ahead of time what changes.
