A Model for Program
Evaluation
© 2008 by Barry Sweeny
The following table presents the program evaluation
model which I use to guide my work. The original ideas for this
model are loosely derived from the research and work of Tom Gusky
and Donald Kirkpatrick. (See below for citations.) The model has
been developed over about 20 years through work in curriculum, staff
development, with grants, and many other kinds of programs. It has
been refined and adapted to the point where I feel it represents
a "best practice" model. If that were not the case, I
would have personally refined it beyond this current state.
| Steps
in the Process: |
Check
When Done |
Planning
Details |
| 1. Set the Goals for
the evaluation |
|
|
| 2. Identify the Audiences
for the data |
|
|
| 3. Define the Indicators
of success for each audience |
|
|
| 4. Check the Relevance
of each indicator to program goals |
|
|
| 5. Determine the Scope
of the evaluation process |
|
|
6. Organize the
indicators by Data Type:
- Reactions (survey attitudes)
- Learning (self-assessment/test)
- Behavior (observe extent of use)
- Needs Assessment (obstacles to use? needs?)
- Results (effectiveness, gains)
|
|
|
| 7. State the evaluation Questions |
|
|
8. Refine the evaluation
questions for:
- Measurability
- Feasibility
- Clarity
- Validity & Fairness
- Consensus
|
|
|
9. Select How to Collect
the data:
- Method
- Design/Select Instrument
- Need to Validate instrument?
|
|
|
10. List the evaluation
Action Plan:
- List the Activities
- Set the Time Line
- Decide the Persons Responsible
|
|
|
| 11. Estimate the Cost
of the evaluation |
|
|
| 12. Gain Approval
for use of the Evaluation Plan |
|
|
| 13. Collect
the Data |
|
|
| 14. Analyze and Interpret
the data |
|
|
| 15. Report the conclusions
& offer recommendations |
|
|
References:
Gusky, T. (1998). "The Age of Our Accountability".
Journal of Staff Development. Fall, 36-44. National Staff
Development Council. This is not the original source I used, but
it is a good and more recent one.
Kirkpatrick, D. (1975). "Evaluating Training
Programs". Madison, WI. American Society for Training and
Development.
Kirkpatrick, D. (1977). "Evaluating Training
Programs: Evidence Vs Proof". Training and Development Journal.
31, (11), 9-12.
|
