A Model for Program Evaluation

© By Barry Sweeny, 1998

The following table presents the basic program evaluation model which I use to guide my work. Of course, in practice, the steps are more complex than is clear here. Never-the-less, I share this with you to aid you in evaluating your own mentoring programs.

The original ideas for this model are loosely derived from the research and work of both Tom Gusky and Donald Kirkpatrick. See below for citations. The model has been developed over about 20 years of work in curriculum, staff development, with grants, and many other kinds of programs. It has been refined and adapted to the point where I feel it represents a "best practice" model.

 Steps in the Process:

Check When Done

Planning Details

1. Set the Goals - purpose for the evaluation    
2. Identify the Audiences for the data    
3. Define the Indicators of success for each audience    
4. Check the Relevance of each indicator to program goals    
5. Determine the Scope of the evaluation process    

6. Organize the indicators by Data Type:

  • Reactions (survey attitudes)
  • Learning (self-assessment/test)
  • Behavior (observe extent of use)
  • Needs Assessment (obstacles to use? needs?)
  • Results (effectiveness, gains)
   
7. State the evaluation Questions    

8. Refine the evaluation questions for:

  • Measurability
  • Feasibility
  • Clarity
  • Validity & Fairness
  • Consensus
   

9. Select How to Collect the data:

  • Method
  • Design/Select Instrument
  • Need to Validate instrument?
   

10. List the evaluation Action Plan:

  • List the Activities
  • Set the Time Line
  • Decide the Persons Responsible
   
11. Estimate the Cost of the evaluation    
12. Gain Approval of Evaluation Plan    
13. Collect the Data    
14. Analyze and Interpret the data    
15. Report the conclusions & offer recommendations    

Gusky, T. (1998). "The Age of Our Accountability". Journal of Staff Development. Fall, 36-44. National Staff Development Council. This is not the original source I used, but it is a good and more recent one.

Kirkpatrick, D. (1975). "Evaluating Training Programs". Madison, WI. American Society for Training and Development.

Kirkpatrick, D. (1977). "Evaluating Training Programs: Evidence Vs Proof". Training and Development Journal. 31, (11), 9-12.


Return to TOP

© 2003 by the International Mentoring Association

All materials on this web site are copyright protected and all rights are reserved to the IMA.

http://www.mentoring-association.org

However, if you do so for free, you may duplicate and distribute this information or link to it, as long as the full page and all attributions and contact information are preserved as they appear on this page. You may not sell this information in any form.