How-Tos

Adobe Acrobat Reader is required to view PDF files. To download a free copy, please visit the Adobe web site.

A Basic Guide to Program Evaluation
C. McNamara, Free Management Library
Developed by a nonprofit management consultant and hosted by the Management Assistance Program for Nonprofits in St. Paul, Minnesota. Explores some myths about program evaluation, provides an overview of data collection methods and gives broad guidelines for analyzing and reporting data. Site also links to other resources and sells a variety of management and evaluation tools.
http://www.mapnp.org/library/evaluatn/fnl_eval.htm

At Your Fingertips: Using Everyday Data to Improve Schools
K. Levesque, D. Bradby, K. Rossi, and P. Teitelbaum, MPR Associates, Inc., 1998
Developed to show administrators and teachers how to measure school performance using existing data sources. This detailed, intensive guide takes users through the process of establishing goals; identifying outcomes, practices and inputs; determining data sources and indicators; examining data; setting performance targets; and monitoring performance over time. Appendices include worksheets and other resources for learning how to collect and use data. Designed for K-12 community but adaptable to adult education and workforce development programs.
http://www.mprinc.com/products/browse_by_subject.aspx?pubID=109

Guide to Performance Management for Community Literacy Coalitions
National Institute for Literacy, 2008
Enables community literacy coalitions and their partners to develop a community literacy outcome measurement process to assess literacy across the community, as well as activities of direct-service providers. Contains outcome indicators and data collection sources for common literacy activities and sample survey questions. Describes how to analyze data and use the analysis for program improvement.
Download/view: PDF (KB) | HTML

How Are We Doing? An Inquiry Guide for Adult Education Programs
M. Bingman and O. Ebert, National Center for the Study of Adult Learning and Literacy (NCSALL), 2001
Offers guidance to adult education programs that want to evaluate the effectiveness of their program. Divided into six sessions that include step-by-step instructions and activities to help programs improve their goals, approach to performance accountability, and process for measuring outcomes. Staff and a program-designated facilitator should expect to spend approximately an hour and a half on each session over the course of six weeks.
http://www.ncsall.net/?id=902

Is it Working? Self Help Guide for Evaluating Vocational and Adult Education Programs
H. Fleischman, Development Associates, Inc. for the U.S. Department of Education, 1995
This guide is geared toward local program directors, program staff, and evaluators. Provides an overall evaluation framework that can be applied to adult and vocational education programs and recommends a process for evaluation.
http://www.ed.gov/pubs/SelfHelpGuide/

Measuring Program Outcomes: A Practical Approach
United Way of America Taskforce on Impact, 1996
A practical step-by-step guide for community service agencies that focuses on outcome measurement. The manual outlines six steps to measuring outcomes: getting ready, choosing outcomes, specifying indicators, preparing for data collection, developing an outcome measurement system, and analyzing and reporting finding. Each step is broken down into concrete tasks and often supplemented with worksheets. Other helpful items include sample outcome indicators, information on how to consider cultural issues in instrument development, a sample data collection log, and more. Available for purchase from
http://www.unitedwaystore.com/product/measuring_program_outcomes_
a_practical_approach/program_film

National Reporting System for Adult Education (NRS)
American Institutes of Research (AIR) for the U.S. Department of Education
Designed to assist administrators and instructors in using the National Reporting System (NRS) supported by the U.S. Department of Education's Division of Adult Education and Literacy, an outcome-based reporting system for state-administered, federally funded adult education programs. Includes background information, explanations of policies and procedures, and training materials. Examples of the materials included on the site:

• Measures and Methods for the National Reporting System for Adult Education
  , 2009 AIR's guidelines for developing an accountability system for federally funded adult education programs could be applied to any adult education program. Provides practical information on, and clear examples of, measures, data collection procedures, the flow of data between stakeholders, evaluation methodologies, software requirements, database structuring, and reports. Download/view: PDF (314kb)


• Guide for Improving NRS Data Quality: Procedures for Data Collection and Training L. Condelli, L. Castillo, M. Seburn, and J. Deveaux, August 2002 To assist state and local staff with their NRS data collection process, this guide describes why high-quality data are important, gives an overview of the NRS procedures, and identifies the collection measures that help ensure quality. It also offers professional development advice. Download/view: PDF (283kb)| HTML

Outcome Measurement in Nonprofit Organizations: Current Practices and Recommendations
E. Morley, E. Vinson, and H. Hatry, Independent Sector and the Urban Institute, 2001
Examines outcome measurement and reporting as it is practiced at 36 private, nonprofit service organizations. Written expressly for leaders and managers, the book discusses types of information collected, data collection procedures, outcome analysis, and reporting and using data. Executive summary available from
Download/view: PDF (456KB) | HTML

Results: The Key to Continuous School Improvement, 2nd Edition
M. Schmoker, Association for Supervision and Curriculum Development (ASCD), 1999
Provides conceptual foundation for outcomes-based assessment using examples from K-12 schools. Key components include establishing short- and long-term goals, utilizing performance data, implementing research-based practices, and improving teamwork and teacher leadership. Designed for K-12 community but adaptable to adult education programs. Available for purchase from:
http://shop.ascd.org/ProductDisplay.cfm?ProductID=199233

Taking Stock: A Practical Guide to Evaluating Your Own Program
S. Bond, S. Boyd, and K. Ropp, developed by Horizon Research, Inc. for the American Association for the Advancement of Science (AAAS), 1997
A broad overview of evaluation techniques for those beginning to think systemically about collecting information on program quality and impact. Thorough but user-friendly resource that covers all the steps of an evaluation from documenting program needs and context to tips on reporting data. Also includes evaluation examples from a fictional community-based organization and illustrates a final evaluation report, a program expansion proposal, and an annual report.
Download/view: PDF (242KB)