ECI 502

Technology Program Evaluation

This course is about evaluation of instructional technology programs, which is the systematic process of collecting and analyzing data in order to determine whether and to what degree program goals have been or are being achieved.

Program evaluation results are fundamentally used for making decisions and determining to what degree objectives are being achieved1. In ECI 502, we learned how to think critically about program evaluation. We studied several topics, including:

The benefits of program evaluation.

Distinct evaluation methods and models.

Different types of data.

Data collection and analysis techniques.

The Evaluator’s Program Description (EPD).

Types of evaluation models.

Terminology behind program evaluation.

By applying the appropriate program evaluation cycle both to prescribed scenarios and a personal project of my own, I was better able to grasp the process of evaluation and its requirements.

In Technology Program Evaluation, we examined program effectiveness through various lenses including federally funded programs, school and community programs, and a retirement community’s gardening program. We examined efficiency, effectiveness, and impact as they related to short- and long-term goals and benefits. Working through various scenarios helped me better understand both the program evaluation cycle and the purpose of evaluations. As a result, I was able to write a full program evaluation based a real-life project of my own.

The Roseland Preschool

We dedicated some time to Roseland Preschool’s sleepy children dilemma. In order to propose a solution to the problem, we worked through several components of evaluation to familiarize ourselves with the process. We considered the stakeholders, types of measure, levels of data, data analysis, and more. Within this real-world context, we figured out how to view and analyze the data. This helped us propose a potential solution for Roseland’s exceptionally tired preschoolers.

Grandview Retirement Community

We worked extensively with the Grandview Retirement Community scenario. Given little information, we determined whether or not the gardening program was a worthwhile component of the community. We evaluated its goals, purpose, and potential longevity. After working to develop the gardening program from its inception, this is the final Evaluation Design that I created for the proposed gardening program at Grandview.

With reasoning and analysis, I was able to formulate thoughtful responses to topics I previously knew little about, like . . .

· What are the benefits and limitations of an evaluation?

· Will the evaluation be successful?

· How do you use evaluation results?

· What is the difference between monitoring and evaluation?

· How can results be used in making decisions?

· What is an EPD and how do you use it?

Rough Land Preparation Project

This particular project was personal to me. We are preparing to build a house, but the land we acquired needed some work first. In stages, I wrote an extensive program evaluation plan to manage this real-life project.

Comprehensive Report

Evaluation Design Format

Sample Contract

  1. Boulmetis, J., & Dutwin, P. (2011). The abcs of evaluation : Timeless techniques for program and project managers. Retrieved from