Online Training Design:
PSO Program Evaluation
Audience
Professionals affiliated with Public Service and Outreach (PSO) , who need to evaluate the effectiveness of their organization’s projects (program coordinators, business managers, research professionals, and more).
Responsibilities
Online Training Development, Video Editing, Visual & Document Design, LMS management, Prototyping
Tools Used
D2L Brightspace (LMS platform), Final Cut Pro, Canva, PowerPoint, Microsoft Word
Problem
There has been increasing need for professionals in PSO units to learn about program evaluation so they can not only learn how to evaluate their services but also have a shared understanding of evaluation and communicate using shared terminologies. To improve their programs and projects, professionals need to acquire knowledge and skills regarding data collection, data visualization, evaluating their programs, and effectively communicating evaluation results. This PSO evaluation workshop was designed to address these needs.
The workshop was initially offered in a face-to-face format. Beginning in August 2022, the PSO team wanted to replace their workshop series with an online training program. As an instructional designer, my role was to transition an original in-person workshop into an asynchronous online training program.
Solutions
- In collaboration with the SMEs in the Survey Research and Evaluation (SRE) unit of the Carl Vinson Institute of Government (CVIOG), I designed and created a self-paced, 15-module online workshop.
- The workshop included 41 lecture videos, a workbook, quizzes (105 questions in total), and hands-on project activities for participants to practice program evaluation using their organization’s projects and/or services.
Purpose
The primary objective of this workshop is to train PSO unit members in the fundamentals of program evaluation so that they can assess the implementation, outcomes, and efficacy of programs.
This plan also aimed to reduce the workload on trainers while maintaining consistent training quality.
Objectives
By the end of the online workshop, participants will be able to:
- Explain the major concepts of program evaluation.
- Develop foundational knowledge of the methodologies used in program evaluation.
- Understand and identify the skills required to conduct program evaluation.
- Transform program evaluation data into usable and easily understood graphics and employ effective reporting strategies.
- Develop an evaluation plan that assesses the effectiveness of their program or project.
Branding and Style Guide
Online Quiz Development
The quiz (105 questions in total) was created in collaboration with the four SMEs in the Survey Research and Evaluation unit of the Carl Vinson Institute of Government.
Checklist
This is the checklist I created to communicate the progress with the team. It includes to-do lists for creating quizzes in the D2L Brightspace LMS system.