ROI Skill-Building Certificate

Program Overview

In this certificate program developed by Jack Phillips, participants will build the skills needed to develop and deliver effective return-on-investment (ROI) evaluations for learning and performance, organizational development, human resources, technology, change, and quality solutions. The program emphasizes the Phillips ROI Methodology and participants learn to apply the ROI Process Model—a results-based method for developing application impact objectives, developing data collection plans, collecting various types of hard and soft data, isolating the effects of the program, converting data to monetary values, tabulating appropriate program costs, calculating return-on-investment, and identifying intangible benefits. Participants are asked to bring a real-time project to maximize transfer of learning by enabling them to build their skills with an example relevant to their professional responsibilities.

By the end of the program, participants are able to:

• Identify the drivers for ROI accountability
• Apply ROI techniques to learning and performance solutions
• Link training program objectives to business results
• Develop an evaluation plan for one of their own programs.

ASTD Certificate Programs are learning events and a certificate is awarded to participants upon successful completion of the program. No test is given and participants are not certified. Certification is a testing event that confirms that skills, knowledge, or competencies have been acquired. Please click here for more information on the ASTD Certification Institute's credential, the Certified Professional in Learning and Performance™ (CPLP™).

Learning Objectives

Upon completion, participants will be able to:

• Update internal processes on evaluation
• Develop application and impact objectives
• Develop data collection plans and select appropriate data collection methods
• Use appropriate methods to isolate the effects of programs
• Use appropriate methods to convert data to monetary values
• Tabulate appropriate program costs
• Calculate the ROI
• Identify intangible benefits.

Topics

• Topic 1 - Introduction and Readiness to Learn

  Topic 1 - Introduction and Readiness to Learn

  • Workshop Ground Rules 
  • Workshop Objectives 
  • Reliance Insurance Company 
  • What Are the Key Factors in Your Work Setting That Are Driving Accountability? 
  • Definition of Results-Based Training 
  • Defining Benefit Cost Ratio and the Return-on-Investment 

  
  
• Topic 2 - Overview of the ROI Model and Process

  Topic 2 - Overview of the ROI Model and Process

  • What is Your Criteria for an Effective ROI Process? 
  • Pieces of the Results-Based Puzzle 
  • Levels of Evaluation for Performance Solutions 
  • The ROI Process Model 
  • The ROI Methodology 
  • The Chain of Impact Tells the Complete Story 
  • All Programs Are Not Evaluated at All Levels 
  • Matching Evaluation Levels with Objectives 
  • Measurement in Learning and Performance 
  • Criteria for Selecting Programs for Level 4 and Level 5 Evaluations 
  • Characteristics of Evaluation Levels
• Topic 3 - Evaluation Planning

  Topic 3 - Evaluation Planning

  • Evaluation Planning Overview 
  • Evaluation Planning Worksheet 
  • The Four Major Categories of Hard Data 
  • Examples of Hard Data 
  • Major Categories of Soft Data 
  • Examples of Soft Data 
  • Developing Objectives of the Solution 
    • Results-Based Process 
    • The Alignment Process
    • PCA, Inc. 
    • API 
    • Matching Evaluation Levels with Objectives 
    • Develop Reaction and Satisfaction Objectives 
    • Developing Learning Objectives 
    • Developing Application Objectives 
    • Developing Impact Objectives 
  • Developing Evaluation Plans and Baseline Data 
    • Collecting Baseline Data 
    • Develop Evaluation Strategy and Plans 
    • Factors to Consider when Developing an Evaluation Strategy 
    • Data Collection Plan Sample 
    • ROI Analysis Plan Sample 
    • Data Collection Plan 
    • ROI Analysis Plan 

  
  
• Topic 4 - Data Collection

  Topic 4 - Data Collection

  • Data Collection Overview 
  • Collect Data during Solution Implementation 
    • Level 1 Target Areas 
    • Improving Level 1 Evaluation 
    • Important Questions to Ask on Feedback Questionnaires 
    • Techniques for Measuring Learning 
    • Most Common Uses of Level 2 Data 
    • Improving Level 2 Evaluation 
  • Collect Data after Solution Implementation 
  • Applications of Data Collection Instruments Matching Exercise 
  • Methods of Collecting Follow-Up Data 
  • Impact Questions for Any Type of Follow-Up Evaluation 
  • Follow-Up Questionnaire Content Issues Checklist 
  • Questionnaire Items—Example 
  • Leadership Development Program Impact Questionnaire 
  • Improving the Response Rate for Questionnaires
  • Developing ROI with Action Planning 
  • Action Plan 
  • Exercise: Leadership 101
• Topic 5 - Data Analysis

  Topic 5 - Data Analysis

  • Data Analysis Overview 
  • Isolating the Effects of the Solution 
    • Case Application: First Bank 
    • Methods for Isolating the Effects of the Program 
    • Several Factors Contribute to an Improvement after a Program or Initiative Is Implemented 
    • Use of Control Groups Example—Customer Service Training 
    • Case Application: Micro Electronics, Inc.—Trend Line Analysis 
    • Case Application: National Bank—Use of Estimates 
    • The Wisdom of Crowds 
    • Isolating the Effects 
    • Credibility of Data Exercise 
    • Credibility of Outcome Data 
  • Converting Data to Monetary Values 
    • Converting Data to Money Matching Exercise 
    • Calculating the Value of an Improvement: Job Aid 
    • Converting Data Using External Database 
    • Package Delivery Company 
    • Methods of Converting Data to Monetary Values 
    • Converting Data Exercise 
    • To Convert or Not To Convert 
  • Capturing the Costs of the Solution 
    • Recommended Categories for Costs 
    • Capturing Program Casts—Recommended Items 
    • Overview of Tabulating Costs 
    • Prorated vs. Direct Costs 
    • Cost Tabulation Guidelines 
    • Calculating the Return-on-Investment
    • Twelve Guiding Principles 
    • A Rational Approach to ROI 
  • Identifying Intangible Benefits 
    • Common Intangible Variables Linked With Training and Performance Improvement Initiatives 
    • Why Intangibles Are Important 
    • Sources for Intangible Benefits 
    • Intangibles You Have Experienced
• Topic 6 - Reporting

  Topic 6 - Reporting

  • Reporting Overview 
  • Case Application: Utility Services Company 
  • Common Target Audiences 
  • Impact Study Outline 
  • Scorecard: Seven Categories of Data
• Topic 7 - Implementation Issues

  Topic 7 - Implementation Issues

  • Implementation Issues Overview 1 
  • Management Influence 
  • ROI Dilemmas 
  • Implementation Concerns 
  • Cost-Saving Approaches to ROI 
  • What Next?
  • Key Implementation Actions 
  • Setting Evaluation Targets
• Appendix

  Appendix

  • Appendix A—Tools and References 
  • Appendix B—Training and Development Assessment 
  • Appendix C—Application Exercises 
  • Appendix D-The ROI Institute, Inc. 
  • Appendix E-ROI Fact Sheet

Who Should Attend

Credits & Attendance