IMPACT Model: Measurement

Do you know how your training programmes stack up?

We do... TwentyEighty Strategy Execution’s online evaluation approach: A practical, tactical way to prove training effectiveness, job impact, business results and return on investment.

HOW DO YOU TELL A STORY OF EFFECTIVENESS AFTER A TRAINING EVENT?


STEP 1

Post Event Evaluation

After each class students are emailed an online survey Smart Sheet Approach. The survey contains approximately 20 questions and takes roughly seven minutes to complete. The following question categories are covered in the survey:

  • Quality of the training
  • Learning effectiveness
  • Job impact
  • Post training support
  • Business results impacted
  • Job performance change and training's contribution to job performance change
  • Value of the training / return on investment

STEP 2

On the Job


Students return to work and apply knowledge and skills on the job.

STEP 3

Follow up Evaluation


Sixty days after the class, a second survey is sent to the same students in order to validate their initial responses, which tend to be optimistic immediately after training, and to collect additional information such as time-to-job-impact and barriers-to-use.

STEP 4

Results


Results are analysed across four levels of learning measurement, which support the story of return on investment, including: quality, effectiveness, job impact, and business results. Quantifying these measures is an important prerequisite to the ROI calculation, not because they are required for the math, (only training’s contribution to performance improvement is needed) but because they provide quantitative proof supporting the final conclusion. Training effectiveness supports job impact, which supports business results, which leads to a positive return on investment.

STEP 5

Calculating ROI for Training Investments with TwentyEighty Strategy Execution


The single most important measure in determining the ROI for a training programme is the training’s contribution to performance improvement reported by the student as a percentage. We capture this both immediately post event and 60 days later in the follow up survey. Using this percentage, an estimate of the student’s salary and the tuition cost, we can get an extremely conservative view of the financial benefit from training. You may ask what salary has to do with the financial return of performance improvement. Look at it this way. Your company gets more value from a person than they pay them – that’s how they earn a profit. So we can conclude that if an individual’s productivity increases by, say 6%, then the company would benefit more than six percent of the individual’s salary.

"Smart Sheet" Approach


TwentyEighty Strategy Execution uses the Smart Sheet online evaluations to replace Level 1 evaluations. These Smart Sheets go beyond the traditional “smile sheet” to gather predictive data about higher-level results. It goes beyond basic questions about whether the learner liked the class, and asks them to project into the future and describe whether they expect to apply what they learned, and if so, what business impact it might bring. This data will help tell the story of programme effectiveness based on how learners predict they will apply learning back on the job, and what business results they think they will deliver to the organisation. Plus, we are able to provide in-depth analytics, intuitive reports and benchmarking to capture both behavioural change and business results. So you can track your organisation’s progress through learning and be confident you’re getting the most out of your budget.