In this episode of Key Connections for Educators, Nate and Hannah dive into the complexities of measuring behavior change as part of Kirkpatrick's four levels of training evaluation. They discuss the challenges of obtaining feedback on trainees' application of learned skills in the workplace, exploring timing issues, real-world barriers, and inherent biases. The conversation is enriched with practical strategies like scheduling follow-up calls, utilizing rubrics, and fostering group dialogues for a comprehensive assessment. The episode encourages educators to share their methods for reducing bias in behavior evaluations and provides actionable insights for both corporate trainers and K-12 educators.

00:00 Introduction to Measuring Educational Impact

00:16 Review of Kirkpatrick's Four Levels

01:29 Three Challenges in Measuring Behavior Change

04:01 Increasing the Volume of Level Threes

08:08 Group Discussions and Peer Influence

09:54 Classroom vs Real World

12:27 Addressing Bias in Evaluations

18:17 Capstone Events and Real-World Applications

21:39 Conclusion and Audience Engagement

n this episode of Key Connections for Educators, we delve into the second level of the Kirkpatrick Evaluation Model. We discuss how confidence in one's abilities can serve as a marker for learning and why it might be more appropriate in a level two evaluation rather than level one. The hosts share personal experiences and practical examples of implementing evaluation methods that build student confidence while accurately measuring learning outcomes. The episode also covers the significance of pre-testing and differentiating content to avoid redundancy in training programs. Join the conversation and share your thoughts on utilizing confidence-based questions to assess your students' progress.

00:00 Introduction and Recap

00:19 Exploring Confidence in Evaluations

01:32 Diving into Level Two Evaluations

03:53 Pre-Testing and Efficient Training

07:14 Effective Testing Strategies

16:06 Real-World Application and Conclusion

In this episode of Key Connections for Educators, Nate and Hannah delve into the pivotal question of how to communicate the value of education and training to stakeholders. They explore the importance of engaging with and understanding the needs of these stakeholders to demonstrate that training programs provide a significant return on investment.

The discussion introduces Kirkpatrick's model of evaluation, focusing on the first level: reaction. The hosts emphasize the critical role of reaction feedback in measuring training effectiveness and the potential dangers of misinterpreting this data.

They share personal anecdotes and practical advice on leveraging qualitative and quantitative feedback to improve educational and training programs.

00:00 Welcome and Introduction

00:14 Communicating the Value of Education

01:17 Understanding Stakeholder Needs

02:03 Effective Training and Measurement

02:19 The Role of Quality in Training

03:43 Coaching and Training Analogies

05:05 Evaluating Training Effectiveness

05:31 Kirkpatrick's Model: Level One

06:49 Gathering and Using Feedback

14:08 Summary and Final Thoughts