Shifting Training Data from "Smile Sheets" to "Measures of Impact"

naomi620
May 20
7 min read

If we want to develop thriving nurse leaders, we need to redefine the current system of hospital development. We have to change how we measure the impact of what we teach.

The Rain in Canmore turns into snow - and I watch 20cm fall during the day with warm cups of coffee and time to reflect on the previous days before a dip in the Hot Tub at the end of the day.

I am writing this to you while watching thick, quiet snow fall onto a hotel patio in Canmore, Canada. The air out here is crisp, clear, and incredibly grounding. It’s the morning after an intense, three-day deep dive surrounded by an elite group of international executive coaches, corporate consultants, and learning and development experts.

As I sat there listening to the paths that led these professionals into the room, I couldn't help but smile. The roads people take to end up in the human development space are wide, winding, and beautifully rambling—mirroring exactly how so many of us find our way into healthcare leadership.

But as the days unfolded, my professional curiosity turned into a heavy realisation.

Spending 72 hours with these experienced architects of impact served as a stark, icy reminder: When it comes to human development, behavioural change, and strategic growth, healthcare is lagging behind other industries. From the capital invested to the time protected for growth, healthcare, too often, treats it like an after-thought.

If we want to develop thriving nurse leaders, we need to redefine the current system of hospital development and be bold in measuring the impact of what we teach.

Pop Psychology vs Bedside Reality

Let’s be honest about how most nurse unit managers, educators, and clinical coordinators learn to lead. For the vast majority, there is no structured pipeline. You are exceptional at the bedside, a vacancy opens up, and suddenly you are handed the keys to a multi-million dollar ward budget and a team of 30-60 60 complex humans. You are left to work it out for yourself.

When healthcare services do invest in formal leadership or educational programs, the content is too often saturated with corporate pop psychology, outdated management myths, and theories that crumble the second a clinical escalation hits at 14:00.

Our staff work in environments with volatile clinical loads, changing evidence, and exhausting structural processes. Yet, healthcare systems invest minimally in true, sustained leadership development. On the flip side of that coin, a culture has grown where frontline staff increasingly expect all professional development to be spoon-fed by the service entirely within rostered shift hours.

This mismatch creates a dangerous stagnation. We are trying to solve 2026-level retention and cultural crises using 1990s educational checklists.

Healthcare significantly underinvests in real, practical leadership development compared to the corporate sector, leaving clinicians to figure out management completely on their own.

Immediate post-course surveys measure momentary satisfaction, not clinical or behavioural transformation.

To build a high-performing healthcare team, learning must be treated as a continuous, post-shift practice that is measured months down the track—not a one-off classroom escape.

What we know from data

By partnering with Actionable, at Better Every Shift we know training is transitioning from a nice to have field to a data driven powerhouse moving from if we can prove impact to how we use it to drive service results.

The objective is to build a bridge between learning and the metrics that executive leaders actually care about.

"The goal is to inspire action. In the case of learning, the hill I’ll die on is that it’s also our responsibility to sustain action." — Chris Taylor

The data is clear: as cohort sizes increase, the "crowd effect" kills individual accountability and the commitment to change. There is a profound need for intimate connection in the modern workplace.

The surge in effectiveness for micro-cohorts is not just a trend; it is accelerating. When comparing "All Time" data to the "Most Recent 12 Months," the adoption rates for small groups have climbed significantly.

Adoption Rates by Cohort Size (Most Recent 12 Months):

2–10 Participants: 95.6% (Up from an all-time average of 78.8%)
11–20 Participants: 69.7%
21–50 Participants: 70.9%
Over 50 Participants: Historically as low as 26%–38%

By prioritizing smaller groups, organizations de-risk their investment, ensuring that nearly every participant moves from "attending" to "applying."

The pervasive "everyone is busy" excuse has led many services to default to 60-minute "lunch and learn" style sessions. However, our data reveals a critical "minimum viable duration" for behaviour change.

If your goal is simple content delivery, short sessions are fine. But if your goal is behavioural fluency, 60 minutes is insufficient. Increasing a session to 90 or 120 minutes increases behaviour change commitments by 18% or more.

60-Minute Session: 61.6% adoption
90-Minute Session: 72.6% adoption
120-Minute Session: 78.3% adoption

Behavioural change requires time for the brain to process, contextualize, and commit. Shortening sessions to save time often ends up wasting the entire hour by failing to trigger any lasting action.

A common failure in Education is the reliance on "Situational" commitments—waiting for a high-stakes event, like a difficult conversation, to try a new skill. This is a strategic error. Game day is a terrible time to practice a new play.

To combat the Ebbinghaus Forgetting Curve—the natural phenomenon where learned information rapidly escapes memory unless preserved through immediate action—participants must engage in "Foundational" behaviours. These are daily, low-stakes practices that build habit strength. Moving from situational to foundational commitments can increase engagement (check-in rates) from 3.2 to as high as 11.7 times per month.

To facilitate this, we utilize the New Habit Formula™:

"When [this happens]… Instead of [old behaviour]… I will [new behaviour]… Because [the reason it matters]…"

People development is the single greatest lever for achieving a service's strategic priorities and positive patient outcomes.

The Myth of the Happy Sheet

Every nurse leader in Australia has filled out a post-training questionnaire. You know the ones. At 16:30, after sitting in a windowless seminar room for eight hours drinking lukewarm instant coffee, you are handed a piece of paper:

Was the presenter engaging?

Was the room temperature comfortable?

Did you find the slides useful?

In the corporate L&D world, these are called "Happy Sheets" (or Kirkpatrick Level 1 evaluations, if you want to get academic).

The truth is Questionnaires at the end of a training session provide limited information for faciliators to improve sessions and zero evidence of impact or behaviour change. A high score on a post-course survey doesn't mean your ward culture is going to improve tomorrow. It just means the presenter was charismatic and the catering didn't cause gastroenteritis.

Real learning transfer cannot be captured the minute a class ends. True behaviour change lives, breathes, and must be measured in the gritty weeks and months following the event. Did the nurse leader actually change how they handle a difficult performance conversation fourteen days later? Are they auditing clinical metrics differently eight weeks down the track? That is where the real data hides.

Shifting the gauge from #Attendance to Impact

At Better Every Shift, we are drawing a non-negotiable line in the snow / red dust / golden sand. We refuse to offer training that just ticks a compliance box.

If we want to transform how our teams operate, we have to look beyond our program evaluations. We need to actively build mechanisms that track real outcomes, using robust metrics to prove our nurse leaders are truly thriving:

measuring behaviour Impact - self reported reflection and confidence in the months following training and match this with outcome data - sick leave, satisfaction / wellbeing scores and clinical outcomes.

"People development is the single greatest lever for achieving a service's strategic priorities and positive patient outcomes." – Naomi

To #Measure Impact

One Small Behaviour Change Habit

Next time you send a staff member to a study day, or next time you complete a professional development module yourself, do not archive the certificate and forget about it.

Open your calendar right then and there, skip forward exactly 30 days, and block out a 10-minute window. When the appointment arrives ask yourself or your staff member "What is one specific thing we have actually changed in our daily practice as a direct result of that study day?" If the answer is nothing, your educational intervention has flatlined. Titrate your approach.

#Data with Impact