Beyond the numbers: measuring real impact

Organisations have become increasingly sophisticated at measuring performance. Dashboards are filled with percentages, targets, traffic lights and quarterly achievements. We know how many people attended, how many services were delivered, how many initiatives were implemented and whether annual targets were achieved.
This is where many performance systems become uncomfortable.
A healthcare organisation may report that thousands of patients attended a newly established clinic. Waiting times may have decreased and patient satisfaction may be high. These are important achievements. But they still do not fully answer the question of impact.
There is an important distance between delivering a service and creating a difference. Education faces exactly the same challenge. Universities may report the percentage of courses offered online, the number of smart classrooms established, the proportion of courses using simulation or virtual reality, student satisfaction rates, and the percentage of students graduating within the expected period. All are legitimate indicators.
But imagine that a university reports that 70 per cent of its programmes now use advanced educational technology. It sounds impressive. Yet the more meaningful questions begin after that number.
Are students learning better? Has their ability to apply knowledge improved? Are nursing students making safer clinical decisions because of simulation? Are engineering students solving problems more effectively? Are graduates more prepared for the workplace? Has technology expanded access for students who previously struggled, or has it simply replaced one method of delivery with another?
The difference is subtle but fundamental. We often measure whether something happened, while strategy should ultimately be concerned with what happened because of it.
This problem exists partly because activity is easier to measure than impact. We can count a training programme the day it is completed. We can calculate attendance immediately. We can ask participants whether they were satisfied before they leave the room.
But whether that programme changes behaviour six months later is harder to establish. Whether it improves organisational performance may be harder still.
And whether it contributes to better outcomes for patients, students, employees or society can take years to become visible. The danger is that what is easiest to measure gradually becomes what matters most.
Once indicators become targets, they influence behaviour. If departments are evaluated by the number of workshops they conduct, workshops will be conducted. If performance depends on the number of initiatives launched, initiatives will multiply. If digital transformation is measured by how many systems are introduced, organisations will introduce systems.
Everyone may technically achieve the KPI. But the organisation may still be unable to answer whether those activities created value.
This is where performance measurement can become an illusion of progress. An organisation can be extremely busy without becoming significantly better.
The distinction becomes clearer when we separate several levels of measurement. At the first level, we measure activity: what did we do?
At the second, we measure output: what did we produce or deliver?
At the third, we measure outcome: what changed for the people receiving the service? At the deepest level, we examine impact: what meaningful and sustained difference resulted from our work?
Impact would appear in areas such as improved employee engagement, reduced turnover, stronger team performance, or better organisational culture.
The same logic applies in healthcare. The number of patients screened is an output. Earlier detection may be an outcome. Reduced complications, mortality, or long-term healthcare burden moves closer to impact.
The mistake is treating them as the final evidence of success. A useful performance system therefore needs different layers of indicators. Some should tell us whether implementation is happening. Others should tell us whether immediate outcomes are appearing. And a smaller number should examine whether strategic priorities are producing meaningful, sustained change.
Perhaps every major KPI should therefore be accompanied by a second question: We trained 500 employees. So what changed?
We introduced virtual reality into 20 courses. So what improved? We opened a new clinic.
So what became better for patients? We increased research publications. So what knowledge, policy, practice or societal benefit emerged from that research?