Measuring transformation: looking beyond activity to impact?

Transformation changes how an organisation works to achieve specific outcomes. Yet measures of delivery, implementation and adoption can tell us whether a programme is progressing without necessarily telling us whether the organisation is performing differently as a result.

AI has made an old transformation challenge more visible. Organisations have become increasingly sophisticated at measuring whether new technologies have been deployed and adopted, but less so at establishing whether they have fundamentally changed how work gets done, improved organisational performance or created lasting value. The challenge is not unique to AI. It sits at the heart of transformation more broadly: distinguishing successful implementation from meaningful impact.

The implication for transformation leaders is important: a programme can be reporting well while the outcomes it was designed to achieve have barely moved. Measurement therefore needs to do more than demonstrate activity. It should help leaders understand what is changing, test whether value is emerging and provide the insight to course-correct while there is still time to make a difference.

Delivered successfully, and still not worth doing

A programme can be delivered on time, on budget, and with strong adoption, and still fail to create meaningful value.

Most transformation leaders will recognise this scenario. A programme is green. The technology works. People have been trained. Adoption is high. And yet, six or twelve months later, it is difficult to point to what has actually improved.

The gap between successful delivery and realised value is becoming hard to ignore.

PwC’s Global AI Performance Survey found that just 20% of companies are capturing 74% of AI-driven returns. Critically, those leading companies are also 80% more likely to systematically track the business impact of their AI initiatives. 

The Irish picture reinforces the challenge. PwC’s 2026 Irish CEO Survey found that only 17% of Irish CEOs reported increased revenue from AI over the previous 12 months and 23% reported lower costs. Most reported neither revenue nor cost benefits.

This does not necessarily indicate a technology failure. Rather, it illustrates a wider challenge for organisations: deploying technology does not, on its own, create value. PwC’s analysis of the Irish findings points to the importance of coupling AI adoption with redesign of processes, roles and operating models if organisations are to translate its use into meaningful business value. 

The research suggests that capturing value from AI is about more than how much technology is deployed. It points to a broader combination of factors spanning strategy, investment, workforce, data and technology, governance and innovation, alongside how extensively and effectively AI is used. The leading organisations focus on the outcomes that matter, build the foundations needed to scale and embed AI into everyday workflows. 

Ultimately, there is a broader lesson here for transformation. If we measure activity more effectively than impact, we can become very good at proving that change happened without proving that it mattered. 

What a green dashboard can hide

Traditional KPIs remain essential for tracking operational and financial performance. Cost, schedule, implementation milestones, system performance and adoption all tell us something important about whether a programme is being delivered effectively. 

The risk arises when measures of implementation and activity become proxies for value. 

Consider an organisation reporting 80% adoption of a new system. It is a reassuring number: clear, timely and easy to track.

But what does 80% adoption actually tell us?

That depends first on what the organisation means by adoption. It could mean log-ins, active users, transactions or deeper use of particular functionality. But even a robust adoption measure does not, on its own, tell us whether work is being done differently or with greater agility, decisions are being made faster, customers are receiving a better service or experience, productivity has improved or the organisation has stopped doing the things the technology was intended to replace.

Some of these outcomes may emerge quickly. Others take longer and can be considerably harder to measure.

The uncomfortable possibility is that the new system is being used while the old process continues alongside it. Adoption rises, costs increase and the transformation dashboard remains green.

Start with the value, not the metric

A broader view of value brings together financial and operational performance with evidence of behavioural change, customer outcomes, employee experience, service quality, and longer-term value. 

The correction isn’t simply a longer list of metrics. It’s a clear and shared vision, established at the outset, of what the transformation is designed to achieve. Instead of starting by asking "How will we measure the programme?", start by asking "What will be observably different if this is successful?" Then the measures should follow.

From there, the organisation identifies how success will be recognised, not only when the transformation is complete but throughout the journey. In practice, this means measuring progress towards the desired outcomes as the work proceeds, rather than waiting until the end to determine whether value has been realised. 

This provides an opportunity to course-correct at a point where it can still make a difference.

There is another, potentially more difficult question too: "How do we know the transformation contributed to the outcome?" 

Revenue might increase, employee engagement might improve or customers might become more satisfied during a transformation without the programme being the sole reason. Market conditions, leadership changes and other initiatives may all be influencing the same outcomes. Effective measurement therefore needs to go beyond demonstrating that an outcome moved. It should build evidence of how the transformation contributed to that change.

Measuring what’s assumed to be unmeasurable

Employee engagement, agility, customer experience, and innovation are often described as intangible, which in practice usually means difficult to measure. Yet they can be assessed using a combination of quantitative and qualitative indicators.

Importantly, there is rarely one metric that adequately captures these outcomes.

Engagement, for example, might be understood through a combination of employee sentiment and behavioural or workforce indicators. Customer experience may draw on satisfaction, loyalty and behavioural information. Organisational agility might consider indicators such as decision speed and responsiveness to change.

None of these measures proves impact in isolation. A more complete view combines organisational performance and human experience, while also considering the other factors that may be influencing the results.

One without the other produces a familiar and misleading result: a programme that reports well and is quietly disliked by those who have to live with it.

From retrospective reporting to continuous insight

Technology has the potential to transform how organisations measure transformation itself. 

Advances in analytics, AI, and digital workplace platforms can provide more timely signals about behaviours, adoption patterns, and business performance. Rather than relying solely on periodic reporting, organisations can bring together appropriate workforce, operational and customer data to identify emerging trends, understand barriers to adoption and identify where interventions may be needed.

There are important considerations here. Particularly when workforce data is involved, greater measurement capability needs to be accompanied by appropriate governance, transparency and consideration of privacy and employee trust.

The real opportunity is the shift from retrospective reporting towards more continuous insight, allowing leaders to make better-informed decisions and course-correct more quickly as the transformation evolves.

AI can also play a role in interpreting large volumes of structured and unstructured data and surfacing patterns that warrant further investigation. That creates an interesting connection with the AI value challenge itself: AI can form part of the toolkit organisations use to understand where value is emerging, where it is not and what may require further investigation.

Balancing the short-term without starving the long-term

Immediate objectives and long-term strategy are frequently framed as competing priorities. They shouldn’t be. Cost savings and productivity improvements matter, but organisations that focus exclusively on immediate returns risk underinvesting in skills, culture, leadership, and capability, which support sustainable value over time.

The strongest transformations connect the two. Short-term measures provide evidence that the programme is moving in the right direction, while longer-term measures test whether the organisation is ultimately achieving the outcomes that justified the investment in the first place.

That means continuing to track programme delivery, but alongside measures of the outcomes that matter: whether services are improving, work is changing, organisational capability is growing and ultimately whether the transformation is creating the value it was intended to create.

Measured that way, a transformation that finishes on time and on budget but changes nothing is visible as a failure while there is still time to do something about it.

Five ways to measure whether transformation is creating value

1. Define success, and how you’ll recognise it, before you start

Be explicit about what should be observably different if the transformation succeeds. Define what that should look like throughout the journey, not only at completion, and establish the baseline against which change will be assessed.

2. Go beyond adoption to understand what has actually changed

Adoption matters, but it is not evidence of value in itself. Look at whether people are working differently, whether old processes have actually stopped, whether workarounds persist and whether the outcomes the transformation was intended to improve are moving. The question is not simply “are people using it?” but “what is different because they are?”

3. Build evidence of impact, not reliance on a single metric

Outcomes such as engagement, agility, customer experience and innovation rarely reduce neatly to one number. Combine quantitative measures with qualitative insight to understand both what is changing and why. And ask the harder question: "What evidence do we have that the transformation contributed to that change?"

4. Use measurement to course-correct, not just to report

Measurement should provide useful information while there is still time to act on it. Use analytics, AI and other available data to identify emerging patterns, barriers and changes in outcomes earlier, with appropriate governance where workforce or other sensitive data is involved. The objective is course-correction during the programme, not a verdict after it.

5. Measure progress today without losing sight of value tomorrow

Track near-term indicators such as cost, productivity and operational performance alongside the longer-term outcomes the transformation is intended to create. Growth, service quality, agility, employee experience and organisational capability may develop on different timelines. A strong scorecard shows both whether the transformation is moving and whether it is moving towards something that matters.

We’re here to help

Measuring transformation value is rarely about finding one perfect metric. It is about being clear on the outcomes that matter, understanding whether behaviours and performance are genuinely changing, and creating the insight to course-correct along the way. We work with organisations to build measurement approaches that connect delivery, adoption and behavioural change with the outcomes the transformation was designed to achieve. If you are looking to strengthen how you measure and demonstrate transformation value, please get in touch.