AI Initiative Rubric Demo: Scoring AI Pilots

Transcript

In this demonstration, I want to show you the AI Initiative Rubric. This is a tool I’ve created to allow you to evaluate whether or not an AI pilot is actually worth doing. And what I mean by that is that many pilots tend to get established through ungoverned and unmanaged shadow AI and potentially end up in a business for quite a long time, but with no real value gating at the start to decide whether or not that was worth doing. And then over time, people then start to query, well, you know, we can’t get rid of this process because we’ve had it for so long, or this initiative because we’ve had it for so long. So the idea behind the Initiative Rubric is that it’s designed to help you prioritise which initiatives you would like to run and which initiatives are going to have the most impact on the organisation.

It allows you to stack rank them and prioritise them. So the Rubric is available on my website. You can access it at mariotomas.com. And what you’ll see here when you reach the Rubric, which is linked from the AI page and other parts of the website, and within this YouTube video as well, is that you will see some initiative details. This is just standard text. So I’m just going to put in my initiative and some descriptive text. And then I’m going to decide whether or not I want this to be a concept, a pilot, an implementation initiative or scaling initiative. So these are initiative stages that you might go through. So I’m just going to say concept. So we’re going to give it a try. And we’d like to do it within zero to three months.

Now, we have to score the initiative across actually 103 different dimensions. We don’t have to evaluate all 103. We might just choose a few. And the initiative model is actually very reactive to the number of initiatives you select. But we do score each outcome on a scale of zero where there’s no impact to five where there is transformative impact. And we have an NA as well as an option. What you also then get is an initiative assessment summary, which gives you a percentage score for the initiative, how the initiative aligns to the Well-Advised strategic priorities as a percentage, and what capabilities across the five pillars, capability areas, the initiative will contribute to. So let’s go back to here. And you can see here the evaluation is a click through. So within the five pillars of Well-Advised innovation, new services, customer value and growth, operational excellence, responsible transformation and revenue, margin and profit, I’ve actually created a number of outcomes.

So if you look in the outcomes table here, you’ll see that in this particular pillar of Well-Advised, there are 17 outcomes. And it may be that this initiative is going to establish new revenue streams. So I’m just going to tick that. And you can see as I change the value, it increases the overall score for that pillar. Now, if I want to understand how to score, I can just click the little help icon. And that tells me which of these scores apply. So, for example, this is going to create one new revenue stream greater than 500k. Similarly, it might be that it provides me the first mover advantage. So you’ll see the score changing here based on first mover advantage. And again, if I hit the help button, it’s going to give me significant market leadership is what we’ll actually say.

So we’ll score that as a four. And it may be that we’re able to create new service offerings. And the score we’ll give for the new service offerings is multiple new service lines. And you can see there the scoring mechanism loops around. So it goes from NA to 0 to 1, 2, 3, 4, 5. So we’ll mark that as a 5. And you can see that we have a 78% score for innovation and new services. Now, let’s look at customer growth and value. And what you’ll see here is that there are clear competitive advantages to this. So we’ll score that as a 3. And you can see here that we get an above average position. Now, what’s happening is the scores are being aggregated. And at the top in the assessment, we’ve now built some outcomes here.

So in real time, it’s saying this is actually a priority 2 initiative. It should be a near-term consideration because it’s only really giving you 78% on innovation and new services, 60% on customer value and growth, and 0% on the other three. But it does give you some capability building as well. So it’s an interesting initiative, but it may not be the one. So let’s carry on. What does it do for us from an operational perspective? Well, maybe it provides us with multiple cost reductions, and maybe it gives us some quantifiable savings of greater than 750K. And maybe we also get some process improvements as well. And again, if we go back to the top here, you can now see that this is recommending that we immediately implement this idea. So let’s continue down the graph, and let’s look at how responsibly it’s going to change us.

So I think we’ll say that it gives us some sustainability gains, and maybe it will give us some stakeholder trust indicators as well. And finally, from a revenue margin and profit perspective, it’s going to generate revenue in excess of 2 million. Let’s make that a 4. And we’ll leave it at that. Now, the initiative is still ranking as we should do it. It’s now 100%, and it’s building across five capabilities. And then what you can see a bit further down is that it also tracks the cross-pillar strategic value of the initiative. So you can see here that it’s saying that this builds operational and value skills. This one builds governance and technical skills. This one builds value and operational. This one builds people and governance. You’ll also notice these predictive lagging and leading icons here.

These are predictive lagging and leading indicators to the success of the initiative. So if we, for example, go back up here and pick on one of these, you can see this one is a lagging indicator. And it expands the service portfolio. So that is why it seems to be a lagging indicator. Whereas an earlier one here is a predictive indicator. It’s a prediction of future potential worlds. So positions, the organization, head of competitors in a new market would be a predictive indicator. And you can see here that we have some strategic recommendations. So it’s saying here that it gives strong innovation capabilities, creating new opportunities, will improve customer experience, will achieve operational excellence through AI, and so on. And it also says that we should try and complete some more assessments to see more recommendations in the improvement areas.

And it’s saying here you can leverage the platform for ecosystem partnerships and expand successful customer initiatives across segments. So again, it’s giving recommendations that you go along. Now, this initiative sounds like we should do it. What you can do here is just save the initiative, and that will download the initiative to your computer. And that means if you ever want to reload it and play around with it and edit it, you can do. And if you’d like to find out more about the AI initiative rubric, fill in my form here and get in touch. Thanks for listening.