Cost And ROI Are Still The Biggest AI Blocker

MAI_bc8c0faa2886b77c

I keep seeing the same moment in AI conversations with small business owners. They are interested. They can see the promise. They may even have had a few good experiences with Copilot Chat or a meeting summary in Teams. Then the conversation gets to licensing, and the room changes.

Not because they hate the idea. Not because they are anti-AI. Because they run small businesses, and small businesses feel every extra monthly cost.

The question is brutally simple: if I add another per-user cost on top of Microsoft 365, what changes in the business?

That is the question many AI conversations still fail to answer.

Value Is Not The Same As Usefulness

A tool can be useful and still not be worth buying.

That sounds harsh, but it is how SMB owners think. They are already paying for Microsoft 365 Business Premium, backup, security tools, line-of-business apps, phones, insurance, wages, vehicles, rent, and everything else that makes the business work. Another subscription is not judged in isolation. It competes with every other demand on cash flow.

So when someone says, “Copilot can summarise meetings,” the owner does not hear a feature. They hear another monthly bill.

The better conversation is not “look what AI can do.” The better conversation is “which number is this going to move?”

Revenue. Profit. Hours saved. Faster quoting. Fewer interruptions. Increased staff capacity. Better client follow-up. Shorter reporting cycles. Reduced rework.

If none of those move, the AI remains interesting but optional.

The First Pilot Should Be A Measurement Exercise

This is where many MSPs and advisers get the Copilot conversation wrong. They start with licensing and features. I would start with one painful business process.

Take Outlook. If a business owner spends the first hour of every morning reading long email threads, then Copilot in Outlook has a clear test. Does it reduce that hour? Does it produce better replies? Does it help the owner get to the few messages that actually matter?

Take Teams. If managers waste time chasing meeting notes, actions, and decisions, then Copilot in Teams has a clear test. Does the recap save time? Are actions clearer? Are follow-ups happening faster?

Take Excel. If reporting is still built from manual copy-and-paste, then Copilot can be tested against report preparation time.

The point is not to “try AI.” The point is to measure one workflow before and after.

A small pilot should answer three questions: what task changed, how much time was saved, and who actually used it without being nagged?

If the answer is “we cannot tell,” then you do not yet have an ROI story. You have a demo.

Cost Sensitivity Is Not Resistance

I think too many people mistake price sensitivity for lack of vision.

SMBs are not slow. They are disciplined. They have to be. A larger organisation can absorb a poor software choice for a while. A small business feels it straight away.

That means AI adoption has to be practical from day one. Start with the people who have the highest-value repetitive work. Give them clear scenarios. Use Microsoft 365 Copilot where the work already happens: Outlook for customer communications, Teams for meetings, Word for proposals, Excel for analysis, SharePoint for business knowledge.

Then build the value case from real usage, not hope.

For MSPs, this is the opportunity. Do not sell AI as magic. Help the client find the task, measure the result, tighten governance, and decide whether the next licence makes sense.

The licence is not the decision.

The business outcome is the decision.

If AI moves a number, it becomes investment. If it only looks impressive, it stays expense. And in the SMB world, expenses get cut quickly.

The Latest AI Model Is Not Always the Best Tool

image

I see this conversation more and more. Someone opens an AI tool, sees a new model name at the top of the list, and assumes that must be the one to use for everything. Newer must be smarter. More expensive must mean better results.

I do not think it is that simple.

The better question is not, “Which model is the latest?” The better question is, “What decision am I trying to improve with this task?” That matters as AI becomes normal work inside Outlook, Teams, Word, Excel, and Microsoft 365 Copilot.

The expensive model is often wasted on cheap work

A lot of AI work is not deep thinking. It is sorting, summarising, rewriting, comparing, and turning messy notes into something usable.

If I ask Copilot in Outlook to tidy a reply, I do not necessarily need the most advanced reasoning model available. I need something that understands the email thread, preserves the intent, and helps me move the conversation forward. That does not require the biggest hammer in the toolbox.

The same applies to meeting recaps in Teams. If the job is to produce a clean summary, identify obvious actions, and help me catch up, then the real value is context and workflow. The model matters, but so does whether the result lands where I can use it.

This is where many businesses get the economics wrong. They confuse “best model” with “best outcome”. Those are not always the same thing.

Better models matter when the work is harder

Advanced models have a place.

If I am asking AI to compare strategies, review a complex proposal, reason across several documents, test assumptions, or help me structure an argument, I want the strongest model I can reasonably use. That is where better reasoning can show up: fewer shallow answers, better trade-offs, and more useful challenge.

For example, if I have a client planning an AI adoption project, I might ask Copilot to review Teams notes, pull themes from Word documents in SharePoint, and help me identify risks that have not been properly addressed. In that situation, a stronger model may produce a better result because the task requires judgement and careful comparison.

But even then, the model is only part of the answer. If the source material is poor, scattered, outdated, or inaccessible, the smartest model in the world is still working with a weak brief. AI does not fix bad information hygiene. It exposes it.

Pay for capability, not fashion

The practical approach is to tier your use.

Use the everyday model for everyday work. Draft the email. Summarise the meeting. Clean up the notes. Turn the rough spreadsheet explanation into something your client can understand.

Use the more advanced model when the cost of being wrong is higher or the thinking is genuinely harder. Strategy. Risk. Governance. Technical design. Client-facing recommendations. Anything where you need deeper reasoning rather than quicker wording.

That is also the advice I would give MSPs talking to SMB clients. Do not sell AI as a race to the newest model. Help clients build judgement about when AI is good enough, when it needs checking, and when the work deserves the better tool.

The latest model may be worth paying for. Sometimes. But always using it is not automatically clever. It can become another form of waste dressed up as sophistication.

The real maturity test is not whether you have access to the newest AI model. It is whether you know when to use it, when not to use it, and how to measure whether it actually improved the result.

That is the shift I am watching now. Not model chasing. Outcome choosing.


The Client Doesn’t Need Magic. They Need Calm.

image

I’ve watched difficult situations go wrong before the technical problem was even understood.

Not because the team lacked skill. Not because the fix was impossible. It went wrong because the person on the other end was left guessing.

That is where panic grows.

When a client, a manager, or a staff member is worried, they are not usually asking you to guarantee the ending. They know things break. Systems fail. Projects drift. People make mistakes. What they want to know is simpler: does someone capable have their hands on the wheel?

That is often the first job of an MSP, a technology adviser, or anyone leading through a messy moment. Not to make the problem disappear immediately. To reduce the fog.

The first response sets the temperature

I see this all the time in technology support. A mailbox stops working. A conditional access change blocks someone unexpectedly. A SharePoint permission issue puts a key document out of reach.

The technical work matters. But the first message matters just as much.

A vague reply makes the problem feel bigger. A confident but empty promise is worse. It sounds good for a moment, then falls apart as soon as the next update is late.

The better approach is plain and steady. Say what you understand. Say what you are checking. Say when the next update will happen.

That does not require drama. It requires discipline.

For me, this is where Microsoft 365 helps when it is used properly. A Teams channel for the incident. A short pinned note with the current status. Planner tasks for who is doing what. Copilot in Teams used to summarise the thread before the next update.

That is not flashy AI. That is practical communication hygiene.

People calm down when the next step is visible

Most people can handle bad news if they can see movement.

What wears them down is silence.

Silence makes people invent their own story. Maybe nobody is looking at it. Maybe it is worse than they are saying. Maybe something has been missed. Once that story starts running, the technical fix is no longer the only issue. Now you are dealing with trust.

A simple rhythm changes that.

What we know. What we are doing. When we will speak again.

That rhythm works in an outage. It works in a project delay. It works when rolling out Copilot and people are nervous about data access, privacy, prompts, or whether AI is going to make their work feel exposed.

In those moments, people do not need a speech about innovation. They need a sensible path. Put the policy in SharePoint. Use Teams for the questions. Use Copilot in Outlook to help draft clear updates, then have a human review them.

The tool does not replace judgement. It helps keep communication consistent when everyone is busy.

Confidence is built in small updates

Clients remember whether you made them feel stranded.

They may not remember the exact PowerShell command, the admin centre setting, or the backend change that fixed the issue. They remember how the situation felt while they were waiting.

That should make us think differently about service maturity. Good process is not just ticket categories and SLA reports. It is the ability to communicate clearly when the answer is not yet complete.

That is where trust is earned.

You do not need to pretend you have solved everything. You do need to show that you have understood the situation, taken ownership, and created a visible path forward.

In my experience, that is often the quickest meaningful win.

Not certainty.

Direction.

When people can see the next step, they can breathe again.

CIA Brief 20260822

image

Announcements – Licensing & Exchange
Industry News – Security & Threat Intelligence
AI & Copilot

After hours

Robots in China gear up for 2nd annual World Humanoid Games – https://www.youtube.com/watch?v=V9z-kLwst90

Editorial

If you found this valuable, the I’d appreciate a ‘like’ or perhaps a donation at https://ko-fi.com/ciaops. This helps me know that people enjoy what I have created and provides resources to allow me to create more content. If you have any feedback or suggestions around this, I’m all ears. You can also find me via email director@ciaops.com and on X (Twitter) at https://www.twitter.com/directorcia.

If you want to be part of a dedicated Microsoft Cloud community with information and interactions daily, then consider becoming a CIAOPS Patron – www.ciaopspatron.com.

Watch out for the next CIA Brief next week

What Happens When The Screen Stops Being The Starting Point?

image

I keep coming back to a simple question: what if the future interface is not a grid of icons?

For years we have trained ourselves to use devices by hunting for the right app, opening it, finding the right menu, tapping the right button, then hoping we remembered where the command lives. That feels normal because we have done it for so long. But normal is not the same as permanent.

AI changes that. Not because it makes the existing interface prettier, but because it challenges whether that interface needs to be the starting point at all.

The app may become the background

I don’t think apps disappear overnight. That is too neat and too dramatic. Businesses still need systems of record. People still need Outlook, Teams, Word, Excel, SharePoint and the rest. The real shift is that the app may stop being where the user begins.

Instead of opening Outlook, finding the email thread, checking the calendar, then drafting a reply, I can see people simply asking Microsoft 365 Copilot: “What do I need to respond to before tomorrow morning, and can you draft the first three replies?”

That is not just a faster way to use Outlook. It is a different relationship with the machine.

The software is still there. The data is still in Microsoft 365. The security, permissions, retention and compliance boundaries still matter. But the user experience moves up a layer. The task becomes the centre, not the application.

That is a big change.

Mobile makes this more obvious

This shift feels especially likely on mobile devices.

A phone is powerful, but it is still a small piece of glass. The more we expect from it, the more ridiculous some workflows become. Open an app. Switch apps. Copy something. Paste it somewhere else. Tap through three screens. Accept a prompt. Go back because you missed something.

That is a lot of ceremony for a device that is usually in your hand while you are walking, travelling, waiting, or trying to get something done between other things.

Voice changes the equation. If I can pick up a phone and say, “Summarise the Teams discussion about that client issue, check whether there is anything in my inbox I need to act on, and create a Planner task for the follow-up,” then the icons become less important.

Not irrelevant. Just less central.

The interface becomes more like a conversation with context. That means the device needs to understand intent, identity, permissions and the work graph around me. This is where Microsoft 365 has an advantage, because so much of the business context already lives inside Outlook, Teams, SharePoint, OneDrive and the calendar.

The danger is sloppy delegation

There is a trap here though.

Asking AI to “do something” sounds simple, but business work is rarely simple. A useful assistant needs to know when to act, when to ask, when to show its reasoning, and when to stop. That matters even more when the interface becomes conversational.

If the AI becomes the front door to the device, then governance becomes part of the user experience. Not something hidden in the admin centre. Not something bolted on after the fact.

For MSPs and business owners, that is the real lesson. The future interface may be conversational, but the foundation still needs to be boringly practical: identity, conditional access, data classification, permissions, auditability and user training.

AI does not remove operational discipline. It exposes whether you had any.

I’m watching the starting point

I don’t think the question is whether AI replaces the operating system. The operating system will still exist. Something has to manage the device, the hardware, the identity and the applications.

The better question is whether people will feel like they are using an operating system at all.

My guess is that, over time, more people will start with the request rather than the app. They will ask, instruct, refine and approve. The screen will still matter, but it may become more of a confirmation surface than a navigation surface.

That is the shift I’m watching. Not AI as another icon on the device, but AI as the place where the work begins.

Stung by my own stupidity

If you aren’t aware, when you built or run anything new in Copilot Studio it will all be charged PAYG against Azure. To allow this you need to connect your Power Platform environment to an Azure subscription. You can find details on how to do that here:

https://blog.ciaops.com/2022/04/29/set-up-payg-for-power-platform/

Now with all that in place I built a new modern agent in Copilot Studio to answer M365 questions (called Sage) built using the new Github Copilot harness and using Claude Opus 5 as the LLM.

image

I then tested it a few times in ‘Preview’ and was happy that it was all working. I knew at this point, all that was going to cost me a few bucks because now even creation costs with the new Copilot Studio. All good so far and still in budget.

Next, I wired up a new Workflow in Copilot Studio to wait for a message to be posted into a Microsoft Teams channel, take that, post it to the newly created Sage agent, then take the reply from the agent and post it back into the same channel. Quick and easy to create. Job done, I thought.

Can you see the logic flaw yet? I certainly didn’t initially. In short, the workflow I created basically replies to every message posted into a channel. Ahem, those replies then trigger the agent to run again and post yet another message, which again triggers another message posting from the agent, and on and on. So, I had created an infinite loop.

My mistake was now running the workflow and calling the agent and posting into the Team every minute or so. I didn’t recognise my error for a few hours! Yes, hours. I estimate the loop I created with the workflow ran for about 3.5 hours in total. Ouch. When I finally realised upon checking back into the channel I immediately deleted the workflow to stop the race condition, however I knew I was going to pay for my mistake.

Fast forward a day or so when I have all the billing data available. Here’s what the results of my oversight were:

Screenshot 2026-08-21 073742

The error had cost me around AU$250. D’Oh!

All of this is always a learning experience, so now that I had understood the ‘bill shock’ amount I wanted to see what more billing information I could obtain about what had actually happened. I visited the Power Platform admin center | Licensing Copilot Studio, scrolled down to Top 5 agents and users, then selected View all agents which showed me this:

image

then when I drilled into my environments I can see:

image

and at the bottom you can see the autonomous consumption of 16,376.01 credits. If I divide that by the 3.5 hour run time I get 4,678.86 credits consumed per hour. If I then divide that by 60 to get the cost per minute I get 77.98 credits. Thus, each post to the channel in effect cost around US$0.78 which is about AU$1.20.

The detail also shows that creating the agent cost around 67.26 + 379.77 = 447.37 credit which is around US$4.50 and AU$6.95 to create.

I have now added notifications at 90% capacity like so in this admin console because they are not enabled by default:

image

I would expect, like the budget notifications from Azure, they are not immediate which makes avoiding costly mistakes harder when your error maybe racking up a few dollars per minute charges!

I accept full responsibility for my error and oversight and bill incurred, however I think there are some important learnings and observations here with the new PAYG billing for AI services. These in essence boil down to the fact that it very difficult to get a good understanding of exactly what your costs are in real time or prior. Typically, you need to wait a full 24 hours until all the billing data has been collected and by then you maybe up for thousands of dollars if you are not very careful.

Another observation is that if you make a logic error in your build you won’t find that until you look at your bill. I was lucky that I found mine after a few hours, imagine if it had run for more than 24 hours before the billing data alerted me? Ouch.

I believe this lack of immediacy an d visibility on costs is going to be a major barrier for adoption of PAYG agents in Microsoft 365, whether Cowork or the new Copilot Studio, especially in SMB.

image

Hopefully, we get to a point like we have with Github Copilot (above) where I can quickly and easily see my usage in the development environment (here Visual Studio Code). Without this type of spending certainty many business are simply not going to use what are fantastic AI tools to help their business. This risk of runaway costs is simply too great.

Another point that I want to reinforce here is that when you implement PAYG with agents you need to monitor your costs DAILY! This will be a big change for many MSPs who may occasionally go into a customers tenant to look at licensing monthly. If your customer has PAYG AI and you are responsible for managing these costs you need to keep an eye on this every single day to minimise what a single logic error could cost.

Ensure you enable all the alerting that you can when you use PAYG AI services, no matter where or whom they are from. Hopefully, doing this and my sorry tale here helps you better monitor your costs and avoid ‘AI usage bill shock’.

Your Skills Files Are Business IP

image

I keep seeing businesses get excited about building reusable prompts, agents, SOPs and skills.md files. Fair enough. That is where the real value starts to appear. Not in one clever prompt, but in documenting how the business works and making that repeatable.

But there is a quiet problem underneath it.

The better those files become, the more they stop being “documentation” and start becoming business intellectual property. A well-written skills.md file may contain how you scope jobs, respond to clients, handle exceptions, use Microsoft 365 Copilot, build proposals, or deliver a managed service consistently. That is not just a file. That is your operating model written down.

And yet, in many businesses, that content sits in a SharePoint library or Teams channel where almost everyone can read it, copy it, sync it, or forward it.

Convenient? Yes. Sensible? Not always.

The process library is now crown-jewel data

Businesses normally think about sensitive data as payroll files, contracts, financial spreadsheets and customer records. Those still matter. But AI changes the definition of what is valuable.

If your business has spent months refining reusable skills, prompts, checklists and delivery playbooks, then you have created a process asset. It explains how your business turns knowledge into outcomes. That deserves proper governance.

I am not saying every user should be locked out. The point of documenting processes is that people can use them. But there is a difference between “available to the team that needs it” and “available to anyone who inherited access from a Team created three years ago”.

That distinction matters when these files become grounding material for Copilot or custom agents. If Copilot can find the content, summarise it and reshape it quickly, then poor permissions become easier to exploit.

Copilot is not the leak. Oversharing is.

Access should match the work

The first control is boring and important: permissions.

Store these files in a dedicated SharePoint site or library. Do not scatter them across personal OneDrives, random Teams channels, email attachments and old project folders. Give the library an owner. Use Microsoft 365 groups or Entra ID security groups to control access. Review membership regularly.

The test I like is simple. If someone left tomorrow and joined a competitor, what could they still download today?

That question cuts through wishful thinking.

Some people need edit rights. Most only need read rights. Some only need access to the process area they work in. If everyone has everything, you do not have knowledge management. You have a shared filing cabinet with the front door open.

Labels and DLP are not decorations

This is where Microsoft Purview matters.

Apply sensitivity labels to the process library. A label like Confidential – Internal Process can make the handling expectation clear and drive protection such as encryption and access restrictions where appropriate.

Then add Data Loss Prevention policies around the same content. If someone tries to email a bundle of process files externally, copy them into chat with an outside party, or move them into unmanaged locations, you want friction, warning, logging, or blocking depending on the risk.

This is not about distrusting staff. It is about recognising that staff move on, mistakes happen, and valuable business knowledge should not be one drag-and-drop away from leaving the organisation.

Offboarding is too late

Many businesses only think about this when someone resigns. By then, the files may already be synced locally, copied into another tool, or forwarded elsewhere.

The right time to protect process IP is when the library is created. Classify it. Restrict it. Monitor it. Review it. Make access part of onboarding and removal part of offboarding.

If you are building AI skills for your business, treat them as assets, not notes.

The future advantage will not belong to the business with the most prompts. It will belong to the business that protects, improves and governs the way it works.

Shared Ownership Is Where Culture Becomes Real

image

I hear culture talked about as if it is something written on a wall, captured in a values statement, or mentioned during onboarding. That is the easy version. The harder version is what happens on a normal Tuesday when something is broken, unclear, duplicated, delayed, or ignored.

That is where culture shows up.

Not in the big presentation. Not in the annual planning day. In the small moments where someone decides whether to leave the problem sitting there or do something useful about it.

The warning sign is hesitation

One of the quietest culture problems in any business is when good people start waiting for permission to care.

They see a clumsy process, notice a client communication could be clearer, or hear a decision drift past without an owner, and tell themselves it probably belongs to someone more senior.

None of that looks dramatic. Everyone looks polite, busy, and professional.

But the business is paying a tax every time that happens.

The work gets slower. The standards get softer. Small issues become normal. People learn that caring too much creates extra work, so they keep their heads down. That is how ordinary cultures become fragile cultures.

Ownership has to be visible

If I want a team to lift its standard, I cannot just tell people to take responsibility. I have to make it practical.

That means making it clear that improvement is not reserved for managers. If a client onboarding checklist in SharePoint is out of date, the useful response is not to complain about it in the background. Fix it, or at least raise it clearly in the right Teams channel with enough context for someone to act.

If a meeting ends with vague actions, do not let them vanish into the air. Use Copilot in Teams to summarise the discussion, check the actions, and then make sure the next steps land somewhere visible, such as Planner or a shared work tracker.

That is not bureaucracy. That is housekeeping.

The point is not that every person can change every decision. The point is that every person can make the problem clearer, remove friction, and stop the next person tripping over the same thing.

Quiet leadership matters

The best ownership I see is often quiet. It is not the person dominating the room. It is the person who notices a gap and calmly closes it.

They ask the extra question. They document the missing step. They follow up after the meeting. They update the shared note. They make the next handover cleaner than the last one.

In an MSP or any service business, that behaviour compounds quickly. Clients feel it when internal ownership is strong. Tickets are cleaner. Handover notes make sense. Recurring issues get spotted earlier. The client does not have to re-explain the same problem three times.

That is culture in operational form.

I am not interested in a team where people only do what is printed beside their name. That might keep the lights on, but it will not build something excellent.

The better standard is this: if you are close enough to see the issue, you are close enough to help move it forward.

That does not mean being reckless or ignoring roles, approvals, or security boundaries. It means acting like the quality of the whole business matters, not just your own narrow lane.

Shared ownership is not a slogan. It is a habit. It is built in the everyday choices people make when there is no applause attached.

And if you want to know the real strength of your culture, do not just listen to what people say in the meeting. Watch what they clean up afterwards.