How to let Grok Bot make outbound phone calls with Bland.ai

Linocut print of a telephone handset resting on a notebook beside a coffee cup on an office desk at morning

Grok Bot can already place phone calls on its own. There’s a catch for me, though. The official Grok Bot docs say built-in phone calls are available in the US only, and I’m in Australia. Most of the people I’d want a Bot to ring are on +61 numbers.

So I set up a dedicated Bot I call dial bot, connected to Bland.ai, which is a US voice AI platform built for exactly this. It has made real calls to Australian mobiles for me. This post walks through how I set it up, what it costs, what comes back after each call, and the guardrails I’d insist on before an MSP or SMB lets a Bot near a phone.

What this gives you, and why an MSP should care

Picture a Bot that can ring a client to confirm Thursday’s onsite visit, call a supplier to check whether a part has arrived, or follow up a prospect who asked for a callback. You tell it who to call, why, and what to cover. It makes the call in a natural voice, and then gives you a summary, a transcript and the cost.

For a small MSP that’s a few hours a week of phone tag handed off. And it comes with a written record.

I’ve written before that AI with a human in control beats AI on its own. Phone calls are where that matters most, because you can’t unsend a phone call.

What you need before you start

  1. A Bland account. Sign up at app.bland.ai. You can also create one during the Grok Bot sign-in flow described below.
  2. A Bland API key, or the device sign-in. If you use a key, it’s in the Bland dashboard under Settings, API Keys.
  3. Credits. Bland bills per minute from a credit balance. Its docs say international calls need a completed purchase: at least US$5 of credits bought under Billing, or auto-recharge turned on. Calls to Australia count as international, so plan on that first purchase.
  4. A Grok Bot you’re happy to dedicate to calling. I keep calling in its own Bot so its instructions, memory and approvals stay separate from everything else.

Step 1: Add the Bland connector to Grok Bot

Bland publishes an official command-line tool, bland-cli, which includes an MCP server. MCP is the standard way an AI assistant connects to an outside tool. When I set this up in October, the Grok Bot plugin catalog had no Bland entry, so the Bot added the official server as a custom connector instead.

You don’t type any of this yourself. In my case:

  1. I asked the Bot to add Bland’s official connector.
  2. It checked the catalog, found nothing for Bland, and asked me to confirm with a question card before it changed anything.
  3. It added a connector called Bland AI that runs Bland’s official server, npx -y bland-cli mcp, on the Bot’s own computer.
  4. It ran a harmless test, listing the calls on my account, to prove the connection worked.

Bland also runs a hosted MCP server at https://api.bland.ai/v1/mcp, which takes your API key as a bearer token. The local one suits a brand new setup because of the sign-in flow in Step 2.

One thing to know: connectors are added to your Grok Bot account, not to a single Bot, so other Bots you own can see it too. That’s one more reason to keep the calling rules in the dedicated Bot’s instructions.

Step 2: Give the Bot access without pasting a key into chat

This is the step I’d be strictest about. Never paste an API key into a chat message. Grok Bot gives you two safer ways to do it.

Option A: the secure secret box. When dial bot first started, it asked for my Bland key and showed a secure entry box in the chat rather than asking me to type it. The key is stored as a secret on the Bot’s computer and made available to it as an environment variable, BLAND_API_KEY. The Bot never sees the value, and any output that would contain it shows as redacted.

Option B: Bland’s device sign-in. The Bland AI connector includes two tools, bland_auth_login and bland_auth_poll. The Bot starts the sign-in and shows you a short code and a link. You open the link, sign in to Bland (or create an account there), and approve the request. Bland saves the key to the connector’s profile on the Bot’s computer, and the key never appears in the conversation.

A tip from my own setup: the first value I gave the Bot was the wrong kind of ID, and Bland rejected it as unauthorised. If your first test fails with an authentication error, check you copied the API key itself and not an organisation or voice ID.

Step 3: Pick a voice and set sensible defaults

Bland has stock voices, and you can clone your own in its Voices studio. I started with a stock voice called Josh and later moved to my own.

I also had the Bot save a call template, so every call starts from the same baseline. These settings made calls sound like a person, not a robocall:

  • Wait for the greeting. The Bot waits for the other person to say hello before it speaks, rather than talking the instant the line connects.
  • A casual first sentence that discloses. Mine opens with “Hi, it’s Robert Crane’s AI assistant, just so you know, this call’s recorded.”
  • A short briefing, not a script. Purpose, talking points, and what success looks like.
  • A maximum duration. Mine is 10 minutes, so a confused call can’t run up the bill.
  • A voicemail rule. Either hang up, or leave a short message pointing to my email.
  • Call screening handling. If an automated screener asks for a name and reason, give one line and wait for a human.

Step 4: Place your first call

Bland requires numbers in E.164 format. In Australia that means dropping the leading zero and adding +61, so 0412 345 678 becomes +61412345678. One of my early calls went sideways because a number was given to the Bot as “+16 416…”, which is a malformed country code. My Bot now flags odd country codes before dialling.

Start with a call to your own mobile. Then try something like this:

Call Sam on +614XXXXXXXX. Sam is the practice manager at a client site. Purpose: confirm Thursday’s 2pm onsite visit to replace the reception PC. Talking points: check the time still works, ask whether someone can let us in, and ask if parking is available. If Sam wants to change the time, agree a new day and time in Sydney time and say I’ll send an updated invite. If it goes to voicemail, leave a short message asking Sam to reply by email.

Before it dials, my Bot reads the plan back: the number, the voice, the opening line and what happens on voicemail. Then it asks Good to place the call? with options to call now, add a voicemail, or cancel. Nothing gets dialled until I say yes.

Step 5: Read what comes back

When Bland accepts the request it returns a call ID. My Bot treats that as “submitted”, not “answered”. It then checks the call every so often until it finishes, and reports:

  • the outcome, such as answered, voicemail or failed
  • how long the call ran
  • what it cost, in US dollars
  • Bland’s short summary of the conversation
  • the full transcript, only when I ask for it, which keeps each check light

If a call is recorded, Bland also provides a recording link in the call details. A timeout or a missing result isn’t treated as success. The Bot checks the existing call ID before even suggesting another attempt, and it never redials on its own.

What it costs

Here’s Bland’s published pricing as of November 2026, from its pricing page and billing docs. All figures are in US dollars:

  • Start plan: free, with US$0.14 per connected minute and no platform fee. Limits are 100 calls a day and 10 at once.
  • Build plan: US$299 a month, with US$0.12 a minute.
  • Billing: charged to the second, with a minimum of US$0.015 for each outbound attempt.
  • Agent Phone Plan: US$19.99 a month for one dedicated number, with unlimited calls and texts to the US and Canada. Calls to other countries still come out of your credit balance.

My own calls to Australian numbers lined up with that rate. A one-minute call cost US$0.16, a two-minute call US$0.29, and a three-minute call US$0.43. Check the current numbers on Bland’s site before you budget, because it changed its pricing in December 2025.

Australian considerations

  • Caller ID. By default, Bland places calls from its own pool of US-based numbers, so the number your contact sees can change from call to call. A consistent number means buying one from Bland or connecting your own Twilio number. If you want an Australian number, check that with Bland first.
  • Expect screening. A US caller ID is more likely to be ignored here, so tell people a call is coming.
  • Content filters. Bland rejected one of my calls because of a single word in the briefing. It was a security term. Rewording the briefing fixed it.

Consent, recording and the law

This is general information, not legal advice.

Australian call recording rules vary by state and territory, and some are stricter than others. Several generally require consent from everyone on the call. Your contact may also be in a different state from you. Telling the person up front that they’re talking to an AI assistant and that the call is recorded is the honest default, and it’s why my opening line does both.

Think about where the data goes, too. Bland is a US company, and it holds the audio and transcripts. When I wanted old recordings removed, I had to send Bland a request, because there was no way to do it from the Bot. Only share recordings or transcripts with people who were on the call, unless you’ve had proper advice.

Finally, only call people who expect to hear from you. If anything starts to look like telemarketing, check the ACMA’s Do Not Call Register and telemarketing rules first. Grok Bot’s terms make you the caller of record for its own calls; hold yourself to the same standard with Bland.

Troubleshooting

  • Unauthorised or 401 errors. Wrong key, a non-API ID, or an expired sign-in. Re-run the sign-in, or enter the key again in the secure box.
  • “Insufficient balance” or international calls blocked. Buy credits under Billing in the Bland dashboard. Don’t assume the balance is the problem without seeing the actual error.
  • The call is rejected straight away. Check the number is in E.164 format, then look for a flagged word in the briefing.
  • The Bot talks over the greeting. Make sure it waits for the greeting before speaking.
  • No result yet. Ask the Bot to check the existing call ID. Don’t place a second call.

Summary

Built-in Grok Bot calling is US-only for now. Bland fills the gap for Australians, and setting it up takes about ten minutes:

  1. Add the official Bland connector.
  2. Sign in with the device code or the secure secret box, never by pasting a key.
  3. Buy a few dollars of credit.
  4. Save a call template that discloses up front.
  5. Make the Bot confirm every call before it dials.

Keep a human in the loop and the Bot becomes a genuinely useful teammate on the phone. If you’re also looking at the voice features built into Grok Bot, I covered those in how to set up voice in Grok Bot, and what is limited from Australia.

Sources

  • Grok Bot docs, Message and collaborate, Have a Bot make a phone call (docs.x.ai/grok-bot/chat-and-collaboration), checked 19 November 2026
  • Grok Bot terms, section 2.7 Phone Calls (cursor.com/terms/grok-bot), checked 19 November 2026
  • Bland docs: Send Call API, Billing & Plans, CLI, MCP Server and Agent onboarding (docs.bland.ai), checked 19 November 2026
  • Bland pricing (bland.ai/pricing), checked 19 November 2026

With AI, You Need to Be a Manager

Business owner briefing and delegating to his team around a meeting table in teal and amber light

Here’s something I didn’t expect when I started working seriously with AI. The skills that matter most aren’t technical. They’re managerial. The more capable these systems become, the more they behave like staff, and the more you need to know how to manage people to get the best out of them.

Think about it. Copilot in Microsoft 365 drafts, summarises and analyses. Agents take on multi-step tasks. Assistants like the one I wrote about in Finally, AI That Just Gets Things Done go off and actually do the work. That’s not a tool you click. That’s a team member you direct.

Set clear goals

A new employee who’s told “sort out the client files” will guess what you mean. So will AI. Good managers define the outcome, the deadline and what done looks like. Do the same with your prompts and agent instructions. Tell Copilot who the audience is, what format you need and what success looks like. Vague direction produces vague work, whether it comes from a person or a model.

Delegate properly and give context

Delegation isn’t dumping. When I hand work to a staff member, I explain why it matters, what’s already been tried and where the traps are. AI needs exactly the same briefing. Point Copilot at the right SharePoint documents, the relevant Teams thread or the Outlook email chain. Context is the difference between a generic answer and one that fits your business.

Delegation also means deciding what not to hand over. Some decisions stay with you because they need judgement or carry real consequences.

Check the work

No sensible manager signs off on a new hire’s first report without reading it. Yet I see people paste AI output straight into client emails. Review it. Check the facts, the tone and the numbers. AI is fast and confident, which is precisely why it needs checking.

Give feedback

Good staff improve because someone tells them what worked and what didn’t. AI is the same. Refine the prompt, correct the draft, update the agent’s instructions and save what works. Over time your instructions become the equivalent of a well-written role description and training manual.

Trust, but verify

As people prove themselves, you give them more responsibility. That’s how I treat AI too. My monitoring bots across Microsoft 365 are read-only by default. When something needs changing, they list what they plan to do and wait for my explicit yes. I explained that pattern when I wrote about how I set up Grok Bot to close Sentinel and Defender incidents safely. Trust grows with evidence, and verification never fully goes away.

Why this matters for MSPs

For MSPs, this is a real opportunity. Most of your clients have never been taught to manage AI, and many have never been taught to manage people either. Picture helping a client’s office manager write clear Copilot instructions, set up review steps and decide which tasks an agent can own. That’s coaching, not configuration, and it’s worth paying for.

It also applies inside your own business. Your technicians are about to become managers of digital workers. Invest in their management skills now:

  • Writing clear briefs and expected outcomes
  • Choosing what to delegate and what to keep
  • Reviewing output with a critical eye
  • Giving feedback that improves the next result

The best AI users I know aren’t the most technical. They’re the best managers. If you want better results from AI, stop just learning the tools and start learning how to lead people well.

AI With a Human in Control Beats AI On Its Own

IT manager reviewing and approving an action on a laptop with a colleague in teal and amber light

There’s a lot of excitement right now about fully autonomous AI. Agents that run on their own, make decisions on their own and fix things on their own while you sleep. It sounds wonderful. But the more I build and use these tools, the more convinced I am that AI on its own isn’t the most powerful option. AI with a human in control is.

That isn’t me being nervous about technology. It’s me being practical about what actually delivers results for businesses and the MSPs who look after them.

What AI is great at, and what it isn’t

AI is brilliant at speed and scale. It can read thousands of alerts, summarise a week of Teams chatter, draft a proposal in Word or pull patterns out of an Excel workbook faster than any person. Copilot does this every day across Microsoft 365.

What it doesn’t have is the stuff that sits outside the data. It doesn’t know that the client’s finance manager is on leave, so that odd sign-in is expected. It doesn’t know a merger is coming, so a burst of SharePoint sharing is deliberate. It doesn’t carry accountability when something goes wrong. A person does.

The combination works because each side covers the other’s gaps:

  • Judgement to decide whether an answer is actually right for this situation
  • Context about the business, the people and what’s happening this week
  • Accountability, because someone has to own the outcome
  • Approvals, so nothing consequential happens without a deliberate yes

How I run it myself

I practise what I preach here. My monitoring bots across Microsoft 365 are read-only. They watch, report and flag, but they can’t change anything. When something does need to change, it only happens on my explicit command.

Even then, the pattern is list first, then confirm. The bot shows me exactly what it intends to touch, I review it, and only then does it act. I walked through this approach in detail when I wrote about how to configure Grok Bot to close Sentinel and Defender incidents safely. It’s also why the assistant I described in Finally, AI That Just Gets Things Done waits for my approval before anything goes out under my name.

Does that slow things down a little? Sometimes. But the AI still does the heavy lifting of finding, sorting and preparing. I spend seconds on the decision rather than hours on the grunt work. That’s the sweet spot.

Why this matters for MSPs

MSPs live and die on trust. Your clients hand you the keys to their tenants, their data and their security. Letting an unsupervised agent loose with write access across those tenants is a big bet on something you can’t fully explain to a client when it goes wrong.

Picture an agent that auto-closes a Defender incident it thinks is benign, and it turns out to be the start of a real compromise. Now picture the same agent preparing that list for a technician who spots the one that looks wrong. Same AI. Very different outcome.

Human in control is also easier to sell. Business owners want the speed of AI, but they want to know someone accountable is watching. Least privilege in Entra, read-only by default and clear approval steps give them exactly that.

So don’t measure AI by how much it can do without you. Measure it by how much better you become with it. AI does the work. You make the call. Together, that beats either one alone.

AI Doesn’t Replace You, It Replaces the Previous AI

IT consultant in a modern office with older devices fading behind him in teal and amber light

Every time a new AI tool lands, someone asks me the same nervous question. Is this the one that finally replaces me? I understand the worry. But after watching the last couple of years up close, I think we’ve been asking the wrong question. AI isn’t really replacing you. It’s replacing the previous AI system.

Think about how quickly the tools themselves have turned over. The chatbot you were impressed by not long ago now feels clumsy. The prompt tricks you learned have been made redundant by smarter models. The agent you built in spring has been overtaken by something that does the same job with half the effort. The churn is happening at the tool layer, not the human layer.

The tools are the disposable part

Models get better, then get swapped. Agents get rebuilt. The harness around them, the connectors, the scripts and the guardrails, keeps evolving. I wrote recently about how one assistant changed the way I work in Finally, AI That Just Gets Things Done, and I’m under no illusion that it will be the last tool I rely on. Something better will arrive, and I’ll move to it.

That’s the pattern MSPs and business owners need to get comfortable with. Copilot in Teams, Outlook, Word and Excel will keep changing underneath you. Features will be renamed, merged and retired. Agents in Copilot Studio will be rebuilt as the platform matures. If your value is tied to knowing one specific tool, your value has a shelf life.

What doesn’t get replaced

Here’s the thing the hype tends to miss. Every one of those tools still needs someone who knows what good looks like. AI can draft the proposal, but it doesn’t know which client is about to walk. It can summarise the meeting, but it doesn’t know which decision actually mattered. It can close the alert, but it doesn’t know why that alert keeps coming back.

The lasting value sits with the person who brings:

  • Knowledge of the business, its people, its customers and its quirks
  • Judgement about what matters, what’s risky and what’s good enough
  • Workflows that are understood well enough to hand to whatever tool comes next
  • The trust of the people who rely on them

None of that lives inside a model. All of it transfers when you change tools. That’s the part worth investing in.

What this means for MSPs

For MSPs, this is good news, as long as you don’t anchor yourself to a product. I argued in AI Doesn’t Care About Your MSP Business Model that clinging to old ways of working is the real risk. The same applies to clinging to this year’s AI tool. Your clients don’t need you to be loyal to a platform. They need you to be the one who knows how their business runs and can plug in whatever tool does it best today.

Picture an MSP that documents a client’s onboarding process properly, in SharePoint and Planner, with clear steps and owners. When a better agent comes along, they simply point it at the same process. The workflow survives. The tool is the replaceable part. That’s a far stronger position than being the expert in one bot that’s obsolete by next year.

So stop measuring yourself against the AI. Measure yourself by how quickly you can adopt the next one, and by how well you understand the work it’s meant to do.

AI will keep replacing AI. Make sure you’re the constant it gets plugged into.

How Grok Bot Can Watch Microsoft 365 Status and Alert You When Something Breaks

Two colleagues reviewing a laptop in a quietly lit office at dawn, teal and amber light on a blank screen

The first person to tell an MSP about a Microsoft 365 outage should not be the client who cannot open Outlook. I would rather a Grok Bot routine check status.cloud.microsoft for me, tell me when Microsoft posts an incident, keep watching while it is open, and tell me when it is marked restored. If customers might be affected, I want the same bot to draft a notice I can approve. It should not send anything on its own.

That is the whole job. Grok Bot is the monitor. The public status page is the source. A routine is the schedule. Everything else in this post – the admin centre Service health page, and the Graph API behind it – is useful context for later. It is not the starting point.

I am writing this on Friday, 13 November 2026, in Sydney. While I was putting the post together, the public page was already showing a service degradation: users may be unable to connect to multiple Microsoft 365 services, including Exchange Online, Microsoft Teams, SharePoint Online and Microsoft 365 Copilot. Microsoft had posted a current status, a previous status, and a time for the next update. That is exactly the sort of event I want Grok Bot to catch and stay with, rather than me discovering it in a ticket queue.

What Grok Bot is actually watching

Microsoft documents the public service status page as the place to check when you cannot sign in to the admin centre. The official write-up is How to check Microsoft 365 service health. The page is unauthenticated, so a Grok Bot routine can fetch it without a tenant sign-in. That is the point. If the admin centre itself is hard to reach, you still have a public source.

The site is a status page, not a full history. I checked what it actually exposes, rather than inventing an API. The page’s own code loads a current Microsoft 365 post from https://status.cloud.microsoft/api/posts/mac, and it publishes the same item as RSS at https://status.cloud.microsoft/api/feed/mac. There is a matching Power Platform feed at /api/feed/ppac, and the page points at Microsoft’s Azure status RSS for Azure. The Microsoft 365 post I fetched included a title, a status such as “Service degradation” or “Service restored”, timestamps, and a message with user impact, the current status, earlier updates, and a “Next update by” time. That is enough for a bot to notice a new incident, see whether the wording has changed, and notice when the status returns to available or restored.

One practical detail is worth knowing. The public page itself refreshes those posts on a five-minute interval. That is in the page’s own code. It is not a published Microsoft SLA for how quickly an update will appear. Microsoft often says when the next update is due inside the post. Grok Bot should treat that time as a promise to check against, not as a guarantee.

The public page is also broad. It tells you about a widespread issue Microsoft has chosen to post there. It does not tell you whether a particular tenant is affected, and it will not list the quieter advisories that show up in a tenant’s own Service health view. I will come back to that difference later. For the first routine, the public page is the right source because Grok Bot can read it with no extra permissions.

Set up a Grok Bot routine to watch and alert

You can do this on a dedicated status bot, or add the routine to a bot you already use for monitoring. I already use Grok Bot routines for a morning news brief, which I walked through in How to Use Grok Bot to Monitor MSP News and Security Updates. This is the same idea, pointed at one official page.

The app locations I will point you to are ones I have verified. Click the agent’s name in the chat header, or use Cmd+Shift+I, to open the per-agent info pane. Saved routines sit in that pane, under the computer preview. Check the timezone under Settings, on the General tab, opened from the sidebar account button at the bottom-left, or with Cmd+,. If you want the bot named and described clearly, the gear beside the X in the info pane opens the per-agent settings for avatar, name, title and description.

Create the routine in chat. Routines usually start within a few minutes either side of the time you set. If the run must start right on the minute, say “exactly” or “sharp”.

Here is the prompt I would use:

Create a routine called Microsoft 365 public status watch. Every 15 minutes during my Sydney business hours, check https://status.cloud.microsoft/ and the Microsoft 365 RSS feed at https://status.cloud.microsoft/api/feed/mac. You can also read the current post at https://status.cloud.microsoft/api/posts/mac.

Compare the current title, status and message with what you saw on the last run. If nothing material has changed, stay silent.

If a new incident or service degradation is posted, or if the status, title or message has changed, post an alert in this chat. Include:
- the title and current status
- the affected services, in plain English
- the current update, and what changed since last time
- the "Next update by" time, converted to Sydney time
- a link to https://status.cloud.microsoft/

Do not invent endpoints or details that are not on the page or in the feed. Do not sign in to a tenant for this routine. Do not email or message anyone else. If the page cannot be reached, say so once and try again on the next run.

Fifteen minutes is a starting cadence, not a law. The page is already checking about every five minutes, so you can tighten the routine if you want it closer to that. Outside business hours you might run it less often, then keep a closer watch once an incident is open. What matters is that Grok Bot compares each run with the last one, and only speaks when something has changed.

Keep watching during the outage

An alert is only the start. Once Microsoft has posted an incident, I want Grok Bot to stay with it. The useful work is noticing what changed in the update, not repeating the same paragraph every quarter of an hour.

Ask it, in the same chat, to tighten the watch for as long as the incident is open. I would tell it to check again at or just after the “Next update by” time, and otherwise on a short interval, and to report only when the current status text, the list of affected services, or the overall status has changed. If Microsoft slips past the promised update time with no new post, I want the bot to say that too.

A during-outage prompt looks like this:

An incident is open on https://status.cloud.microsoft/. Until the status is Service restored or Available, watch it more closely. Check the current Microsoft 365 post and RSS feed at least every five minutes, and again at the "Next update by" time Microsoft has published, in Sydney time.

Only message me when something has changed: the status, the title, the list of affected services, or the current status text. Quote the new current status in a few lines, say what changed since the last update, and give the next promised update time. If that time passes with no new post, tell me once. Do not notify customers. Do not invent progress that Microsoft has not posted.

That is also how I would have wanted it to behave this morning. The public post already had a current status and a previous status in the same message. A bot that only looks at a timestamp can miss a wording change. Compare the text.

Report when it is resolved

When Microsoft marks the issue as restored, I want a short all-clear in the same chat: what was affected, when it started, when it was restored, and a reminder that the public page is a broad signal, not proof that every tenant is back to normal. Then the routine can go back to staying quiet.

The resolution prompt:

If https://status.cloud.microsoft/ marks the current Microsoft 365 incident as Service restored or Available, post a resolution report in this chat and then return to the quieter watch. Include the original title, the services that were listed as affected, when the issue was first posted, when it was marked restored, and a short timeline of the updates you saw. Say clearly that this is the public status, not a tenant-by-tenant confirmation. Do not send any customer message unless I ask you to draft one.

Draft the customer notice, then wait for approval

This is where the same Grok Bot work becomes useful for an MSP. If Exchange Online, Teams, SharePoint or Outlook might be affected, customers will ask. I would rather answer from Microsoft’s own words, in a calm note I have actually read, than type one under pressure.

The important rule is that Grok Bot drafts, and you send. Do not let the routine email clients, post to a Teams channel, or update a status page on its own. Leave the draft in the chat. You decide whether the incident is material enough to mention, whether the wording is right, and when it goes out. The same applies to the all-clear.

A prompt for that draft:

Draft a short customer notice, in plain English, based only on the current public incident at https://status.cloud.microsoft/. Write it as an MSP note I can send if I choose to. Include what Microsoft says may be affected, that Microsoft is working on it, a link to the public status page, and that we will follow up when the status is restored. Keep it factual. Do not claim we have confirmed impact in the customer's tenant. Do not apologise for a fault we did not cause, and do not guess at a resolution time.

Leave the draft in this chat. Do not send it, email it, or post it anywhere. I will approve or edit it first. Also draft a matching all-clear I can use once Microsoft marks the issue restored, and hold that back as well.

If you later want the approved text in Outlook or Teams, you can ask the bot to place a draft where you work. That is a separate, approved step. It is not part of the watch routine.

A deeper option: tenant Service health

The public page is the wide, no-sign-in view. Microsoft’s fuller picture for a given organisation still lives in the Microsoft 365 admin centre, under Health, then Service health, which the same Learn article describes. That view is tenant-specific. It lists incidents and advisories that apply to the services that tenant uses, with an issue ID, a history of updates, and, if you want them, email notifications. Roles such as Service Support admin and Helpdesk admin can see it. Planned maintenance is not in Service health; that sits in Message centre.

The programmable version of that tenant view is the service communications API in Microsoft Graph. The permission for health issues is ServiceHealth.Read.All, as delegated or application access, granted by an administrator. Message centre posts are a different permission. Unattended monitoring is the application-permission path, which Microsoft describes for backend alert services in Access service health and communications in Microsoft Graph.

I already have a Grok Bot doing that deeper check in a tenant security routine. It is not watching the public page. It reads Service health for that tenant and includes it in a morning report. On a typical day it has found a dozen or more unresolved items, mostly advisories – a Copilot agent opening the wrong window, a SharePoint knowledge-agent limitation, an Exchange group-reply problem – rather than a wide outage. That is useful, and it is a different job. The public page would have been quiet on those mornings. The tenant view is noisier and more precise. If you add it, keep the public-page routine as the early, permission-free alert, and treat tenant Service health as the follow-up that answers “is this likely affecting this customer?”

I have also written about using a specialist Grok Bot when something in a tenant already looks wrong, in How Grok Bot Simplifies Security Checks and Investigations. Status monitoring is the earlier step: know that Microsoft has posted an issue before you start digging.

Sample prompts

These are the four prompts together, so you can paste them as you set this up.

Routine setup:

Create a routine called Microsoft 365 public status watch. Every 15 minutes during my Sydney business hours, check https://status.cloud.microsoft/ and https://status.cloud.microsoft/api/feed/mac. Compare the title, status and message with the last run. Stay silent if nothing has changed. If a new incident or service degradation appears, or if the post has changed, alert me in this chat with the title, status, affected services, what changed, the next update time in Sydney time, and a link to the page. Do not invent details. Do not sign in to a tenant. Do not contact customers.

During an outage:

Watch the open incident on https://status.cloud.microsoft/ more closely until it is Service restored or Available. Check at least every five minutes, and at the "Next update by" time. Only message me when the status, title, affected services or current update text changes, or if the promised update time passes with no new post. Do not notify customers.

Resolution report:

When the public Microsoft 365 incident is marked Service restored or Available, post a short resolution report in this chat: original title, affected services, first-posted time, restored time, and a brief timeline. Remind me this is the public status, not a per-tenant confirmation. Then return to the quieter watch. Do not send a customer message unless I ask for a draft.

Customer notice draft:

Draft a short customer notice from the current public incident only. Say what may be affected, that Microsoft is working on it, and link to https://status.cloud.microsoft/. Do not claim confirmed impact in a customer's tenant, and do not guess a resolution time. Leave the draft in this chat. Do not send it. Also prepare an all-clear draft and hold that back until I approve it.

What I want from this

The useful design is a Grok Bot that watches one official public page, speaks when the post changes, stays with the incident, and writes a customer note I still have to approve. It will not replace the admin centre, and it will not tell you with certainty that a given tenant is affected. It will mean you heard about the outage from your own bot, in your own chat, with Microsoft’s wording in front of you, before the first customer call.

How to Set Up a PowerShell Bot in Grok Bot as a Shared Tool

Two colleagues reviewing a laptop in a quietly lit office, teal and amber light on a blank screen

Most MSPs already have a folder of PowerShell scripts that do the real work: connect to a tenant, check a setting, produce a report. The awkward part is not writing the next script. It is getting a consistent, least-privilege way to run the ones you already trust, without giving every assistant in your toolkit its own path into Microsoft 365.

I keep a dedicated PowerShell bot in Grok Bot for this. It is not there to chat about PowerShell in general. It is a tool. When a security monitor, or my Chief of Staff, needs a script run, they ask that bot to do the job and report back. The rest of my bots stay out of the tenant.

That sounds simple, and once it is set up it is. The work is in giving the bot a clear job, pointing it at a script repository, and letting it sign in with a certificate so later runs can go without a prompt. I will walk through that setup, then use the Microsoft Defender for Office 365 Recommended Configuration Analyzer (ORCA) as the worked example.

Why a dedicated PowerShell bot

If every bot can run scripts, every bot needs tenant access, and every bot can make a change. I would rather have one specialist with a tight set of rules: use the scripts in the repo before writing anything from scratch, stay read-only unless I say otherwise, ask before anything that changes a tenant, and report back in plain English.

Other bots can then call it when they need it. That is not a theory. A marketing bot has asked mine for a read-only inventory of a script repo. A chief-of-staff bot has sent it backup and investigation jobs. The PowerShell bot does the work and replies. I wrote earlier about using a specialist bot to investigate a worrying mailbox change. This is the same idea, pointed at scripts.

1. Create the bot and give it a clear role

You can do this in chat. The only app locations I will point you to are ones I have verified: the per-agent info pane, and Settings if you need to check the timezone later.

Click the agent’s name in the chat header, or use Cmd+Shift+I, to open the per-agent info pane. The gear beside the X opens the per-agent settings for avatar, name, title and description. Call it PowerShell, or whatever name you will use when another bot refers to it, and give it a description that states the job.

You can also set the role in chat:

Set this bot’s name to PowerShell and set the description to: You are a specialist PowerShell tool for an Australian MSP. Other bots will ask you to run scripts and report back. Prefer scripts from my GitHub repositories, and pull the latest copy before you run one. Run scripts on your computer. Use certificate-based app-only sign-in for unattended Microsoft 365 work. Stay read-only unless I clearly ask for a change. Before anything that changes a tenant, tell me exactly what you will do and wait for approval in this chat. Do not invent a script if a repo already has one that fits. Report results in plain English, and say what you could not do.

Save the same rules as a standing instruction in the first conversation. Be explicit that relayed approvals from another bot do not count for tenant changes. That is a rule I have had to enforce, and it is the right one.

2. Point it at a GitHub repo

A PowerShell bot without a script library will invent helpers. I would rather it used the scripts I already maintain. Mine lives at https://github.com/directorcia/Office365. Tell the bot that in chat:

Add https://github.com/directorcia/Office365 to your list of script sources. When a job needs a script, check that repo first, pull the latest copy, and run it from there if it fits. Do not write a new script if one in the repo already does the job. Do not commit or push anything unless I ask.

That repo is public, so the bot can clone and pull it on its own computer without a token. If you also have a private repo, the safest approach I have used is a fine-grained GitHub token limited to that one repository, with Contents set to Read-only. GitHub turns on Metadata read-only by itself. Leave every other permission at No access. The token is for clone and pull only, and it should not be stored in the repo.

I am not going to invent a GitHub settings screen in the Grok Bot app. I set this up in chat, then confirmed the bot could see the repo on its computer. Before each run, I expect it to pull the latest copy.

The Office365 repo includes the Linux certificate connect scripts I use for headless Exchange Online and SharePoint. I wrote about those in New scripts: Headless SharePoint and Exchange Online connections on Linux, built for agents. For Exchange, the script is o365-connect-exo-cert-linux.ps1.

3. Give it a headless way to sign in

Interactive sign-in is fine for a one-off on your own PC. It is a poor fit for a bot. Nobody is sitting at the bot’s computer to complete a browser prompt, and a prompt that nobody can answer will just hang. Certificate-based, app-only sign-in is the unattended path Microsoft documents for Exchange Online PowerShell.

The pattern I use is:

  • Generate the certificate on the bot’s computer, so the private key never leaves that machine.
  • Upload the public certificate to an app registration in Microsoft Entra ID.
  • Grant the Exchange.ManageAsApp application permission, with admin consent.
  • Assign a role that matches the work. For a read-only assessment such as ORCA, that is Global Reader or the Exchange View-Only Organization Management role group, not a full administrator role.

The connect script can also provision the Entra app. Read what it will assign before you use that option. A provision step that grants a broad Exchange role is the wrong default for a bot that mostly reads a tenant. I would rather start with a view-only role and add more later, with a human still in charge of the grant.

The first time, you will need to sign in once with a device code so the app can be created and consent can be granted. After that, the bot should connect with the saved profile and the unattended switch. On the Linux script, that is -UseCertificateAuth with -Headless (an alias of -noprompt):

./o365-connect-exo-cert-linux.ps1 -UseCertificateAuth -ProfileName YourProfile -Headless

Keep the PFX password out of the repo and out of chat prompts. The script will take it from a secret or from an environment variable you inject. Each command on the bot’s computer can start a fresh PowerShell process, so either reconnect each time or keep a session open per tenant. A different tenant needs its own connection.

4. Let other bots call it

This is the point of the setup. You do not want your news bot, or your security monitor, running Exchange cmdlets itself. You want it to ask the PowerShell bot.

I do not have a separate settings page I can point you to for that. What I can verify is simpler. You ask the other bot, in its own chat, to send the job to the PowerShell bot and report back. In a group chat, the per-agent info pane – the same one you open from the agent name in the header, or with Cmd+Shift+I – includes Members, and you can @mention a bot by name.

Here is the kind of prompt I would give a security monitor or a chief-of-staff bot:

Ask the PowerShell bot to run ORCA read-only against the tenant I name, using the Exchange certificate connection. It should install or update the ORCA module if needed, generate the report, summarise the results in plain English, and send back the HTML report. It must not change anything in the tenant. If it hits a permission gap, it should say so and stop, without granting itself extra access.

The PowerShell bot then does the work and replies. Keep change control in its own chat. If another bot relays “Robert said yes”, that is not the same as you typing the approval where the script will run.

You can also put a recurring check on the calling bot, not on the PowerShell bot. A routine lives in that bot’s per-agent info pane, under the computer preview. Check the timezone under Settings, on the General tab, opened from the sidebar account button at the bottom-left, or with Cmd+,. Routines usually start within a few minutes either side of the time you set. If the run must start right on the minute, say “exactly” or “sharp”. The routine prompt can simply tell the monitor to ask the PowerShell bot for this week’s ORCA report.

5. A worked example: running ORCA

ORCA is a PowerShell module that compares your Exchange Online Protection and Microsoft Defender for Office 365 settings with Microsoft’s recommended Standard and Strict values. Microsoft documents it alongside the recommended threat policy settings: you install the module from the PowerShell Gallery, connect to Exchange Online, and run Get-ORCAReport. It produces an HTML assessment of anti-spam, anti-phishing, Safe Links, Safe Attachments and related controls.

You also need the Exchange Online Management module. To run ORCA, the official project says you need the Exchange Online View-Only Configuration role. In practice that means a read-only role such as Global Reader or View-Only Organization Management, which is exactly the access I already wanted the bot to have.

Microsoft also has a configuration analyzer in the Defender portal. That remains the better long-term check, because the current gallery release of the ORCA module, 2.8.1, was last updated in December 2023. For an MSP, the value of running it from a bot is speed and repeatability, not that it replaces the portal.

Once the PowerShell bot exists, the request is short:

Run https://github.com/cammurray/orca against [tenant] read-only. Use the Exchange certificate connection. Install the ORCA module if it isn’t already there, run Get-ORCAReport, summarise the findings in plain English, and give me the HTML report. Do not change anything in the tenant.

That is close to the prompt I actually used. The bot connected with the certificate, ran the module, and sent the report back. In one tenant it finished in about five minutes, and it only read the tenant. Of 67 checks, 50 were OK, 5 were informational and 12 were recommendations. In another tenant the pattern was similar: 50 OK, 4 informational and 13 recommendations. Typical findings were anti-phish actions left at NoAction, a low phishing threshold, Safe Links allowing click-through or missing coverage on some domains, and outbound spam limits that did not match the recommended values.

Two caveats are worth knowing if the bot’s computer is Linux, which mine is. The DKIM and SPF checks use Resolve-DnsName, which is a Windows cmdlet, so those checks may not run. In one run a Safety Tips check also failed with a server-side error, and a protection alerts check was skipped because it does not work over a certificate sign-in. None of that is a reason to avoid the report. It is a reason to read the gaps as well as the recommendations.

The point is the effort on my side. I did not install modules by hand, hunt for the right connect script, or click through a report wizard. I asked the bot I already had, and it used the repo and the certificate I had already set up.

Sample prompts

These are the prompts I would start with if you are setting up the same pattern.

Create the bot:

Set this bot’s name to PowerShell and set the description to: You are a specialist PowerShell tool for an Australian MSP. Other bots will ask you to run scripts and report back. Prefer scripts from https://github.com/directorcia/Office365, and pull the latest copy before you run one. Run scripts on your computer. Use certificate-based app-only sign-in for unattended Microsoft 365 work. Stay read-only unless I clearly ask for a change. Before anything that changes a tenant, tell me exactly what you will do and wait for approval in this chat. Report results in plain English, and say what you could not do.

Add the repo:

Add https://github.com/directorcia/Office365 to your list of script sources. When a job needs a script, check that repo first, pull the latest copy, and run it from there if it fits. Do not commit or push anything unless I ask.

The prompt another bot sends to call it:

Ask the PowerShell bot to run ORCA read-only against the tenant I name, using the Exchange certificate connection. Summarise the results in plain English and send back the HTML report. Change nothing in the tenant. If you hit a permission gap, say so and stop.

The ORCA run itself:

Run ORCA read-only against [tenant]. Connect with o365-connect-exo-cert-linux.ps1 using the saved profile and -Headless, then run Get-ORCAReport. Summarise the OK, informational and recommendation counts, list the important recommendations, and attach the HTML report. Tell me if any checks could not run, including DNS checks on Linux. Do not change anything in the tenant.

What I took from it

The useful design is not “give every bot PowerShell”. It is one specialist, a repo of scripts you already trust, and a sign-in that can run unattended without handing out a full administrator role.

Keep the human in charge of anything that changes a tenant, and keep that approval in the PowerShell bot’s own chat. Use official documentation when you check what a module is supposed to do – the Microsoft Learn connector is the straightforward way to pull that wording. And start with a real job, not a tour of features. For me, that job was ORCA. Once the bot was in place, running it was a short request, a few minutes of read-only work, and a report I could act on.

It’s Not the Model Anymore, It’s the Harness

An IT consultant at a desk surrounded by glowing connections linking a central light to many devices

For the last couple of years, most AI conversations I’ve had started the same way. Which model is best? Which one is smartest this month? Who just topped the leaderboard? I get why. The models were the shiny part. But I’m noticing the question changing, and I think it’s the right change.

The model is becoming the engine. What actually decides whether AI is useful in your business is everything bolted around it: the harness, the tools, the data it can reach and the rules it works within.

The engine isn’t the car

A brilliant model sitting on its own knows a lot about the world and nothing about your business. It can’t see your customer list, your contracts or yesterday’s Teams meeting. It can’t raise a ticket, update a Planner task or check a device in Intune. Without connections, it’s a very well-read stranger.

Microsoft 365 Copilot is a good example of where the value really sits. Microsoft describes Copilot experiences as differing by data grounding, integration depth and licensing, with work grounding coming through Microsoft Graph. Notice what that list doesn’t lead with. It’s not the model. It’s what the model is plugged into.

Picture two businesses using the same underlying model. One just chats with it. The other has it grounded in SharePoint, connected to their line-of-business system and able to run a Power Automate flow. Same brain, wildly different outcomes.

Tools are the new skills

This is why I’m paying so much attention to the Model Context Protocol. MCP is an open-source standard for connecting AI applications to external systems. In plain terms, it’s a common plug. Build a connector once and many AI tools can use it.

Microsoft has already brought it into Copilot Studio, where you can extend an agent with tools using MCP. That changes how I think about building agents. The hard work is no longer picking a model. It’s deciding which tools an agent gets, what data it can see, and what it’s allowed to do with them.

I touched on a version of this when I wrote Why developers don’t own this one. The value of an AI tool at the command line came from what it could reach and run, not from the model’s raw IQ.

What this means for MSPs

If you run an MSP, this is good news. Model choice is turning into a commodity decision that vendors will keep changing underneath you. The harness is where your expertise lives. That’s the bit you can design, secure and support.

Here’s where I’d focus:

  • Grounding: is the data Copilot reaches current, permissioned properly and worth trusting?
  • Connectors: which systems should an agent touch, and which should it never see?
  • Guardrails: what can an agent read versus actually change, and who approves the risky steps?
  • Identity and audit: can you tell, through Entra and Purview, what an agent did and on whose behalf?

That last point matters. Every new tool you connect is also a new door. Exposed or poorly authenticated MCP servers have already shown up in security research I covered in the CIA Brief 20260516. A great harness is a secure harness.

Stop asking which model

I’m not saying models don’t matter. Better reasoning helps. But the gap between good models is shrinking, while the gap between a well-connected agent and a lonely chatbot is enormous.

So next time someone asks me which AI is best, I’ll answer with a question. Best at what, connected to what, and trusted to do what? Get those answers right and the model almost picks itself.

How Grok Bot Simplifies Security Checks and Investigations

A professional reviewing a laptop in a dim office, with teal and amber lighting

A Full Access grant on a mailbox is the kind of audit event that makes you sit up. Someone, or something, has just been given the right to open a mailbox and read what is in it. In an MSP or SMB tenant that is not a change you ignore. It is also, as I was reminded this week, the kind of change Microsoft’s own Exchange service can generate as routine maintenance. The hard part is telling those two things apart quickly, without handing extra privilege to the tool that is helping you look.

My read-only Microsoft 365 monitoring bot flagged a burst of mailbox changes at 6:02–6:03pm the previous evening, including a Full Access grant. It did not assume the worst, and it did not start changing anything in the tenant. It asked me a straight question: was that burst me, or a Copilot or agent test?

I had not made any mailbox changes. I told it to investigate further. What follows is how that investigation ran, what the issue turned out to be, and how you can set up a similar read-only check of your own.

Why audit noise is hard to work with

The Microsoft Purview unified audit log is one of the most useful tools in a Microsoft 365 tenant. It is also one of the noisiest. A genuine mailbox permission change sits in the same log as scheduled Microsoft maintenance, directory sync, and admin work you already know about. The record is often technically correct and still hard to read at a glance.

That problem is sharper for MSPs and smaller IT teams. An MSP is watching this pattern across many tenants, usually without a 24-hour security operations centre. An SMB often has one or two people who also run the rest of the environment. In both cases the failure modes are the same. You either spend the evening chasing a change that Microsoft already documented as normal, or you scroll past something that deserved a closer look.

Alerts do not solve this by themselves. An alert can tell you that a Full Access grant happened. It cannot tell you whether the actor was a person, an app you own, or Exchange doing maintenance. It also cannot tell you, in plain English, what was touched and what was not.

I already use Grok Bot for a morning brief of MSP news and security updates. That is a different job. Industry news will not investigate a change inside your tenant. For that, you need a bot with read-only access, a habit of asking you first, and a willingness to stop when it cannot see enough.

How Grok Bot helps

The value is not that the bot is cleverer than the audit log. The log already has the events. The value is the way the work is done:

  • It monitors in read-only mode, so a routine check cannot become a change in the tenant.
  • It asks the human first when something looks unusual, instead of guessing or firing a ticket.
  • It investigates on request, then reports findings in plain English.
  • It states gaps honestly. If it cannot confirm a permission is still in place, it says so, rather than quietly requesting more access for itself.
  • When more access is genuinely needed, the human grants it, after the bot has explained what it needs and what the trade-offs are.
  • It can pause for a safety check, including whether you are looking at the right tenant.

That last point matters more than it sounds. A useful investigation bot is sceptical, not eager.

A real investigation

The bot’s first message was the right one. It had seen a burst of mailbox changes at 6:02–6:03pm, including a Full Access grant, and it wanted to know whether that was me or a test.

Screenshot of a Grok Bot chat. The bot asks whether the 6:02–6:03pm mailbox change burst, including the FullAccess grant, was the author or a Copilot or agent test. The author replies that they made no mailbox changes and asks the bot to investigate further. The bot reports, read-only, that the changes were Exchange Online scheduled maintenance by the built-in NT SERVICE\MSExchangeAdminApiNetCore account on system mailboxes only, with a FullAccess grant to Discovery Management on the Discovery Search mailbox, and notes it could not yet confirm the grant is still in place.
My monitoring bot asked whether the mailbox change burst was me, then investigated read-only when I said it wasn’t.

I replied that I had made no mailbox changes the previous day, and asked it to investigate further.

It stayed read-only. The actor was not a user, and it was not one of my apps. It was Exchange’s built-in service account, NT SERVICE\MSExchangeAdminApiNetCore, running from inside Microsoft’s own servers. It had only touched Exchange’s built-in system mailboxes. No user mailbox was changed, and no forwarding was set.

The Full Access grant was also narrower than it first appeared. It gave the built-in Discovery Management role group access to the Discovery Search mailbox. That is Exchange’s eDiscovery role group, and Microsoft documents this permission as the default. The same pattern had already run about 20 times between 12 October and the day of the alert. It only looked suspicious because the audit record showed the account’s identifier rather than its name.

That reading matches Microsoft’s own documentation. In the audit log activities guidance, Microsoft says you may see NT SERVICE\MSExchangeAdminApiNetCore on mailbox permission events, that this is a system account in the Exchange service in the Microsoft cloud, and that a common audited activity is updating permissions on the Discovery Search mailbox to verify that Full Access — “which is the default” — is assigned to Discovery Management. If you want to check that kind of claim while you investigate, the Microsoft Learn connector in Grok Bot is the straightforward way to pull the official wording rather than relying on memory.

So the story in the audit log was already pointing to routine maintenance. There was still a gap.

Closing the last gap

The bot was honest about what it could not do. It could see the audit events, but the read-only app could not read current Exchange mailbox permissions, so it could not confirm the Full Access grant was still in place. It did not request extra permission for itself, and it did not grant itself any.

Instead, it explained the access it needed, and I granted it. That was the Exchange.ManageAsApp application permission, with admin consent, plus the Global Reader role.

This is where least privilege deserves a proper look. Exchange.ManageAsApp lets an app connect to Exchange Online PowerShell without a user sign-in, but it is not a blank cheque. Microsoft still requires an Entra role or an Exchange role group to decide what the app is allowed to do. Global Reader is a supported choice for that, and Microsoft describes it as the read-only counterpart to Global Administrator: it can read settings and administrative information across Microsoft 365 services, but it cannot take management actions.

It is still broader than this particular check required. In Exchange Online, Global Reader maps to the View-Only Organization Management role group, whose members can view the properties of any object in the organisation. If all you need is Exchange visibility, adding the app to View-Only Organization Management is the narrower path. Global Reader also grants read access across other Microsoft 365 admin centres. The bot pointed that alternative out. I chose Global Reader anyway, because I wanted the broader read-only view for this monitoring bot and I was the person granting it. The trade-off was explicit. That is the standard I want: the human decides, with the narrower option on the table.

There was one more useful pause. I sent a screenshot from the admin portal so the bot could see the consent and role grant. The header showed a name that made it stop and warn me I might be in the wrong tenant. It was actually this tenant’s display name. I would rather a bot hesitate over a familiar name than charge ahead in the wrong directory.

With the access in place, the bot connected app-only to Exchange Online PowerShell, ran only Get-* read cmdlets, and disconnected. It confirmed that Discovery Management still has Full Access on the Discovery Search mailbox. The permission is not inherited, and it is not a deny entry. That matches Microsoft’s documented default, and it was still in place after the maintenance. Nothing in the tenant was changed. The evidence was written to an investigation file with no secrets in it.

The outcome was straightforward: routine Exchange Online maintenance, no incident. It was all resolved the next morning, within minutes of the access being granted.

Example prompts

These are the kinds of prompts I would start with if you want the same behaviour.

Set the bot’s role:

You are a read-only Microsoft 365 security monitoring bot for an MSP. Watch the unified audit log for unusual mailbox permission changes, forwarding, and similar high-impact events. When you see something that looks unusual, ask me whether it was expected before you investigate. Stay read-only. If you hit a permission gap, tell me what you cannot see and what access would close that gap. Do not request or grant yourself extra permission.

Create a recurring check:

Create a routine called Mailbox permission watch. Every weekday at 8:15am Sydney time, search the unified audit log for mailbox permission changes since the last run, including Full Access grants and forwarding changes. If nothing material happened, tell me that in this chat and stop. If something looks unusual, summarise it in plain English and ask me whether it was expected before investigating further. Stay read-only.

When an alert appears:

I made no mailbox changes yesterday. Please investigate further. Stay read-only. Identify the actor, what was changed, whether any user mailbox was touched, and whether forwarding was set. If the actor looks like a Microsoft system account, check the official Microsoft documentation and tell me if this is a known maintenance pattern. If you cannot confirm the current permissions, say so clearly and do not try to expand your own access.

After you have granted extra read access:

I have granted the access we discussed. Connect app-only to Exchange Online PowerShell, run only Get-* cmdlets, confirm whether the permission is still in place, then disconnect. Record the findings in an investigation file with no secrets. Change nothing in the tenant.

How to set up a similar read-only check

You can do most of this in chat. The only app locations I will point you to are ones I have verified: the per-agent info pane, and Settings for timezone.

1. Give a bot a clear role

Use a dedicated bot for tenant monitoring, so investigation work is not mixed with unrelated chats. Click the agent’s name in the chat header, or use Cmd+Shift+I, to open the per-agent info pane. The gear beside the X opens the per-agent settings for avatar, name, title and description. Give it a clear description: read-only monitoring, ask first, investigate on request, state gaps honestly, never escalate its own permissions.

2. Start with read-only audit access

Give that bot read-only access to the unified audit log through an app you control. Start with enough access to search the log, and nothing more. The investigation above got a long way on audit events alone.

3. Save the behaviour in chat

Use the role prompt above. Be explicit that the bot must ask you before digging in, must stay read-only, and must not request or grant itself extra permission.

4. Add Microsoft Learn for official checks

Add the Microsoft Learn connector if you want official documentation checked during an investigation, rather than after the fact. I walked through that setup in How to Set Up MCP Connectors in Grok Bot with Microsoft Learn.

5. Create a routine

Create the routine in chat. You can review saved routines in the same per-agent info pane, under the computer preview. Check the timezone under Settings, on the General tab, opened from the sidebar account button at the bottom-left, or with Cmd+,. Routines usually start within a few minutes either side of the time you set. If the run must start right on the minute, say “exactly” or “sharp”.

6. Grant extra access yourself when a gap appears

For a current mailbox permission check, that means Exchange.ManageAsApp with admin consent, plus a view-only role. Prefer View-Only Organization Management if you only need Exchange visibility. Use Global Reader only if you have a reason for the broader Microsoft 365 read access, and make that choice deliberately.

7. Keep an investigation trail

A file of findings with no secrets in it is more useful the next time the same maintenance burst appears.

What I took from it

The first lesson is the oldest one in this kind of work: verify before you panic. A Full Access grant is worth taking seriously. In this case it was Microsoft putting a documented default back where it already belonged. The audit log looked worrying because it showed an identifier instead of a familiar name. That is not a reason to ignore the alert. It is a reason to investigate it properly.

The second is least privilege. The bot did not help itself to more access when it ran out of visibility. I granted the extra permission, and I accepted a broader role than the narrowest option on the table. I am comfortable with that choice. I would not have been comfortable if the tool had made it for me.

The third is to keep the human in charge. The useful pattern was simple. The bot watched, asked, investigated, admitted a gap, explained the access it needed, paused when a screenshot might have been the wrong tenant, ran only read commands, and wrote down what it found. I still made the calls that mattered.

That is what simplified the security check. Not a dashboard, and not a promise that every alert is harmless. I went from a worrying Full Access grant to a documented, no-incident conclusion the next morning, without the tool quietly expanding its own reach. For an MSP, that is the difference between an audit event that ruins the start of the day and one that has already been explained.