My Teams Copilot can now interpret images

image

A while back, I built an agent that I published into Teams to provide answers to technical questions on the Microsoft Cloud. I have always been super impressed by the results I get from it, but now, as you see above, it can also interpret images!

image

You need to enable the Image Input option in Settings for your agent as shown above, and of course, don’t forget to again publish your agent so the updates flow into Teams.

What is even more impressive, is that if you look at the error screen at the top of the page you’ll notice that it isn’t even in English and Copilot has extracted the text from the image, interpreted it and answered in English in Teams. Impressive!

Viewing Copilot prompt and responses across the organisation

image

To explore Copilot activity in your environment open:

https://purview.microsoft.com

with a user with appropriate access. Select Solutions on the left and then DSPM for AI as shown above.

image

Then select Activity Explorer and from the list that appears on the right select an entry that says AI interaction as shown above.

You should now see a panel appear from the right with a range of details about that session. Towards the bottom you will find

image

both the Prompt and Response as shown above. You will also see an resources, for example files or links, used in that session.

image

A little further up you will also find where that session took place, in this case from inside an Office app.

The Data Security Posture Security Management (DSPM) for AI has many other resources that you can also take advantage of but the above is the simplest method I’ve found to quickly see what a Microsoft 365 Copilot prompt and response in the environment was.

Configuring DLP with Microsoft 365 Copilot

Here is a video that takes you through the process of setting up a Data Loss Prevention Policy (DLP) that protects content when used in Microsoft 365 Copilot.

To achieve this you need to set up Data Labelling in your Microsoft 365 environment which is not covered in this video. Documentation from Microsoft on DLP with Microsoft 365 Copilot can be found here:

Learn about the Microsoft 365 Copilot policy location (preview)

Copilot pages missing

Recently, I discovered that Copilot pages were not appearing in Edge inprivate.

image

You can see the example above: Edge, inprivate and no Copilot pages.

image

It seems that a control in the Microsoft 365 administration portal (Copilot | Settings | Pin Copilot) plays a role somehow. Initially mine was set to Do not pin Microsoft Copilot to the navigation bar.

image

However, when I changed the setting to Pin Copilot to the navigation bar (recommended) and after a browser refresh or two (or close down/reopen browser), the Edit in Pages now appears within Edge inprivate as shown above.

What I also didn’t appreciate is that if you don’t have a paid version of Copilot for Microsoft 365 and simply use the free version of Copilot with your Microsoft 365 environment you can also get access to the Edit in Pages capabilities, which I thought required a fully paid Copilot for Microsoft 365. However, that doesn’t appear to be the case as the above screen shot came from a tenant with no paid Copilot for Microsoft 365 and the Edit in Pages is available, PROVIDED it seems, you turn on the pin Copilot option!

Of course, I can’t find this documented anywhere and only stumbled across it playing around. I have found the Edit in Pages button appearance to be somewhat unreliable when it did appear, but I have been turning the setting on and off to test, which have contributed to that unreliability.

After all this testing, my advice would be, based on the tests I’ve run, that even if you don’t have a pad version of Copilot for Microsoft 365 in your environment you want the option to Pin Copilot to the navigation bar enabled as I detailed above. That should allow the Edit in Pages to always appear regardless of a paid version of Copilot being in the tenant or not and regardless of browser or browser session you use.

Another observation is that with the pinned option set, the free version of Copilot returns more information as you can see when you compare the screen shots. With the pinned option enabled you get citations and hyperlinsk to the citation. Interesting.

It would be nice to know for sure if this setting does what I have found but for now you’ll have to take my word for it based on what I have found in my testing.

Copilot pages not appearing in Edge inprivate

Here’s something weird. If I use Copilot with Edge inprivate I don’t see Copilot pages likes so:

Screenshot 2025-01-06 074334

and if I try again but this time in Teams, also within an Edge inprivate session:

Screenshot 2025-01-06 074453

but if I use the Teams desktop client I see Copilot pages:

Screenshot 2025-01-06 074632

I also see Copilot pages if I’m with a private session in another browser (here Brave):

Screenshot 2025-01-06 074835

and yet Edge in normal mode is fine:

Screenshot 2025-01-06 075045

I wonder what Edge is doing differently inprivate? For some reason, it seems that when I’m using Edge with inprivate I don’t see Copilot pages?

I’ll have to try a device that maybe isn’t locked down with Intuen to see if I get the same result.

Understanding AI

I am not a big fan of the term ‘Artificial Intelligence’ because I really don’t believe what we see today can be truly be classified a ‘intelligence’ but for the sake of consistency I will run with the pack and use the terminology that is out there already.

Clearly, there is a lot of hype in and around AI. It permeates businesses from the smallest to the largest. The thing that we do know for sure is that no one can predict with certainly where the future lies. Honestly, this AI wave seems to be a lot like the cloud computing wave back in the early 2000’s. If this AI stuff follows the predictable historical pattern then my guess is that 2025 will see the peak of inflated expectations as most providers of AI try and generate real ROI for their AI investment dollars.

This, of course, doesn’t mean that AI is going away. However, I do feel that we will see greater ‘real world’ incorporation of AI into everyday business. I came across an idea that I believe will hold true in 2025 that every entity will soon have it’s own AI agent that will act of its behalf. This means individuals, businesses, brands, etc will have their own autonomous AI agents that will conduct business and manage things automatically and intelligently.

This shift to a world full of AI, to me, is a very similar to what I saw with the move to the cloud as I said. That means that in the long term AI is simply going to be a part of the technology landscape and we’ll take it for granted now as we do with using apps on our phone connected just about anywhere to our data. However, while we are still in the growth phase this represents a business opportunity I would suggest.

I was lucky enough to understand the change that cloud computing would bring to the landscape almost 20 years ago now and I see much the same opportunity today. You have to parse you way through the hype and drill down into the business benefits, but I do see them in the not to distant future for just about every business. The starting point I would suggest is to deepen your understanding about not only the technology but also its impact, especially what problems it will solve.

As always, education is the key and I have been doing my best to educate myself. So far I would suggest the following book as the best I have come across so far:

The Coming Wave: Technology, Power, and the Twenty-first Century’s Greatest Dilemma – Mustafa Suleyman,
Michael Bhaskar

and this interview with Mustafa as well, who in fact is now the AI CEO for Microsoft!

Mustafa Suleyman on the coming wave of AI

Unfortunately, as with the move to the cloud back all those years ago, I’m again seeing a hesitancy by SMB IT professionals, MSPs and technology providers from adding AI to their portfolio of skills and services. This, I feel will place them at a great disadvantage as the wave gathers momentum. It is much easier to ride in front of the wave than trying to paddle and catch it. Independent of any bet on the technology, looking at it in pure business terms, I would suggest it is largely green fields and if few are taking advantage then it is generally a risk that is well worthwhile. It is rare that you make good money doing what everyone does. Thus, doing what few are doing is probably the path to greater profitability I would suggest.

It seems to me that most SMB technology providers are most comfortable when they are doing what all their peers are doing. This leads to a commoditisation of these services are there is little differentiation between what different providers offer. I would suggest that you don’t need to throw away everything that you are doing today, however you should take a pragmatic approach and determine what is the least profitable part of your MSP business and stop doing that and replace with something few due, such as AI. We all know that to maximise returns, you should review your portfolio regularly and sell the loss makers. There is also room in most portfolios for an amount of risk. Not 100%, but a certain amount to potentially reap larger rewards. Was Bitcoin a risk back 10 – 15 years ago? Sure, but good judgement would have told you not to bet your house on it. However, a small amount of capital invested in this risk asset would have paid extremely handsome dividends today. As the old adage says ‘you need to speculate to accumulate’.

As I said, education is key and in many cases for traditional MSPs this will also mean a pivot from purely hardware, infrastructure and licenses to using code to solve problems. Luckily, there is an abundance of training and tools to be taken advantage of, with many being free. It is never too late to learn if you have the desire. However, desire without discipline is dreaming. Discipline is planning. Discipline is consistency. Discipline is the differentiator that will separate those who benefit from the AI and those that will again fall behind and struggle to keep up with change as it accelerates even faster than it did with the shift to the cloud.

Success is a journey. It is hard work but importantly it is achievable with nothing more than discipline. You have can give yourself more chance of success by supporting disciple with process, planning and review. If it is challenging for your business to adopt AI and pivot, then it will be the same for every other business. That should inspire you because it means if you can make it happen, then most will not because they fear that same challenge and will not take action. The funny thing is that the action required is generally far less onerous that you think once you actually get started. Overcoming the initial inertia is what keep most people rooted in place. Overcome that initial inertia and you are well on the way, and in fact I would suggest it will be mostly downhill from there. The trick is, just get started.

Fate provides us all with opportunities to succeed. Most procrastinate and say they will be ‘ready’ to begin tomorrow and thus it passed them by because fate waits for no one. You need to make yourself ready for the opportunity that something like AI provides. That comes with commitment and discipline as well as risk of course, but in my books it is a risk well worth taking because standing still is falling behind when it comes to technology. I have seen it before and the chances are that it will play out in a similar way. No one knows for certain but what you do for sure is give yourself the best chance of taking advantage of that opportunity through something as simple as education.

It seems clear that, like the cloud, AI will make the technology landscape a very different place in a few years. However, the question is, will you and your business still be the same as it is now? The answer to that, I would suggest, will determine your success.

Need to Know podcast–Episode 336

A final episode for 2024. Thanks all for listening in 2024. For this episode I thought I’d wrap up my thoughts on the previous AI episodes experiment as well a let you know how I use Ai currently I also have some resources that I suggest you dig into to give you a better understanding of where all this Ai hype may end up.

Brought to you by www.ciaopspatron.com

You can listen directly to this episode at:

https://ciaops.podbean.com/e/episode-336-thoughts-on-ai/

Subscribe via iTunes at:

https://itunes.apple.com/au/podcast/ciaops-need-to-know-podcasts/id406891445?mt=2

or Spotify:

https://open.spotify.com/show/7ejj00cOuw8977GnnE2lPb

Don’t forget to give the show a rating as well as send me any feedback or suggestions you may have for the show.

Resources

@directorcia

Join my shared channel

CIAOPS merch store

Become a CIAOPS Patron

CIAOPS Blog

CIAOPS Brief

CIAOPSLabs

Support CIAOPS

The Coming Wave: Technology, Power, and the Twenty-first Century’s Greatest Dilemma – Mustafa Suleyman, Michael Bhaskar

My Goodreads feed

Mustafa Suleyman on the coming wave of AI

What is Ai anyway?

Free Github Copilot

Create a Microsoft Licensing Agent

December Microsoft 365 Webinar resources

image

The slides from this month’s webinar are available at:

https://github.com/directorcia/general/blob/master/Presentations/Need%20to%20Know%20Webinars/202412.pdf

If you are not a CIAOPS patron you want to view or download a full copy of the video from the session you can do so here:

http://www.ciaopsacademy.com.au/p/need-to-know-webinars

Watch out for next month’s webinar.

Key Topics:
  • Introduction and Webinar Details: Robert welcomed participants to the December 2024 need-to-know webinar, acknowledged the holiday season, and provided information on accessing the recording and shared resources. He also mentioned the creation of a Teams shared channel for updates. 0:06

  • Microsoft 365 Updates: Robert discussed updates and new features coming to Microsoft 365, including enhancements to Copilot, the ability to add images from Copilot in Word and PowerPoint, and the importance of AI in various Microsoft services. 2:04

  • Intune and Security Updates: Robert highlighted improvements in Intune, including the deprecation of older admin templates in favor of the settings catalog, and the integration of AI in security features. 3:48

  • GitHub Copilot for VS Code: Robert announced that GitHub Copilot is now available for free for VS Code users, allowing them to write and understand code using AI. He recommended the commercial version for IT professionals. 4:31

  • Book Recommendation: Robert recommended the book “The Coming Wave” by Mustafa Suleyman, which provides a realistic overview of AI, including its challenges and threats. He also suggested watching Mustafa’s TED talk. 6:18

  • Copilot Overview: Robert provided an overview of Microsoft Copilot, explaining its integration with Microsoft 365 applications, its reliance on the Microsoft Graph, and its ability to assist with tasks such as meeting summaries, data analysis, and content creation. 7:43

  • Copilot Licensing and Dependencies: Robert explained the licensing requirements for Copilot, including the need for an annual commitment, and emphasized the importance of having underlying services like identity and security in place for Copilot to function effectively. 10:32

  • Copilot Studio: Robert introduced Copilot Studio, which allows organizations to customize Copilot for their specific needs, and demonstrated how to create and use custom agents within the Microsoft environment. 14:09

  • Copilot in Action: Robert demonstrated the use of Copilot in various applications, including Word and Teams, showing how it can generate content, summarize information, and assist with technical queries. 20:04

  • Admin and Security Considerations: Robert discussed the importance of having security and compliance measures in place before implementing Copilot, and highlighted tools like the Purview portal for managing data security posture. 35:54

  • Copilot Adoption and Usage: Robert emphasized the need for training and understanding how to use Copilot effectively, and provided insights into driving adoption and monitoring usage within an organization. 51:22

  • Conclusion and Q&A: Robert concluded the webinar by thanking participants, encouraging feedback, and wishing everyone a happy new year. He also mentioned the availability of the webinar recording and additional resources. 54:09