Month: November 2024

Posted on

Facilitator agent: Live AI notes in Teams meetings & chat

Microsoft announced at Ignite, the new Facilitator agent – an update to the AI notes in Teams that works inside your meetings and chat and is designed to enhance collaboration and streamline the way teams work. It works similar to the AI generated notes after a meeting, but this works live alongside you and all participants can see it working live in the meeting.

How Facilitator works in Teams Meetings

Facilitator will take real-time notes during Teams meetings (not currently adhoc meetings or Meet Now), enabling everyone to co-author and collaborate seamlessly. This allows meeting participants to focus and engage more deeply in meetings, while ensuring alignment before the meeting concludes.

To enable this feature and use it a meeting, organisers can toggle AI-generated notes setting on or off when setting up a meeting in the Teams calendar or enable it during the meeting via the Notes section in the meeting.

Once enabled, a notification appears in the meeting chat to inform all participants. This also activates meeting transcription, with a notification to users… During the meeting, participants can click on Notes to open a pane where the AI generated live notes are created every few minutes, organised by topics and follow-up tasks.

What is nice about this is that participants can edit the notes inline or assign tasks to users, with attributions indicating whether the content is AI-generated or user-edited making these Co authored notes by humans and AI!

After the meeting ends, notes continue to be accessible in the Recap tab and are stored in the OneDrive of the user who enabled real-time notes. These notes are contextual to the meeting transcript, ensuring relevance and accuracy.

Future Capabilities in Meetings

As the Facilitator agent gets developed futrther, Microsoft say that it will be able to take on more tasks to enhance meeting effectiveness. Soon, it will also manage meetings from end-to-end, including managing agendas, moderating discussions, and handling action items automatically or semi-automatically

In early 2025, the real-time note-taking experience will also expand to Microsoft Teams Rooms. Employees will be able to invite a Teams Room to a meeting, allowing all participants to see real-time notes however, they have joined the meeting. This feature will also be available for ad-hoc meetings, enabling in-office discussions to be captured seamlessly.

How Facilitator works in Teams Chats

As of now (November 2024), the Facilitator Agent creates and maintains up-to-date summaries of what it considers valuable information within Teams chats. This includes key decisions, action items, and open questions, helping groups stay focused, align faster, and resolve issues efficiently.

AI-generated notes are automatically enabled when creating a new chat. For existing chats, users can toggle it on via the Notes icon which is shown at the top right of the chat window as shown below.

When notes are enabled, a notification appears in the group chat to inform everyone that notes are being taken in real time.

To access the notes users simply click on the Notes icon in the top right corner of the chat to show a summary of the chat thread, organised by topics with corresponding decisions, action items, and unanswered questions.

These are continuously updated as the chat conversation progresses.

Availability and access

Facilitator is already in public preview now for desktop (Windows/Mac), web, and iOS/Android. To access the public preview of the new Facilitator agent, meeting hosts need a Microsoft 365 Copilot license.

Facilitator will only be available to users that have app permission policy for Microsoft apps set to “Allow all apps”. The Facilitator App will become available soon for Admins to see and manage in Teams admin center. For more information about app permission policies, see Manage app permission policies in Microsoft Teams – Microsoft Teams | Microsoft Learn

External users cannot access AI-generated notes

Let me know if you find this helpful

Posted on

Enhanced Data Protection and Governance coming SharePoint and Purview to remove AI adoption blockers.

This week at Microsoft Ignite 2024, Microsoft unveiled new features and controls for SharePoint and Purview, aimed at empowering IT teams and ensuring robust data protection and governance. These enhancements are part of Microsoft’s ongoing commitment to providing intelligent solutions that respect an organisations controls while driving productivity and efficiency. Oversharing of data is one of the most common causes of rogue data and poor data governance and one of the biggest blockers to wider AI adoption.

Microsoft offers two powerful tools to address this concern of oversharing: SharePoint Advanced Management for site management and content governance capabilities, and Microsoft Purview for security, compliance, and governance across data and files. Both have new capabilities and availability following announcements at Ignite in Chicago.

Advanced Management for SharePoint for Copilot.

To give IT teams even more control, Microsoft have said that SharePoint Advanced Management will be included at no additional charge for Copilot customers. There’s also need and updated features coming.

  • Restricted Content Discovery (RCD) to help identify and manage content that is restricted or sensitive, ensuring that such content is not overshared within the organisation. This works by allowing SharePoint Administrators to restrict specific SharePoint sites from participating in organisation wide search and Microsoft 365 Chat. Once configured, all content from the site will be hidden from tenant-wide search and Microsoft 365 Chat by default for all users in the tenant, even if a user has site access permissions. While child content will be hidden by default, users will still be able to search for content they have recently interacted with. This includes recently accessed and modified files, even if RCD is applied to the parent site. Searches originating from a site context will not be impacted.This will be available in Public Preview in December 2024 and Generally Available from March 2025
  • Restricted Access Control (RAC) feature allows administrators to control and restrict access to specific sites or content within SharePoint to helps in preventing unauthorised access and oversharing of sensitive information. New AI content governance controls and insights will be available in early 2025.
  • Deployment Blueprint is a new feature that will offers a structured approach to deploying Microsoft 365 Copilot while addressing the risks of information oversharing. It will include best practices, guidelines, and tools to ensure that sensitive information is protected during the deployment process.

SharePoint Advanced Management will be Generally available in Q1 2025 and will allow IT to better govern access and usage of Copilot and agents, including controls over which users can use Copilot and agents, along with visibility into agent status and life cycle.

SharePoint Advanced Management will be included as standard for organisations with Microsoft 365 Copilot licenses.

Purview

  • Data Loss Prevention – To provide addition protection, Microsoft Purview Data Loss Prevention (DLP) will soon be extended to support Microsoft 365 Copilot. DLP policies will be able to identify sensitive documents based on sensitivity labels and exclude processing for Copilot interactions in Microsoft 365 Copilot Business Chat. In preview from December.
  • Data Security Posture Management (DSPM) provides insights into the security posture of data within the organisation. It helps in identifying potential risks and vulnerabilities related to data oversharing and provides recommendations to mitigate these risks.
  • Risky AI Usage Detection is a new feature which can detect and alert admins about potentially risky usage of AI within the organization. It helps in preventing data leakage and unauthorised access by monitoring AI activities. This is now in public preview.
  • GenAI Risk Detections is another feature which focuses on detecting risks associated with the use of generative AI. It ensures that AI-generated content does not lead to oversharing of sensitive information or unauthorised access.

Measurement and Reporting with Copilot Analytics

To help IT and business leaders track adoption patterns and return on investment from the use of Copilot and agents, Microsoft is introducing Copilot Analytics.

This new feature includes out-of-the-box experiences to measure Copilot adoption and business impact, customisable reporting for deeper analysis.

The new Copilot Analytics. Microsoft Viva Insights will be included in Copilot at no additional charge as part of this new analytics suite.

How Microsoft partners can help

Cisilion, as your Copilot Jumpstart partner, will be incorporating these new features and controls into our guidance and briefing and expect Microsoft will rapidly be updating their official documentation and guidance.

The Copilot Pilot programme, entwines technical readiness with business guidance and comprehensive adoption and change management to ensures that your organisation receives the most up-to-date and comprehensive support in leveraging these advancements for optimal data protection and governance whilst putting these into practice for a smooth and measurable pilot.

Conclusion

These new controls and features are designed to provide IT teams with the tools they need to govern access, usage, and reporting while ensuring data protection and governance. Microsoft is committed to helping organisations leverage the power of AI to drive productivity, efficiency, and security.

You can read the official Microsoft Blogs here.

Posted on

Microsoft’s Copilot AI Agents enter Public Preview

TL;DR

Microsoft has introduced autonomous Copilot AI agents in public preview. These agents can learn, adapt, and make decisions, aiming to assist employees with various tasks and improve productivity. While AI has the potential to displace some jobs, it also creates new opportunities and enhances productivity.

Microsoft’s wave of Autonomous agents are here

Microsoft has unveiled new tools designed to help businesses create software agents powered by foundation models, referred to as autonomous Copilot AI agents. These agents are currently available in public preview.

Copilot is Microsoft’s generic term for all their AI-driven productivity workloads. Copilot is built upon the advanced GPT-4 series of large language models by OpenAI and offers a chatbot interface where users can input text, images, or audio prompts to receive responses tailored to their needs. Microsoft 365 Copilot also seamlessly integrates with Microsoft Office applications like Word, Teams, and Excel. It can generate documents, analyse extensive Excel spreadsheets, summarise meetings content, rewrite documents, create entire PowerPoint presentations and even reason over your inbox and company information you have access too….., and much, much more.

The next step in Microsoft 365 Copilot’s advancement is through what are termed AI-Agents, which are chat bots that can not only respond but can also perform a series of linked tasks (actions) based on user instructions. This new wave went into public preview this week at Microsoft Ignite in Chicago.

What are Microsoft 365 Copilot Agents?

This first stage of the next phase of evolution comes with Microsoft introducing a set of Microsoft 365 Copilot agents with predefined roles. These include:

  • Agents in SharePoint. These can be customers with a personalised name and certain behaviours, and can be shared across emails, meetings and chats, with users being able to ask the agents questions and getting real-time responses. These are grounded just on the SharePoint sites and files you specify. One created, employees can ask the agents questions about data across your files. These agents can even be shared or published in Teams for simple access.
  • The Employee Self-Service Agent in Microsoft 365 Copilot Business Chat (this currently in private preview), will be able to respond to specific HR and IT questions. It can retrieve employee benefits and even things like payroll info and holiday information, or request help from IT such as a new mouse, password reset etc.
  • The Facilitator agent (in public preview), works like a assistant in meetings and goes beyond the current AI notes that Teams Premium offers. It can take notes, curate actions and even pull up information or execute instructions such as “see if Bob is free and invite him to the meeting”. It will also be able to summarise the conversations based on the role of the participants.
  • The Interpreter agent (due in preview in early  2025) promises real-time interpretation in Teams meetings in up to nine languages. It will also be able to sample and then simulate their personal voice for a more inclusive experience as part of the translation, essentially using the sound of your voice in the language of the other participants. It was great to see this in action at ignite in a live demo!
  • The Project Manager agent, will be able to act and work like a PM with the ability to automate project management, from planning to execution using Microsoft (and later other) project tools like Planner.

For organisations that need more control or different templates to build on and use, Microsoft Copilot Studio provides a way to customise or create your own AI agent behaviour.

Agents in Copilot Studio

Agents built in Copilot Studio can operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention,These autonomous agents can be triggered by data changes, events, and other background tasks – and not just through chat.

Copilot Studio bundles many templates for common agent scenarios that can serve as the basis for a customised version. It will also shortly support voice-enabled agents, image uploading (for analysis by GPT-4o), and knowledge tuning with the added ability automatically add new sources of knowledge to help agents respond to questions.

Devs can use the Agent SDK to access services from Azure AI, Semantic Kernel, and Copilot Studio. There’s also an Azure AI Foundry (also launched at Ignite) integration that links Copilot Studio to facilitate connection to services like Azure AI Search and the Azure AI model catalog.

Finally, a public preview of agent builder in Power Apps was also announced at Ignite.

What about Responsible AI?

Sarah Bird, chief product officer for Responsible AI, wrote in a blog post this week that extra safety considerations arise with autonomous agents and that Microsoft is focused on ensuring that they behave and hand over to human before taking unexpected actions which can have big impacts and that extra guard rails and protections will be put in place.

The blog post talks about examples of such measures including the vital need for a human-in-the-loop check to make sure autonomous decision-making doesn’t do things it’s not expected too. Nothing demonstrates confidence in automation more than a human approval process.

Microsoft also suggest that anyone looking to get a sense of AI agents in a real role, can try out the  Linked In Hiring Assistant which is designed to help HR hiring teams speed up the process of dealing with the Admin involved in reviewing  job applications.

Key Benefits

The key Benefits these new adaptions to Copilot. Agents should bring to users and organisations includes:

  • Learning and Adaptation: The Copilot AI agents can learn from their environment and adapt to new information and tasks.
  • Decision-Making: These agents are capable of making decisions to assist users in their daily work.
  • Productivity Enhancement: The primary goal is to empower employees by reducing workload and improving efficiency in tasks such as managing meetings, emails, and creating presentations.
  • Automation of some tasks connected to regular and recurring inquiries or asks.

Human Impact – what about jobs!

The introduction of AI and automation, including Microsoft’s Copilot AI agents, has the potential to impact the roles of people in jobs.

  • Job Displacement: People naturally worry that AI has the potential to replace certain jobs, particularly those involving repetitive and manual tasks. According to a report by Goldman Sachs, AI could replace the equivalent of 300 million full-time jobs….. But.
  • Job Creation: On the other hand, AI also creates new job opportunities. It can lead to the emergence of new roles that require advanced technical skills and the ability to work with AI systems
  • Economic Impact: AI is expected to contribute significantly to global economic growth. McKinsey Global Institute estimates that AI could deliver additional global economic activity of around $13 trillion by 2030
  • Skill Demand: The demand for skills will shift towards more advanced and technical capabilities. Employees will need to upskill and reskill to stay relevant in the evolving job market. AI skills will be similar requirement to the “Internet skills” we saw on CVs in the 1990s!

Conclusion

Microsoft’s autonomous Copilot AI agents represent a significant step towards integrating advanced AI into everyday business operations. By enhancing productivity and reducing routine workload, these agents have the potential to transform how employees manage their tasks.

These will be in public preview very soon as these often take a few weeks to rollout across the globe.

Source: Conversation with Copilot, 22/11/2024
(1) How Will Artificial Intelligence Affect Jobs 2024-2030. https://www.nexford.edu/insights/how-will-ai-affect-jobs.

(3) The impact of AI on jobs – GOV.UK. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1023590/impact-of-ai-on-jobs.pdf.

Posted on

What is Windows 365 Link?

At Microsoft Ignite 2024, Microsoft announced Windows 365 Link to address the need to provide zero touch, secure, lightweight “thin client” device capable of running critical Windows workloads in the Cloud while enhancing security and flexibility,

Windows 365 Link represents the first move by Microsoft into the hardware space with a dedicated new class of devices purpose-built to connect securely to Windows 365 in seconds.

Yes, essentially a Thin Client device yes, Windows 365 Link, offers a simple, secure, purpose-built device for Windows 365, which will instantly book (using Windows 365 on a dedicated Windows 11 (light) device which boots instantly to the Windows 365 desktop.

The device is tuned and built to to provide responsive, high-fidelity experiences and will be available from April 2025 for around $349 RRP.

Windows 365 Link device is a compact, fanless and lightweight device. When powered up it boots in seconds, and provides modern power management including instant wake and localised processing for high-fidelity experiences, such as Microsoft Teams meetings and Webex by Cisco, helping users make the most of productive time.

Design and Build.

The device is built with 90% post-consumer recycled aluminum alloy in its top shield, 100% pre-consumer recycled aluminum alloy in its bottom plate, and its motherboard contains 100% recycled copper and 96% recycled tin solder. It also has 100% paper-based packaging, is ENERGY STAR®-certified device, with super low energy consumption.

Windows 365 Link has a fanless design, with the ability to boot quickly and wake instantly from sleep, according to the company.

There’s no local data storage, and no admin privileges for users. The device supports dual 4K monitors, with four USB ports, an audio port, an Ethernet port, Wi-Fi 6E, and Bluetooth 5.3.and supports any Windows certified wired and wireless peripherals including webcams.,

Windows 365 Link

Windows 365 Link is designed to be long-lasting with no moving parts, not even a fan—hence reducing the need for frequent replacements.

Secure By Design

Windows 365 Link is secure by design. The device stores no local, runs no local apps and has no local admin access. All corporate data will stay protected within the Microsoft Cloud under the Windows Cloud PC environment. The devices also ship with security baseline policies enabled by default and security features cannot be turned off or disabled.

Firmware and device updates are managed by Microsoft and the devices cannot be side-loaded or bypassed since they leverage the same secure by design principlans protecting Microsoft first devices like Surface.

Windows 365 Link supports DCFI, password less authentication using Microsoft Entra ID and the Microsoft Authenticator app or USB security keys.

Windows 365 Link Management

The device is managed via Intune ensuring a coherent and consistent management for IT. Windows 365 Link is designed to be long-lasting and can be remotely deployed and factory reset remotely in minutes, making it easy to reuse, secure and scalable.

The devices default to having a name starting with WCPC (for Windows CPC), and you can easily find them by looking for devices where the SKU family is WCPC. Windows 365 Link also automatically stays up to date: it downloads updates in the background and will apply them overnight when the device is not in use.

Posted on

AI agents are transforming Customer interactions.

AI and human Agent

In our recent fireside chat, we delved into the transformative potential of AI agents across multiple industries. These business areas include customer service, IT support, and internal business support. The discussion, titled “Rise of the AI Agents,” brought together industry experts across several fields. These included transportation, public sector, legal, media, and executive search. The panel explored how AI is reshaping customer and consumer interactions and discussed enhancing efficiency and driving more inclusive interactions.

Introduction to AI Agents

We kicked off the session our fireside chat by setting the scene. We highlighted the traditional challenges faced in contact centers. These include long hold times and inefficient call transfers between chat bots and human agents. Here we agreed on these and but also the importance of not just jumping on “injecting ChatGPT” into workflows, but instead discussed the advent and value of generative AI and human-like conversation across chat and AI-Voice and how these rapid technology advancements have the potential to revolutionise these experiences.

AI agents, leveraging large language models like, are now capable of understanding context, handling a wide range of queries, and providing personalized responses and we are seeing Contact Center solutions such as Cisco Webex, starting to infuse this technology to assist end-to-end in the Human-to AI, Human-to-AI-to-Human, and Human-to-Human conversation.

AI agents leverage advanced technologies like large language models (LLMs) and machine learning to provide more dynamic and context-aware interactions. AI agents can understand and generate natural language. This ability allows them to handle a wider range of queries. They also provide more personalised responses. They can learn from data and feedback, improving their performance over time without needing manual updates.

AI agents can also integrate with various data sources and systems, enabling them to provide more comprehensive and accurate information.

  • Autonomous Agents can operate entirely independently, without human intervention. They can handle multi-step tasks, make decisions based on pre-programmed logic, and adapt to new situations using advanced AI techniques like reinforcement learning. These agents are ideal for environments where human input is minimal or impractical.
  • Semi-Autonomous Agents on the other hand, still involve a “human in the loop.” While they can perform many tasks independently, they require human input for certain decisions or actions. This hybrid approach combines the efficiency of automation with the oversight of human expertise, ensuring accuracy and reliability.

The example below is a recent marketing video from Cisco introducing their new AI agent in Webex Contact Centre.

AI Agent example in Cisco Webex Contact Centre

AI Agent – Use Cases

Through the discussion, the panel agreed on several key areas in which AI assisted agents could add value.

  • Customer Support: Investing (or extending existing platform) in AI agents can help multiple lines of business better and more efficiently handle routine customer inquiries, such as changing addresses, booking or changing appointments, and freeing up human agents to work on less trivial customer requests or more complex issues. 
  • Sales Assistance: Another area discussed, was where AI can assist human agents (for example in sales or customer service), by providing real-time information and suggestions during human customer interactions, improving the chances of successful sales conversations, such as overcoming objections or asking for more technical information about a product or service.
  • Customer Service and Complaints: helping agents improve their interaction with their customers, such as making agents aware of similar problems, outages or similar calls that led to successful outcomes or helping explain something better or in a different way to their customer.
  • Training and Development: AI can be used to train new agents by simulating customer interactions and providing feedback, helping them improve their skills more quickly. This can be used for onboarding fresh staff, running different customer scenarios or reviewing previous calls for improvement
  • Sentiment Analysis: Using AI to analyse customer sentiment during interactions, allowing agents to adjust their approach and improve customer satisfaction as well as flagging to supervisors early where interaction or training may be needed.

AI Agent Value and Applications

Driving efficiency and improving satisfaction

Darren Everden (London Borough of Hillingdon) shared his insights on how local authorities are looking at utilising AI to improve resident interactions. David emphasised the importance of channel shift and transformation in the public sector, driven by funding reductions and the need for more cost-effective solutions that also improve the resident experience and resolution rate. Darren highlighted the evolution of chatbots, which can now use natural language processing to understand and respond to resident queries more effectively. He also discussed the potential of integrating AI into voice channels, enhancing accessibility and providing a more natural interaction experience making it almost impossible to differentiate from human voice. Interactions are far more natural than ever, and this continues to evolve and improve with models such as ChatGPT-4o.

Inclusivity and Accessibility

Ken Dickie from Leathwaite Executive Search, discussed the role of AI in promoting and improving inclusivity and accessibility. He pointed out that AI agents are far better at being able to adapt to the needs of users with disabilities, such as dyslexia, by adjusting text spacing or providing audio responses something human only operated agents simply cannot easily do This real-time adaptability empowers individuals to engage with systems more effectively. Ken also mentioned the global reach of AI, enabling organisations to provide support in multiple languages, thus breaking down communication barriers.

Enhancing Agent Efficiency

Aidan Shanahan from Govia Thameslink Railway discussed the benefits of AI in assisting human agents. He discussed his view on where AI can provide real-time guidance and sentiment analysis, helping agents handle customer interactions more effectively. The panel here discussed the role AI as an human assistant (An Agent to the Agent) being particularly valuable in high-stress situations, such as handling complaints, where AI can suggest appropriate responses based on the customer’s tone. Aidan also highlighted the potential for AI to improve internal processes, such as IT support, by automating routine tasks and reducing response times, replacing laboreous processes with natural language requests.

Jas Bassi from Gately highlighted the potential applications of AI in the legal sector. While acknowledging the generational differences in adopting new technologies, Jas emphasized the need for a multi-channel approach that includes both human and AI interactions. He pointed out that AI can deliver efficiency gains in transactional activities, ensuring faster and more consistent service delivery. However, he also raised concerns about biases in AI training and the risk of deep fakes, underscoring the importance of maintaining a balance between automation and human oversight.

Low cost of entry and ease of Proof of Concept

Alex Taylor from Awin shared his experience with implementing AI agents internally at Awin. He mentioned that this is no longer about one off business cases and specific dictated expensive systems. He shared that he is seeing huge interest in the use of AI agents across various departments, such as InfoSec and marketing, in leveraging AI to not only automate and ease customer interactions but also going beyond this and automating processes and improving efficiency. He emphasised the importance of extending this value by connecting backend systems (which also involved in many cases minimising diserpate vendrs) and ensuring they are “compatible” to maximize their effectiveness with automation and semi-automatic interactions. He realised examples, of automatically logging tickets, providing simple answers to issues and even liaising with other systems or processes.

Finally Alex and Ken agreed that the bar to entry is much lower, with a similar approach,. bring able to serve multiple departments, handle thousands of enquiries and not only reduce the cost, but truely delivery faster, more inclusive and international support even for organisations that don’t have global offices.

Conclusion: The Value and Opportunities of AI Agents

Our fireside chat concluded that there were several key value points when it comes to the use and exploration of AI agents across customer and employee focused formal contact centers but also across more adhoc and internal communications within and across business, from website chat to internal IT support.

  • Enhanced Customer Interaction: AI agents can provide more efficient and personalized customer service, reducing wait times and improving satisfaction
  • Cost-Effective Solutions: The low cost of entry and easy of deployment (compared to the previous laborious process of programming conversational paths), enables organisations to handle a higher volume of interactions without significantly increasing costs, making it a viable option for sectors with budget constraints and most importantly without a huge development and support burden.
  • Inclusivity and Accessibility: AI agents can adapt to the needs of diverse user groups, promoting inclusivity and breaking down language barriers both with end customers and with human-agents.
  • Supporting the Human Agents: AI assists can act as a huge support for human agents by providing real-time guidance, sentiment analysis, and automating routine tasks, enhancing overall efficiency and can even help handle delicate situations, detect agent stress and suggest rest-bites and training to supervisors based on AI assisted analysis.
  • Internal Process Optimisation: Used effectively, this can extend way beyond the conversation, streamlining internal workflows, reducing response times and improving productivity across various departments.

Missed the fireside chat? Catch up on demand here

Posted on

Creating a Copilot Agent from a SharePoint Library

The new Agent Builder in SharePoint is designed to help people use and share Copilot Agents to query sibsets of data within your organistion using a simple click, point, create and tweak approach. Out of the box every SharePoint site (assuming you have a Copilot license) brings a Copilot sidebar allowing you to ask questions about the content, but you can also replace this with a custom Copilot Agent which we will walk through here.

The goal is to enable business users to easily empower their employees use Copilot to reason over specific information sources or across discrete repositories. Microsoft provide a handful of “use cases” as why a Copilot agent might be useful and what’s great is that “anyone” can create one!

Image – Microsoft Copilot Adoption Hub

Once created and tested, these custom Copilot Agents can be easily shared via a simple hyperlink that can be embedded in SharePoint pages or used in Teams.

In this how to blog, I walk you through the setup and customisation of a Copilot Agent using Agent Builder in SharePoint, customising of the agent, and sharing of the agent. Free to follow along and create your own agent.

Copilot agents are specialised AI assistants designed to enhance the capabilities of Microsoft 365 Copilot by connecting to your organisation’s knowledge and data sources. They are custom tools embedded in Copilot Extensions, providing additional functionalities tailored to specific needs. In SharePoint, Copilot agents are natural language AI assistants that give trusted, precise answers and insights. Agents are expert systems that operate autonomously on behalf of a process or company.

Building your First Copilot Agent

Step 1 – Choose your starting point.

First, you need to navigate to a SharePoint site, library or document library you want to create an “agent” from. You will of couse need to have access to that Library and also need a Microsoft 365 Copilot license to create the agent.

From here, you can select the three dots and choose “Create a Copilot agent“

Step 2 – Click and you are done!

Done (well – you will probably want to customise it and test it), but once you do this, your Copilot Agent is created for you. Click “Edit” to make changes, such as change the name, and then of course test it out.

Step 3 – Edit and Customise

Here I have clicked “Edit” to take me to the customisation pages. From here you can toggle across different options to customise your Copilot agent.

The customisation pages are split into three sections – Idenitity, Sources and Bebaviour – each of these allow you to tweak the way the agent works. There’s also the ability to edit for advanced customisation through Copilot Studio but this feature is not available at time of writing…

In the Identity Section – you can change the name, icon and description (who the agent introduces itself to the user)

In the Sources Section – you can modify the sources that the Copilot Agent uses. You can add additonal SharePoint sites, individual files or extenal sources such as websites.

In most cases, I suspect you will want to use a single library or a discrete set of files, but you can add up to 20 different information sources. These 20 information sources can be mean sites, libraries, folders, or documents. What’s more, you can have a combination of these as long as the total is 20 sources – for example, you could add 20 sites or 20 documents, or 3 sites, 5 document libraries, 2 libraries and 10 descrete files as long the total sources totals 20.

Note: You of course need to ensure that the intended users of the agent have access to the sources your specify as agents run under the security context of the user using the agent.

In the Behaviour Section, you can customise the welcome message which will help your users to understand the purpose of this Copilot agent and can also edit or change the starter prompts to help users get some tips on some of the things the agent can do for them. You can also give the agent specific instructions on how it should respond and behave based on the user input.

As you update the behviour, you will see the changes in real-time.

Testing your Copilot Agent

Once you are ready, you can test your agent, simply writing a prompt in the chat dialog as you would with any other Copilot – feel free to try one of the templates or create your own.

Be sure to test a few things, you might find you need to update the user instructions and review the sources before you share it with other people to test further.

Once you are happy with your agent, click save. The agent is saved a “file” with a .copilot extension in the root of the SharePoint folder you started creating your agent in.

Using your Copilot agent

Once saved, your new Copilot Agent launches automatically for any user accessing the SharePoint library that has a Microsoft 365 Copilot license. This replaces the default copilot interface that opens when you visit a SharePoint library.

Sharing your Copilot agent

Since the Agent is encapsulated as a manifest “.copilot” file, you can simply share the file like you would any other file, or click the three dots and select share.

Once shared, they click on the file and open it and it displays like a standalone app or can of course access it from the SharePoint library directly.

[Current] Limitations

  1. Currently Custom agents do not appear on the main Copilot Business Chat pages, though this is coming I beleive. On the FAQ on Microsoft’s support page it clearly states that “You can access a Copilot agent from a SharePoint site, page, or document library. You can also use it in Teams if added. We plan to make it available across Microsoft 365, including Microsoft Copilot.” https://support.microsoft.com/en-us/office/get-started-with-copilot-agents-in-sharepoint-69e2faf9-2c1e-4baa-8305-23e625021bcf.
  2. Advanced editing with Copilot Studio is not currently available, but is also coming soon.
  3. It’s not possible to “hide” the .copilot file (that I can see anyway), so make sure to change permissions on the file.

Let me know how you get on….

Posted on

Copilot Vision: A New Era of AI Assistance or a step too far?

Microsoft is about to add more capabilities to the consumber version of Copilot including a new way we interact with it Copilot through its latest feature, Copilot Vision.

Is this a privacy step to far? or is this simply leveraging the power of vision to bring new experience and assistance to users.

Designed to enhance the capabilities of Microsoft’s Copilot AI assistant by allowing it to see and understand the same content as the the user is seeing on scene is said to bring a new dimension to how we work with AI tools.

Copilot Vision – image (c) Microsoft

What is Copilot Vision?

Copilot Vision is an extension of Microsoft’s Copilot AI assistant that enables it to visually perceive the content on your screen. Whether you’re browsing websites, reading documents, or viewing images, Copilot Vision can interpret and respond to the visual data, making it a more intuitive and helpful assistant.

Examples of Copilot Vision in Action

  • Travel Planning: Instead of manually searching for travel options, Copilot Vision can provide recommendations and answer questions based on the travel websites you’re viewing.
  • Recipe Adjustments: If you’re looking at a recipe online and want to make substitutions, Copilot Vision can suggest alternatives and cooking tips without needing to switch tabs or open a new search.
  • Document Assistance: While working on a document, Copilot Vision can offer suggestions, corrections, and additional information relevant to the content you’re editing.

All this happens without you having to copy and paste stuff to the Copilot chat interface so it’s really like having eyes on what you are doing (once turned on of course). It’s like having your assistant working and viewing with you so it can see exactly what you see on your screen, whether it’s a website or a document.

Copilot Vision.

That’s what Copilot Vision does. It can read both typed and handwritten text displayed on your screen, and it responds to what it sees, offering answers to your questions and suggesting next steps.

Privacy Consideration

Microsoft has emphased that privacy is a top priority with Copilot Vision. The data processed by Copilot Vision is not saved or used beyond the current session (like clearing the cache). Microsoft Copilot Vision will initially also be limited to certain popular websites that meet Microsoft’s security standards, ensuring a safe and secure user experience. It also won’t work on sites that contain sensitive data such as banking sites.

Remember, this is something you can choose to use or not, so you can turn it off!

Rollout Timeline

Microsoft say that after a successful trial period with a select group of users in the Copilot Labs experiment hub, Copilot Vision is “now ready” for a broader rollout.

The feature will soon be integrated into the Microsoft Edge browser, accessible via a screen-like icon. This phased rollout will allow Microsoft to gather more feedback and ensure a smooth user experience.

Posted on

Recall “Recalled” Again: Microsoft’s Copilot+PC Flagship Feature Faces Further Delays

Recall Recalled again feature image

In a move that has surprised few, Microsoft has once again delayed the rollout of its controversial Recall feature for Copilot AI PCs. Initially planned for a June release to coincide with the new Copilot+PCs launch, Recall was then postponed to October while Microsoft addressed initial concerns around privacy and security.

This week however, Microsoft has yet again delayed this again with testing for Windows Insiders coming (so we are told) in December, which unfortunately falls after Ignite.

Microsoft Recall….

Security Concerns and Refinements

Recall’s primary value is to create a timeline of screenshots that users can scroll through and search. However, early testing revealed by security researchers discovered that the core database storing these screenshots and tagging was not encrypted, posing a massive security risk.

Microsoft have since addressed this by fully encrypting the database and requiring Windows Hello authentication for access.

Microsoft have also confirmed that Recall will now be an opt-in feature, allowing users to completely uninstall it if they choose.

Microsoft’s Cautious Approach

Brandon LeBlanc, senior product manager of Windows, enforced Microsoft’s commitment to delivering a secure and trusted experience with Recall.

Microsoft need to get this right in order to maintain trust with its customer base. He stated that the additional time is necessary to refine the feature before previewing it with Windows Insiders. Despite these assurances, social media shows huge skepticism about whether Microsoft will meet the new December deadline and even if they might scrap the feature all together. This will be a shame, as the value around it looks. Promising and is really ( currently) the one killer reason consumers were looking at when looking at investing in Copilot+ PCs outside of the huge battery life that these Qualcomm Snapdragon Powered devices deliver.

The verge covered this in an exclusive interview

Wider AI privacy concerns

The repeated delays and security issues surrounding Recall highlight broader concerns within the AI industry.

There is a growing perception that companies are rushing to release new features without fully considering the potential consequences.

Microsoft’s cautious approach with Recall is a step in the right direction, but it also underscores the need for more rigorous testing and security measures in AI development.

Will Recall still be exclusive to Copilot+ PCs?

That’s a good question.

When Microsoft announced the Copilot+PC back in June, Recall was the flagship feature and it was unique to the device’s (and kinda stole the show).

Since then AMD and Intel have released their new AI PC chipsets offering similar NPU performance to the Snapdragon chips in Copilot+ PCs like Surface Pro 11 and Surface Laptop 7.

We now have NPU turbocharged PCs with Snapdragon® X Series, AMD Ryzen™ AI 300 Series and Intel® Core™ Ultra 200V Series devices after all.

We don’t know if this will remain an exclusive (I don’t see why it would) and if all the “exclusive AI features” that are part of Windows 11 24H2 will soon be lit up in any decide with a dedicated NPU.

From what I can… It will be supported… But some features are limited to Snapdragon, so we will have to wait and see….

Coming soon then… Or will it?

While the future of Recall still remains uncertain, Microsoft’s efforts to address security concerns and refine the feature are commendable, I just hope they haven’t missed the boat. We’ve already seen Apple quietly move forward with Apple Intelligence (clever) and it’s now embedded in MacOS. Microsoft need to move quick and innovate here to regain confidence and innovative is their mission to empower every person on the planet to achieve more (with their technology)!

Consumers, IT professionals, industry experts and social media will be keenly observing whether the Recall gets the release and value reputation it received back in June, with  a secure and functional version of Recall to define what AI can really do in Windows.

I hope succeeds and brings life to the new AI PCs and Copilot+PCs or of it quietly gets canceled as skeptics seem to think…

Posted on

Windows Hello is getting a much welcomed face-lift

Microsoft is taking a significant step forward in enhancing the Windows Hello experience on Windows 11. This overhaul, now in beta testing for Windows Insiders will bring a more intuitive and visually appealing interface for both facial, passkeys and fingerprint recognition.

New Windows Hello experience on Windows 11

Cleaner, More Intuitive UI

The revamped Windows Hello UI is designed to streamline the authentication process. Users will notice new iconography and visual changes that make switching between authentication options more intuitive. Whether you’re logging into your device or using passkeys for websites and apps, the experience is now more seamless and user-friendly.

Enhanced Passkey Integration

One of the standout features of this update is the improved passkey integration.

New passkey process in testing on Windows 11

Previously, using passkeys from a mobile device involved scanning QR codes and navigating an outdated UI. The new system simplifies this process, allowing for quicker and more secure authentication. Additionally, Microsoft has also introduced a new API for third-party password and passkey managers, enabling developers to integrate directly with the Windows Hello experience.

Future-Proofing Authentication

This update is not just about aesthetics; it’s about future-proofing authentication on Windows 11.

By supporting passkeys from mobile devices and enabling synchronization with third-party apps, Microsoft is ensuring that users have a secure and efficient way to manage their credentials and also allows them to be seemlessly and securely added to your Microsoft Account.

We redesigned Windows security credential user experiences for passkey creating a cleaner experience that supports secured and quick authentication.. Users will now be able to switch between authentication options and select passkey / devices more intuitively.

Microsoft Windows Team

Microsoft Windows team talk more about in their recent Windows Insider Blog.

Availability and Rollout

Currently available to Windows Insiders in the beta channel, and will hopefully hit testers on the other Insider channels soon. This new Windows Hello experience is expected to roll out to all Windows 11 users in the coming months.

Are you looking forward to seeing new Windows Hello UI?

Posted on

The Cost of Not Migrating to Windows 11

As Microsoft prepares to end support for Windows 10 on October 14, 2025, users have a critical decision to make. They must either migrate to Windows 11 or pay for extended security updates (ESU). Microsoft will offer distinct options for consumer (home) customers. They will also offer options for commercial customers who want or need to continue using Windows 10 after this date.

Consumer Pricing for ESU

We know that commercial enterprises were going to have the “cost” option of paying for extended updates while they “complete” they migration / move to Windows 11, but in the first time in history, Microsoft have also announced that consumers can will also have the option to purchase a single year of Extended Security Updates (ESU) for a one off $30 (£25) cost.

Commercial Pricing for ESU

Pricing to commercial customers will be based on tiered pricing options with pricing set-out at

  • $61 per device per year for the first year
  • $122 per device for the second year, and
  • $244 per device for the third year.

Organisations needed or wishing to pay for ESU for their devices for 3 years will therefore incur costs of $427 per device.

Extended Security Updates: A Temporary Solution

Microsoft’s ESU program will provide a lifeline in helping any organisation or consumer unable or unwilling to upgrade to Windows 11 before October 14th, 2025, (when Windows 10 enters end of support).

Bear in mind though that these ESU updates are just security and zero-day updates. There will be no new features, bug fixes, or technical support included.

These are, of course, optional, but there are huge risks for continuing to use Windows 10 devices without protection from security exploits or newly discovered vulnerabilities.

This is especially true for commercial organisations. They lack protection from security and vulnerability updates.

The Risks of Running an Unsupported OS

Running an operating system without security updates poses significant risks, both for consumers and businesses including:

  • Increased Vulnerability to Cyber Attacks: Without regular security patches, systems become prime targets for hackers. Vulnerabilities that are discovered post-support will remain unpatched, leaving systems exposed to malware, ransomware, and other cyber threats.
  • Compliance Issues: For businesses, using unsupported software can lead to non-compliance with industry regulations. It can also lead to non-compliance with standards. This may result in hefty fines and legal repercussions. This can also affect security certifications. These include Cyber Security and Cyber Security Plus. It also impacts trust from customers and business partners.
  • Operational Disruptions: Security breaches can cause significant downtime, disrupting business operations and leading to financial losses. For consumers, this could mean losing access to important personal data and services.
  • Higher Long-Term Costs: While the initial cost of ESU might seem manageable, the long-term financial impact of a security breach can be devastating.

The best approach is to start planning the move to Windows 11 now. There are just over eleven months to do this. For consumers, this could mean upgrading. It could also mean replacing their devices with ones capable of running Windows 11. Windows 11 was released and started shipping on new devices in 2021.

Will my device run Windows 11?

Microsoft have a useful website which show the minimum system specifications for Windows 11 which you can access –> here <-

In reality any device newer that 4-5 years old should have no problem running Windows 11, , but in short, you need a device with at least:

  • Processor: 1 GHz or faster and min of 2 core.
  • RAM: 4 GB or more.
  • Storage: 64 GB or larger storage device / HDD / SDRAM – you’ll much more in reality.
  • System Firmware: UEFI, Secure Boot capable.
  • TPM: Trusted Platform Module (TPM) version 2.0. (this is important)
  • Graphics Card: Compatible with DirectX 12 or later with WDDM 2.0 driver.
  • Display: High definition (720p) – must be greater than 9” diagonally.

Tools to check compatibility

Another really easy way to check your device (if you are a consumer of want to check a couple of devices) is to the use the PC HealthCheck App. This can be downloaded from https://aka.ms/GetPCHealthCheckApp if it’s not already installed on your Windows 10 device.

When you run the tool, you get one of three outcomes. If you device passes, you’ll see a “meets requirements” message, and if it fails, you’ll receive a “doesn’t currently meet”. Coprate devices may see a message stating that “your organisation manages updates” and as such check with IT department (though I suspect they are already on it!)

Commercial Customers IT departments can easily check Windows 11 eligibility using Microsoft Intune or System Centre.

Conclusion

The decision to stick with Windows 10 and not migrate to Windows 11 should not be taken lightly. While ESU provides a temporary solution, the risks associated with running an unsupported OS far outweigh the benefits.

The risks of not updating (or paying for extended security updates) are too high. It is only acceptable if your device is never connected to the internet. Additionally, you should avoid using external sources such as USB devices.

Upgrading to Windows 11 ensures continued security. It also provides access to the latest features and support. This makes it a wise investment for both consumers and businesses.

Q&A

  1. What about my anti-virus applications? In reality these will still work as will any application you are running on your machine. You will need to check with the antivirus provider to check that they will still support Windows 10, but as long as they do and you pay the subscription to them, it shouldn’t impact these anti-virus signature updates.
  2. What about other software like Office Apps? Well Office 2016 and Office 2019 also go end of support in October 2025. You’ll need to upgrade these too if you want to get feature updates and security updates and fixes. You will likely find other software vendors like Adobe will also stop supporting Windows 10 (as many did with Windows 7). You’ll need to check with the software provider.
  3. Can I upgrade the hardware in my device to get compliant? That is also an option. After running the compatibility checker, you may find that upgrading your hard drive, adding more memory or swapping other components may “get your device compliant”. In most cases this isn’t cost effective.

Proudly powered by WordPress