TL;DR
Microsoft has introduced autonomous Copilot AI agents in public preview. These agents can learn, adapt, and make decisions, aiming to assist employees with various tasks and improve productivity. While AI has the potential to displace some jobs, it also creates new opportunities and enhances productivity.
Microsoft’s wave of Autonomous agents are here
Microsoft has unveiled new tools designed to help businesses create software agents powered by foundation models, referred to as autonomous Copilot AI agents. These agents are currently available in public preview.
Copilot is Microsoft’s generic term for all their AI-driven productivity workloads. Copilot is built upon the advanced GPT-4 series of large language models by OpenAI and offers a chatbot interface where users can input text, images, or audio prompts to receive responses tailored to their needs. Microsoft 365 Copilot also seamlessly integrates with Microsoft Office applications like Word, Teams, and Excel. It can generate documents, analyse extensive Excel spreadsheets, summarise meetings content, rewrite documents, create entire PowerPoint presentations and even reason over your inbox and company information you have access too….., and much, much more.
The next step in Microsoft 365 Copilot’s advancement is through what are termed AI-Agents, which are chat bots that can not only respond but can also perform a series of linked tasks (actions) based on user instructions. This new wave went into public preview this week at Microsoft Ignite in Chicago.
What are Microsoft 365 Copilot Agents?
This first stage of the next phase of evolution comes with Microsoft introducing a set of Microsoft 365 Copilot agents with predefined roles. These include:
- Agents in SharePoint. These can be customers with a personalised name and certain behaviours, and can be shared across emails, meetings and chats, with users being able to ask the agents questions and getting real-time responses. These are grounded just on the SharePoint sites and files you specify. One created, employees can ask the agents questions about data across your files. These agents can even be shared or published in Teams for simple access.
- The Employee Self-Service Agent in Microsoft 365 Copilot Business Chat (this currently in private preview), will be able to respond to specific HR and IT questions. It can retrieve employee benefits and even things like payroll info and holiday information, or request help from IT such as a new mouse, password reset etc.
- The Facilitator agent (in public preview), works like a assistant in meetings and goes beyond the current AI notes that Teams Premium offers. It can take notes, curate actions and even pull up information or execute instructions such as “see if Bob is free and invite him to the meeting”. It will also be able to summarise the conversations based on the role of the participants.
- The Interpreter agent (due in preview in early 2025) promises real-time interpretation in Teams meetings in up to nine languages. It will also be able to sample and then simulate their personal voice for a more inclusive experience as part of the translation, essentially using the sound of your voice in the language of the other participants. It was great to see this in action at ignite in a live demo!
- The Project Manager agent, will be able to act and work like a PM with the ability to automate project management, from planning to execution using Microsoft (and later other) project tools like Planner.
For organisations that need more control or different templates to build on and use, Microsoft Copilot Studio provides a way to customise or create your own AI agent behaviour.
Agents in Copilot Studio
Agents built in Copilot Studio can operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention,These autonomous agents can be triggered by data changes, events, and other background tasks – and not just through chat.
Copilot Studio bundles many templates for common agent scenarios that can serve as the basis for a customised version. It will also shortly support voice-enabled agents, image uploading (for analysis by GPT-4o), and knowledge tuning with the added ability automatically add new sources of knowledge to help agents respond to questions.
Devs can use the Agent SDK to access services from Azure AI, Semantic Kernel, and Copilot Studio. There’s also an Azure AI Foundry (also launched at Ignite) integration that links Copilot Studio to facilitate connection to services like Azure AI Search and the Azure AI model catalog.
Finally, a public preview of agent builder in Power Apps was also announced at Ignite.
What about Responsible AI?
Sarah Bird, chief product officer for Responsible AI, wrote in a blog post this week that extra safety considerations arise with autonomous agents and that Microsoft is focused on ensuring that they behave and hand over to human before taking unexpected actions which can have big impacts and that extra guard rails and protections will be put in place.
The blog post talks about examples of such measures including the vital need for a human-in-the-loop check to make sure autonomous decision-making doesn’t do things it’s not expected too. Nothing demonstrates confidence in automation more than a human approval process.
Microsoft also suggest that anyone looking to get a sense of AI agents in a real role, can try out the Linked In Hiring Assistant which is designed to help HR hiring teams speed up the process of dealing with the Admin involved in reviewing job applications.
Key Benefits
The key Benefits these new adaptions to Copilot. Agents should bring to users and organisations includes:
- Learning and Adaptation: The Copilot AI agents can learn from their environment and adapt to new information and tasks.
- Decision-Making: These agents are capable of making decisions to assist users in their daily work.
- Productivity Enhancement: The primary goal is to empower employees by reducing workload and improving efficiency in tasks such as managing meetings, emails, and creating presentations.
- Automation of some tasks connected to regular and recurring inquiries or asks.
Human Impact – what about jobs!
The introduction of AI and automation, including Microsoft’s Copilot AI agents, has the potential to impact the roles of people in jobs.
- Job Displacement: People naturally worry that AI has the potential to replace certain jobs, particularly those involving repetitive and manual tasks. According to a report by Goldman Sachs, AI could replace the equivalent of 300 million full-time jobs….. But.
- Job Creation: On the other hand, AI also creates new job opportunities. It can lead to the emergence of new roles that require advanced technical skills and the ability to work with AI systems
- Economic Impact: AI is expected to contribute significantly to global economic growth. McKinsey Global Institute estimates that AI could deliver additional global economic activity of around $13 trillion by 2030
- Skill Demand: The demand for skills will shift towards more advanced and technical capabilities. Employees will need to upskill and reskill to stay relevant in the evolving job market. AI skills will be similar requirement to the “Internet skills” we saw on CVs in the 1990s!
Conclusion
Microsoft’s autonomous Copilot AI agents represent a significant step towards integrating advanced AI into everyday business operations. By enhancing productivity and reducing routine workload, these agents have the potential to transform how employees manage their tasks.
These will be in public preview very soon as these often take a few weeks to rollout across the globe.
Source: Conversation with Copilot, 22/11/2024
(1) How Will Artificial Intelligence Affect Jobs 2024-2030. https://www.nexford.edu/insights/how-will-ai-affect-jobs.
(3) The impact of AI on jobs – GOV.UK. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1023590/impact-of-ai-on-jobs.pdf.