Microsoft announced at Ignite, the new Facilitator agent – an update to the AI notes in Teams that works inside your meetings and chat and is designed to enhance collaboration and streamline the way teams work. It works similar to the AI generated notes after a meeting, but this works live alongside you and all participants can see it working live in the meeting.
How Facilitator works in Teams Meetings
Facilitator will take real-time notes during Teams meetings (not currently adhoc meetings or Meet Now), enabling everyone to co-author and collaborate seamlessly. This allows meeting participants to focus and engage more deeply in meetings, while ensuring alignment before the meeting concludes.
To enable this feature and use it a meeting, organisers can toggle AI-generated notes setting on or off when setting up a meeting in the Teams calendar or enable it during the meeting via the Notes section in the meeting.
Once enabled, a notification appears in the meeting chat to inform all participants. This also activates meeting transcription, with a notification to users… During the meeting, participants can click on Notes to open a pane where the AI generated live notes are created every few minutes, organised by topics and follow-up tasks.
What is nice about this is that participants can edit the notes inline or assign tasks to users, with attributions indicating whether the content is AI-generated or user-edited making these Co authored notes by humans and AI!
After the meeting ends, notes continue to be accessible in the Recap tab and are stored in the OneDrive of the user who enabled real-time notes. These notes are contextual to the meeting transcript, ensuring relevance and accuracy.
Future Capabilities in Meetings
As the Facilitator agent gets developed futrther, Microsoft say that it will be able to take on more tasks to enhance meeting effectiveness. Soon, it will also manage meetings from end-to-end, including managing agendas, moderating discussions, and handling action items automatically or semi-automatically
In early 2025, the real-time note-taking experience will also expand to Microsoft Teams Rooms. Employees will be able to invite a Teams Room to a meeting, allowing all participants to see real-time notes however, they have joined the meeting. This feature will also be available for ad-hoc meetings, enabling in-office discussions to be captured seamlessly.
How Facilitator works in Teams Chats
As of now (November 2024), the Facilitator Agent creates and maintains up-to-date summaries of what it considers valuable information within Teams chats. This includes key decisions, action items, and open questions, helping groups stay focused, align faster, and resolve issues efficiently.
AI-generated notes are automatically enabled when creating a new chat. For existing chats, users can toggle it on via the Notes icon which is shown at the top right of the chat window as shown below.
When notes are enabled, a notification appears in the group chat to inform everyone that notes are being taken in real time.
To access the notes users simply click on the Notes icon in the top right corner of the chat to show a summary of the chat thread, organised by topics with corresponding decisions, action items, and unanswered questions.
These are continuously updated as the chat conversation progresses.
Availability and access
Facilitator is already in public preview now for desktop (Windows/Mac), web, and iOS/Android. To access the public preview of the new Facilitator agent, meeting hosts need a Microsoft 365 Copilot license.
Facilitator will only be available to users that have app permission policy for Microsoft apps set to “Allow all apps”. The Facilitator App will become available soon for Admins to see and manage in Teams admin center. For more information about app permission policies, see Manage app permission policies in Microsoft Teams – Microsoft Teams | Microsoft Learn
This week at Microsoft Ignite 2024, Microsoft unveiled new features and controls for SharePoint and Purview, aimed at empowering IT teams and ensuring robust data protection and governance. These enhancements are part of Microsoft’s ongoing commitment to providing intelligent solutions that respect an organisations controls while driving productivity and efficiency. Oversharing of data is one of the most common causes of rogue data and poor data governance and one of the biggest blockers to wider AI adoption.
Microsoft offers two powerful tools to address this concern of oversharing: SharePoint Advanced Management for site management and content governance capabilities, and Microsoft Purview for security, compliance, and governance across data and files. Both have new capabilities and availability following announcements at Ignite in Chicago.
Advanced Management for SharePoint for Copilot.
To give IT teams even more control, Microsoft have said that SharePoint Advanced Management will be included at no additional charge for Copilot customers. There’s also need and updated features coming.
Restricted Content Discovery (RCD) to help identify and manage content that is restricted or sensitive, ensuring that such content is not overshared within the organisation. This works by allowing SharePoint Administrators to restrict specific SharePoint sites from participating in organisation wide search and Microsoft 365 Chat. Once configured, all content from the site will be hidden from tenant-wide search and Microsoft 365 Chat by default for all users in the tenant, even if a user has site access permissions. While child content will be hidden by default, users will still be able to search for content they have recently interacted with. This includes recently accessed and modified files, even if RCD is applied to the parent site. Searches originating from a site context will not be impacted.This will be available in Public Preview in December 2024 and Generally Available from March 2025
Restricted Access Control (RAC) feature allows administrators to control and restrict access to specific sites or content within SharePoint to helps in preventing unauthorised access and oversharing of sensitive information. New AI content governance controls and insights will be available in early 2025.
Deployment Blueprint is a new feature that will offers a structured approach to deploying Microsoft 365 Copilot while addressing the risks of information oversharing. It will include best practices, guidelines, and tools to ensure that sensitive information is protected during the deployment process.
SharePoint Advanced Management will be Generally available in Q1 2025 and will allow IT to better govern access and usage of Copilot and agents, including controls over which users can use Copilot and agents, along with visibility into agent status and life cycle.
SharePoint Advanced Management will be included as standard for organisations with Microsoft 365 Copilot licenses.
Purview
Data Loss Prevention – To provide addition protection, Microsoft Purview Data Loss Prevention (DLP) will soon be extended to support Microsoft 365 Copilot. DLP policies will be able to identify sensitive documents based on sensitivity labels and exclude processing for Copilot interactions in Microsoft 365 Copilot Business Chat. In preview from December.
Data Security Posture Management (DSPM) provides insights into the security posture of data within the organisation. It helps in identifying potential risks and vulnerabilities related to data oversharing and provides recommendations to mitigate these risks.
Risky AI Usage Detection is a new feature which can detect and alert admins about potentially risky usage of AI within the organization. It helps in preventing data leakage and unauthorised access by monitoring AI activities. This is now in public preview.
GenAI Risk Detections is another feature which focuses on detecting risks associated with the use of generative AI. It ensures that AI-generated content does not lead to oversharing of sensitive information or unauthorised access.
Measurement and Reporting with Copilot Analytics
To help IT and business leaders track adoption patterns and return on investment from the use of Copilot and agents, Microsoft is introducing Copilot Analytics.
This new feature includes out-of-the-box experiences to measure Copilot adoption and business impact, customisable reporting for deeper analysis.
The new Copilot Analytics. Microsoft Viva Insights will be included in Copilot at no additional charge as part of this new analytics suite.
How Microsoft partners can help
Cisilion, as your Copilot Jumpstart partner, will be incorporating these new features and controls into our guidance and briefing and expect Microsoft will rapidly be updating their official documentation and guidance.
The Copilot Pilot programme, entwines technical readiness with business guidance and comprehensive adoption and change management to ensures that your organisation receives the most up-to-date and comprehensive support in leveraging these advancements for optimal data protection and governance whilst putting these into practice for a smooth and measurable pilot.
Conclusion
These new controls and features are designed to provide IT teams with the tools they need to govern access, usage, and reporting while ensuring data protection and governance. Microsoft is committed to helping organisations leverage the power of AI to drive productivity, efficiency, and security.
Microsoft has introduced autonomous Copilot AI agents in public preview. These agents can learn, adapt, and make decisions, aiming to assist employees with various tasks and improve productivity. While AI has the potential to displace some jobs, it also creates new opportunities and enhances productivity.
Microsoft’s wave of Autonomous agents are here
Microsoft has unveiled new tools designed to help businesses create software agents powered by foundation models, referred to as autonomous Copilot AI agents. These agents are currently available in public preview.
Copilot is Microsoft’s generic term for all their AI-driven productivity workloads. Copilot is built upon the advanced GPT-4 series of large language models by OpenAI and offers a chatbot interface where users can input text, images, or audio prompts to receive responses tailored to their needs. Microsoft 365 Copilot also seamlessly integrates with Microsoft Office applications like Word, Teams, and Excel. It can generate documents, analyse extensive Excel spreadsheets, summarise meetings content, rewrite documents, create entire PowerPoint presentations and even reason over your inbox and company information you have access too….., and much, much more.
The next step in Microsoft 365 Copilot’s advancement is through what are termed AI-Agents, which are chat bots that can not only respond but can also perform a series of linked tasks (actions) based on user instructions. This new wave went into public preview this week at Microsoft Ignite in Chicago.
What are Microsoft 365 Copilot Agents?
This first stage of the next phase of evolution comes with Microsoft introducing a set of Microsoft 365 Copilot agents with predefined roles. These include:
Agents in SharePoint. These can be customers with a personalised name and certain behaviours, and can be shared across emails, meetings and chats, with users being able to ask the agents questions and getting real-time responses. These are grounded just on the SharePoint sites and files you specify. One created, employees can ask the agents questions about data across your files. These agents can even be shared or published in Teams for simple access.
The Employee Self-Service Agent in Microsoft 365 Copilot Business Chat (this currently in private preview), will be able to respond to specific HR and IT questions. It can retrieve employee benefits and even things like payroll info and holiday information, or request help from IT such as a new mouse, password reset etc.
The Facilitator agent (in public preview), works like a assistant in meetings and goes beyond the current AI notes that Teams Premium offers. It can take notes, curate actions and even pull up information or execute instructions such as “see if Bob is free and invite him to the meeting”. It will also be able to summarise the conversations based on the role of the participants.
The Interpreter agent (due in preview in early 2025) promises real-time interpretation in Teams meetings in up to nine languages. It will also be able to sample and then simulate their personal voice for a more inclusive experience as part of the translation, essentially using the sound of your voice in the language of the other participants. It was great to see this in action at ignite in a live demo!
The Project Manager agent, will be able to act and work like a PM with the ability to automate project management, from planning to execution using Microsoft (and later other) project tools like Planner.
For organisations that need more control or different templates to build on and use, Microsoft Copilot Studio provides a way to customise or create your own AI agent behaviour.
Agents in Copilot Studio
Agents built in Copilot Studio can operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention,These autonomous agents can be triggered by data changes, events, and other background tasks – and not just through chat.
Copilot Studio bundles many templates for common agent scenarios that can serve as the basis for a customised version. It will also shortly support voice-enabled agents, image uploading (for analysis by GPT-4o), and knowledge tuning with the added ability automatically add new sources of knowledge to help agents respond to questions.
Devs can use the Agent SDK to access services from Azure AI, Semantic Kernel, and Copilot Studio. There’s also an Azure AI Foundry (also launched at Ignite) integration that links Copilot Studio to facilitate connection to services like Azure AI Search and the Azure AI model catalog.
Finally, a public preview of agent builder in Power Apps was also announced at Ignite.
What about Responsible AI?
Sarah Bird, chief product officer for Responsible AI, wrote in a blog post this week that extra safety considerations arise with autonomous agents and that Microsoft is focused on ensuring that they behave and hand over to human before taking unexpected actions which can have big impacts and that extra guard rails and protections will be put in place.
The blog post talks about examples of such measures including the vital need for a human-in-the-loop check to make sure autonomous decision-making doesn’t do things it’s not expected too. Nothing demonstrates confidence in automation more than a human approval process.
Microsoft also suggest that anyone looking to get a sense of AI agents in a real role, can try out the Linked In Hiring Assistant which is designed to help HR hiring teams speed up the process of dealing with the Admin involved in reviewing job applications.
Key Benefits
The key Benefits these new adaptions to Copilot. Agents should bring to users and organisations includes:
Learning and Adaptation: The Copilot AI agents can learn from their environment and adapt to new information and tasks.
Decision-Making: These agents are capable of making decisions to assist users in their daily work.
Productivity Enhancement: The primary goal is to empower employees by reducing workload and improving efficiency in tasks such as managing meetings, emails, and creating presentations.
Automation of some tasks connected to regular and recurring inquiries or asks.
Human Impact – what about jobs!
The introduction of AI and automation, including Microsoft’s Copilot AI agents, has the potential to impact the roles of people in jobs.
Job Displacement: People naturally worry that AI has the potential to replace certain jobs, particularly those involving repetitive and manual tasks. According to a report by Goldman Sachs, AI could replace the equivalent of 300 million full-time jobs….. But.
Job Creation: On the other hand, AI also creates new job opportunities. It can lead to the emergence of new roles that require advanced technical skills and the ability to work with AI systems
Economic Impact: AI is expected to contribute significantly to global economic growth. McKinsey Global Institute estimates that AI could deliver additional global economic activity of around $13 trillion by 2030
Skill Demand: The demand for skills will shift towards more advanced and technical capabilities. Employees will need to upskill and reskill to stay relevant in the evolving job market. AI skills will be similar requirement to the “Internet skills” we saw on CVs in the 1990s!
Conclusion
Microsoft’s autonomous Copilot AI agents represent a significant step towards integrating advanced AI into everyday business operations. By enhancing productivity and reducing routine workload, these agents have the potential to transform how employees manage their tasks.
These will be in public preview very soon as these often take a few weeks to rollout across the globe.
Source: Conversation with Copilot, 22/11/2024 (1) How Will Artificial Intelligence Affect Jobs 2024-2030. https://www.nexford.edu/insights/how-will-ai-affect-jobs.
(3) The impact of AI on jobs – GOV.UK. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1023590/impact-of-ai-on-jobs.pdf.
The new Agent Builder in SharePoint is designed to help people use and share Copilot Agents to query sibsets of data within your organistion using a simple click, point, create and tweak approach. Out of the box every SharePoint site (assuming you have a Copilot license) brings a Copilot sidebar allowing you to ask questions about the content, but you can also replace this with a custom Copilot Agent which we will walk through here.
The goal is to enable business users to easily empower their employees use Copilot to reason over specific information sources or across discrete repositories. Microsoft provide a handful of “use cases” as why a Copilot agent might be useful and what’s great is that “anyone” can create one!
Image – Microsoft Copilot Adoption Hub
Once created and tested, these custom Copilot Agents can be easily shared via a simple hyperlink that can be embedded in SharePoint pages or used in Teams.
In this how to blog, I walk you through the setup and customisation of a Copilot Agent using Agent Builder in SharePoint, customising of the agent, and sharing of the agent. Free to follow along and create your own agent.
Copilot agents are specialised AI assistants designed to enhance the capabilities of Microsoft 365 Copilot by connecting to your organisation’s knowledge and data sources. They are custom tools embedded in Copilot Extensions, providing additional functionalities tailored to specific needs. In SharePoint, Copilot agents are natural language AI assistants that give trusted, precise answers and insights. Agents are expert systems that operate autonomously on behalf of a process or company.
Building your First Copilot Agent
Step 1 – Choose your starting point.
First, you need to navigate to a SharePoint site, library or document library you want to create an “agent” from. You will of couse need to have access to that Library and also need a Microsoft 365 Copilot license to create the agent.
From here, you can select the three dots and choose “Create a Copilot agent“
Step 2 – Click and you are done!
Done (well – you will probably want to customise it and test it), but once you do this, your Copilot Agent is created for you. Click “Edit” to make changes, such as change the name, and then of course test it out.
Step 3 – Edit and Customise
Here I have clicked “Edit” to take me to the customisation pages. From here you can toggle across different options to customise your Copilot agent.
The customisation pages are split into three sections – Idenitity, Sources and Bebaviour – each of these allow you to tweak the way the agent works. There’s also the ability to edit for advanced customisation through Copilot Studio but this feature is not available at time of writing…
In the Identity Section – you can change the name, icon and description (who the agent introduces itself to the user)
In the Sources Section – you can modify the sources that the Copilot Agent uses. You can add additonal SharePoint sites, individual files or extenal sources such as websites.
In most cases, I suspect you will want to use a single library or a discrete set of files, but you can add up to 20 different information sources. These 20 information sources can be mean sites, libraries, folders, or documents. What’s more, you can have a combination of these as long as the total is 20 sources – for example, you could add 20 sites or 20 documents, or 3 sites, 5 document libraries, 2 libraries and 10 descrete files as long the total sources totals 20.
Note: You of course need to ensure that the intended users of the agent have access to the sources your specify as agents run under the security context of the user using the agent.
In the Behaviour Section, you can customise the welcome message which will help your users to understand the purpose of this Copilot agent and can also edit or change the starter prompts to help users get some tips on some of the things the agent can do for them. You can also give the agent specific instructions on how it should respond and behave based on the user input.
As you update the behviour, you will see the changes in real-time.
Testing your Copilot Agent
Once you are ready, you can test your agent, simply writing a prompt in the chat dialog as you would with any other Copilot – feel free to try one of the templates or create your own.
Be sure to test a few things, you might find you need to update the user instructions and review the sources before you share it with other people to test further.
Once you are happy with your agent, click save. The agent is saved a “file” with a .copilot extension in the root of the SharePoint folder you started creating your agent in.
Using your Copilot agent
Once saved, your new Copilot Agent launches automatically for any user accessing the SharePoint library that has a Microsoft 365 Copilot license. This replaces the default copilot interface that opens when you visit a SharePoint library.
Sharing your Copilot agent
Since the Agent is encapsulated as a manifest “.copilot” file, you can simply share the file like you would any other file, or click the three dots and select share.
Once shared, they click on the file and open it and it displays like a standalone app or can of course access it from the SharePoint library directly.
[Current] Limitations
Currently Custom agents do not appear on the main Copilot Business Chat pages, though this is coming I beleive. On the FAQ on Microsoft’s support page it clearly states that “You can access a Copilot agent from a SharePoint site, page, or document library. You can also use it in Teams if added. We plan to make it available across Microsoft 365, including Microsoft Copilot.” https://support.microsoft.com/en-us/office/get-started-with-copilot-agents-in-sharepoint-69e2faf9-2c1e-4baa-8305-23e625021bcf.
Advanced editing with Copilot Studio is not currently available, but is also coming soon.
It’s not possible to “hide” the .copilot file (that I can see anyway), so make sure to change permissions on the file.
Microsoft is about to add more capabilities to the consumber version of Copilot including a new way we interact with it Copilot through its latest feature, Copilot Vision.
Is this a privacy step to far? or is this simply leveraging the power of vision to bring new experience and assistance to users.
Designed to enhance the capabilities of Microsoft’s Copilot AI assistant by allowing it to see and understand the same content as the the user is seeing on scene is said to bring a new dimension to how we work with AI tools.
Copilot Vision – image (c) Microsoft
What is Copilot Vision?
Copilot Vision is an extension of Microsoft’s Copilot AI assistant that enables it to visually perceive the content on your screen. Whether you’re browsing websites, reading documents, or viewing images, Copilot Vision can interpret and respond to the visual data, making it a more intuitive and helpful assistant.
Examples of Copilot Vision in Action
Travel Planning: Instead of manually searching for travel options, Copilot Vision can provide recommendations and answer questions based on the travel websites you’re viewing.
Recipe Adjustments: If you’re looking at a recipe online and want to make substitutions, Copilot Vision can suggest alternatives and cooking tips without needing to switch tabs or open a new search.
Document Assistance: While working on a document, Copilot Vision can offer suggestions, corrections, and additional information relevant to the content you’re editing.
All this happens without you having to copy and paste stuff to the Copilot chat interface so it’s really like having eyes on what you are doing (once turned on of course). It’s like having your assistant working and viewing with you so it can see exactly what you see on your screen, whether it’s a website or a document.
Copilot Vision.
That’s what Copilot Vision does. It can read both typed and handwritten text displayed on your screen, and it responds to what it sees, offering answers to your questions and suggesting next steps.
Privacy Consideration
Microsoft has emphased that privacy is a top priority with Copilot Vision. The data processed by Copilot Vision is not saved or used beyond the current session (like clearing the cache). Microsoft Copilot Vision will initially also be limited to certain popular websites that meet Microsoft’s security standards, ensuring a safe and secure user experience. It also won’t work on sites that contain sensitive data such as banking sites.
Remember, this is something you can choose to use or not, so you can turn it off!
Rollout Timeline
Microsoft say that after a successful trial period with a select group of users in the Copilot Labs experiment hub, Copilot Vision is “now ready” for a broader rollout.
The feature will soon be integrated into the Microsoft Edge browser, accessible via a screen-like icon. This phased rollout will allow Microsoft to gather more feedback and ensure a smooth user experience.
In a move that has surprised few, Microsoft has once again delayed the rollout of its controversial Recall feature for Copilot AI PCs. Initially planned for a June release to coincide with the new Copilot+PCs launch, Recall was then postponed to October while Microsoft addressed initial concerns around privacy and security.
This week however, Microsoft has yet again delayed this again with testing for Windows Insiders coming (so we are told) in December, which unfortunately falls after Ignite.
Microsoft Recall….
Security Concerns and Refinements
Recall’s primary value is to create a timeline of screenshots that users can scroll through and search. However, early testing revealed by security researchers discovered that the core database storing these screenshots and tagging was not encrypted, posing a massive security risk.
Microsoft have since addressed this by fully encrypting the database and requiring Windows Hello authentication for access.
Microsoft have also confirmed that Recall will now be an opt-in feature, allowing users to completely uninstall it if they choose.
Microsoft’s Cautious Approach
Brandon LeBlanc, senior product manager of Windows, enforced Microsoft’s commitment to delivering a secure and trusted experience with Recall.
Microsoft need to get this right in order to maintain trust with its customer base. He stated that the additional time is necessary to refine the feature before previewing it with Windows Insiders. Despite these assurances, social media shows huge skepticism about whether Microsoft will meet the new December deadline and even if they might scrap the feature all together. This will be a shame, as the value around it looks. Promising and is really ( currently) the one killer reason consumers were looking at when looking at investing in Copilot+ PCs outside of the huge battery life that these Qualcomm Snapdragon Powered devices deliver.
The repeated delays and security issues surrounding Recall highlight broader concerns within the AI industry.
There is a growing perception that companies are rushing to release new features without fully considering the potential consequences.
Microsoft’s cautious approach with Recall is a step in the right direction, but it also underscores the need for more rigorous testing and security measures in AI development.
Will Recall still be exclusive to Copilot+ PCs?
That’s a good question.
When Microsoft announced the Copilot+PC back in June, Recall was the flagship feature and it was unique to the device’s (and kinda stole the show).
Since then AMD and Intel have released their new AI PC chipsets offering similar NPU performance to the Snapdragon chips in Copilot+ PCs like Surface Pro 11 and Surface Laptop 7.
We now have NPU turbocharged PCs with Snapdragon® X Series, AMD Ryzen™ AI 300 Series and Intel® Core™ Ultra 200V Series devices after all.
We don’t know if this will remain an exclusive (I don’t see why it would) and if all the “exclusive AI features” that are part of Windows 11 24H2 will soon be lit up in any decide with a dedicated NPU.
From what I can… It will be supported… But some features are limited to Snapdragon, so we will have to wait and see….
Coming soon then… Or will it?
While the future of Recall still remains uncertain, Microsoft’s efforts to address security concerns and refine the feature are commendable, I just hope they haven’t missed the boat. We’ve already seen Apple quietly move forward with Apple Intelligence (clever) and it’s now embedded in MacOS. Microsoft need to move quick and innovate here to regain confidence and innovative is their mission to empower every person on the planet to achieve more (with their technology)!
Consumers, IT professionals, industry experts and social media will be keenly observing whether the Recall gets the release and value reputation it received back in June, with a secure and functional version of Recall to define what AI can really do in Windows.
I hope succeeds and brings life to the new AI PCs and Copilot+PCs or of it quietly gets canceled as skeptics seem to think…
The recent Copilot update is a Game-Changer in AI Voice Technology. In the recent announcements, Microsoft unveiled a new version of its Copilot app for iPhone and Android. The update brings a fresh look and new features. It also includes an impressive voice mode that rivals OpenAI’s ChatGPT Advanced Voice – especially since Microsoft make this available for free – yes free
I have tested both recently. I can confidently say that the new Copilot is a significant upgrade. What’s more, it is totally free to use. This is best read while/after you have watched my hands-on video below.
Hands on with Copilot Voice
User-Friendly Interface and Enhanced Voice Mode
The updated Copilot app boasts a more “consumer-friendly” interface. I do wish they would bring some of the advanced customisations back. The standout feature in this update is most definitely the new voice mode, which on first look (a few app updates before it worked), I thought would be a bit of a fad – but it is absolutely brilliant.
Voice mode offers speech-to-speech functionality, allowing for more natural and engaging conversations. While it may not interrupt as fluidly as OpenAI’s offering (though it’s still in early stages), it feels more casual and less stilted, making interactions feel more like chatting with a friend.
A Conversation That Feels Real
During my testing, I found myself deeply starting to actually forget that I was talking to an AI as the conversation felt natural and real (there was the odd delay. In my hands-on example (see the video below), I participated in a discussion. We talked about “if and when AI could ever become self-aware”. We also considered what the implications might be. Unlike a text-based discussion, this level of engagement goes to show just how fast and how rapid the advancement of natural conversation is becoming.
Copilot appears to adapt its vocal tones and pace during conversations. It emphasizes certain words as we speak.
Perhaps the biggest (pleasant) surprise I found was how Copilot adapted to use slang terms the more I used them too. If I swore or spoke more loudly, it also seemed to detect the change in my tone and adjust its output. I’ll be testing this more to see just how far it can go.
Spoiler: I did find the occasional limitation as the conversation continued, such as occasional delays when I interrupted it and seconds of silence.
Customisation and Accessibility
Copilot offers four voice options: Grove, Canyon, Wave, and Meadow. Unlike ChatGPT, you can modify the speed and tone of these voices, making them sound more natural and suited to your preferences. This feature, combined with the app’s inclination to use slang and short-hand words, makes it easy to forget you’re interacting with a machine. I’m not a fan of all the voices though and they are not currently that localised – with most very American (which is fine for now).
Gemini Live (yes, all the chat bots are discovering their voice) currently gives users a choice of 10, but Microsoft say more voice options will be coming “soon”.
What I also like is that you can customise the speed at which each of the voices speaks. Personally, I find the standard setting is too slow and find that a speed of 1.1x sounds most natural. I also discovered that you can also ask Copilot to speak differently by explaining how you want it to sound – for example, applying a slightly different accent, changing its tone of voice or to be more empathetic but I’d like to think eventually Copilot will do this natively without me asking (after all it’s unlikely you’d ask a human to speak in a different tone!).
Copilot Voice is free
One of the most significant advantages of Copilot is that it’s free to use. Today, OpenAI’s ChatGPT Advanced Voice feature currently requires a $20 monthly subscription, whilst Microsoft makes this feature available to all Copilot users, regardless of their subscription status.
Conclusion
Copilot is now under the leadership of Mustafa Suleyman [Microsoft CEO for AI]. It seems poised to make a significant impact in the AI voice technology market. It builds on its partner OpenAI. Its user-friendly design, natural voice interactions, and accessibility make it a strong competitor against other AI voice models.
The best thing – this is totally free
Try this out. Let me know how in depth you feel during a conversation is and can be with Copilot. How “close” do you think this is in becoming a natural, almost human conversation.
Microsoft is rolling out new controls to better manage the availability of Copilot in Teams meetings. These expanded controls offer greater flexibility and customisation for managing Copilot and transcription settings in meetings. This ensures it aligns with the specific needs and policies of organisations and meeting organisers.
IT admins can find the new setting in the Teams Admin Center and have a few options when it comes to the control Scope with options to set Copilot in meetings to be ‘Off’ at different levels including “per Tenant” Per User” and “Both”
Meeting Organisers also get controls which are accessible in the meeting options under “AllowCopilot“. From here there are three choices around how Copilot can be used in “their” meetings:
Only during the meeting: Copilot is available only while the meeting is in progress.
During and after the meeting: Copilot is available during and post-meeting.
Off: Completely disables Copilot for the meeting.
Meeting organisers can choose who has access to the recording. They can also decide who can see the meeting transcript after a meeting. This adds a huge amount of control and privacy.
Image (c) Microsoft
Auto meeting Summaries
After a meeting ends, users can open the meeting event in Microsoft Outlook. This allows them to view a summary of everything that happened in the meeting. Here you will see a summary. It includes a link to the recap page, transcript, recording, notes, shared files, whiteboard, and meeting details.
Auto meeting Summarisation in Outlook.
Users with a Copilot License or Teams Premium license will also see highlights. These include the number of speakers. They will see the number of times you were mentioned. Additionally, they will see the number of AI-generated tasks.
Rollout Timeline
Both features are being rolled out this month (October 2024).
Microsoft (off the back of Windows 11 24H2 release this week) have unveiled a series of updates to their AI infused Copilot+ PCs, aimed at enhancing the user experience with innovative features.
Copilot+PCs are a new category of PCs released this year by leading OEMs including and debuted by Microsoft and are equipped with NPUs. These devices come in Intel, AMD, and Qualcomm-powered Windows on Arm configurations. Microsoft introduced several new features for both types of these advanced PCs. The newly launched Windows 11 2024 Update (version 24H2) brings new functionalities for all Windows 11 users, with some exclusive enhancements specifically for Copilot+ PC owners.
These updates further demonstrates Microsoft’s commitment to baking AI assistance into more and more manual or semi manual tasks, and are designed to make everyday tasks more intuitive and efficient, leveraging the power of AI to transform how we interact with our new shiny devices.
New AI experiences in Copilot Plus PCs
These new features are summarised in an extensive Copilot / Windows Blog but the key ones I have summarised below.
Enhanced Search: Find stuff faster and easier.
One of the standout features in this update is the new Enhanced Search. Here, Microsoft has integrated AI-driven improvements deep into Windows search, making it significantly more powerful and user-friendly.
With these enhancements, users can now find files, images, and emails with ease, even if they don’t remember the exact names. Better than a simple search index (you know, that thing that used to grind your PC to a halt), this AI search understands context and can retrieve relevant results based on partial information or related keywords.
Image (c) Microsoft.
For instance, if you’re looking for a presentation you worked on last month but can’t recall the title, simply typing in related terms like “presentation” and “last month” will bring up the correct file. This feature is huge change for how we find and retrieve information and is more human connected in terms of how we think and ask. Plus, if you are anything like me, it should reduce the time spent searching for documents and allowing users to focus on their work.
“AI-powered search makes it dramatically easier to find virtually anything,” says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft. “You no longer need to remember file names and document locations, nor even specific names of words. Windows will better understand your intent and match the right document, image, file, or email”.
Yusuf Mehdi |Executive VP and CMO | Microsoft.
For images this will work extremely well as you won’t need to know the file name and can search for pictures using words, even if the search word isn’t part of the file name!
The improved Windows search will first show up in File Explorer on Copilot Plus PCs from November.
This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “duplicate my screen” into the Settings search box and it will help you find the right settings.
Click to Do: Interacting directly with your screen.
This feature really caught my attention and is definitely one I think I will use.
Click to Do will allows users to interact directly with images and text on their screen to perform quick actions. As an example you might be viewing a webpage or a pdf and see a phone number. You’ll be able to click on it to initiate a call, or clicking on an address to open it in your maps application. This feature streamlines workflows by reducing the number of steps needed to complete tasks.
Image (c) Microsoft
Click to Do works by understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items… It works on any windows, document, image, or even video”
Yusuf Mehdi |Executive VP and CMO | Microsoft.
As an example, you could use Click to Do to perform a visual search on an item that appears in a YouTube video you’re watching or a page you are viewing in a browser. Click to Do is also context-aware, assisting with text-related actions like rewriting, summarising documents, explaining text, and sending emails.
Microsoft have said Click to Do will begin testing with Windows Insiders on Copilot Plus PCs in October, with a gradual rollout planned for November.
The previously announced Recall feature will also be available to Windows Insiders in October on Qualcomm-powered devices, before being rolled out to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November.
I think this could be a real time saver for me and for anyone who does a lot of research, works with high volumes of information and has lots of open windows on their screen(s). By enabling direct interaction with on-screen content, it should help minimise interruptions and keeps the focus on what your are doing without having to open other tools.
Generative AI in Paint: Bringing modern tech to a staple app.
Microsoft Paint is also getting another significant upgrade (which has been in testing with Windows Insiders for a few months) with the introduction of new generative AI tools. These new tools ncluding generative fill, image generation (using Designer) and generative erase, that bring capabilities similar to those found in advanced photo editing software like Photoshop. Layers was also introduced to Paint earlier this year.
Copilot UI : The human touch.
Finally, Microsoft are revamping the general Copilot experience. This is not just about adding new features (though there are some) but are more about a total overhaul and part of their vision to make AI a more human-centric experience.
Their goal is to differentiate Copilot from other AI tools like ChatGPT and Gemin, by focusing on usability and user satisfaction. This approach ensures that the technology adapts to the user’s needs, rather than the other way around.
In a blog post yesterday, Microsoft unveiled a huge overhaul. They also introduced new features which are rolling out “now” to the consumer version of Microsoft Copilot. These updates set out to help them differentiate Copilot from ChatGPT. They aim to bring a more human-centric approach to the user experience.
These experiences are coming to Apple iOS, Android, the Copilot web experience at copilot.microsoft.com and in Copilot in Windows. Microsoft have also announced that Copilot is coming to WhatsApp. It will “help users there experience natural and engaging interactions with Copilot”. Interesting.
This is not available for me yet (I have a Copilot Pro license). Microsoft says that until this rolls out, users will see a message like below. This message pre-advertises the new Copilot experience that is coming “soon”.
In this blog, I’ll cover the key changes, the reasons for change and some of the coolest new features. I’ll also share my take on this and what they mean for users.
New Microsoft Copilot Video
Oh yes, there’s also a Microsoft “sizzle” video below if you don’t want to read my ramblings:
The Human Side of Gen AI?
At the heart of Microsoft’s vision is the belief that technology should enhance human well-being and support our unique qualities. Microsoft say that the revamped Copilot has been designed with this philosophy in mind. It ensures that every interaction is intuitive, personalised, and ultimately beneficial to the user.
Now, this is kind of the part of Copilot that was missing in my view. Other Gen AI tools now do this. They are essentially giving Copilot (for consumer – not Microsoft 365 Copilot) to “get to know you” – this is how they describe it:
“Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests. It understands the context of your life, while safeguarding your privacy, data and security, remembering the details that are most helpful in any situation. It gives you access to a universe of knowledge, simplifying and decluttering the daily barrage of information, and offering support and encouragement when you want it. …..Over time it’ll adapt to your mannerisms and develop capabilities built around your preferences and needs. We are not creating a static tool so much as establishing a dynamic, emergent and evolving interaction. It will provide you with unwavering support to help you show up the way you really want in your everyday life, a new means of facilitating human connections and accomplishments alike.” Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI
New Copilot Features
The new Copilot experience will be far more than an UI facelift when it arrives. (I don’t have it yet.) It will come with brand new features that promise to re-innovate the ways in which we can use Copilot in our daily lives. The new features include:
Copilot Voice: This allows users to interact with their devices using natural language, making technology more accessible and user-friendly. This means you will be able ro engage in natural conversations with Copilot. The current method is more just speech to text and doesn’t really feel like a conversation. This is rolling out “now” for initially available in English in Australia, Canada, New Zealand, the United Kingdom and the US with more regions and languages coming soon.
Copilot Daily: Delivered as “cards”, this will provide personalised insights and recommendations to help users manage their day-to-day tasks more efficiently. Microsoft say this content will only be served by trusted news sources – the cite: Reuters, Axel Springer, Hearst Magazines, USA TODAY Network and Financial Times, with more “local sources” coming soon. As Copilot gets to know you, it will bring personalsed feeds and also allow users to have controls over what is served up. This starts rolling out now in the US and UK with other countries following soon.
Copilot Vision: which looks so cool, will leverage Microsoft’s vision and seeing AI tools to offer enhanced visual recognition capabilities, making it easier to organise and find information. Microsoft say that this work on all websites and documents. They have taken steps to put “boundaries” on the types of websites Copilot Vision can engage. It also won’t work on pay-walled content initially. It won’t work on sensitive content initially either. This is to protect “users’ and creators’ interests” and copyright. This will be a Copilot Pro Feature and will roll out to US customers first…
Think Deeper: This is similar to Deep Search in Bing, whereby Copilot will be able to reason through more complex questions. As such it will take longer to respond and may ask for clarifications before responding. This is really designed to allow Copilot to go beyond basic responses. It will help with more in-depth discussions. It will also aid in challenging questions and research. This is in experimental phase and will more details will come.
Wrap up
The new and enhanced Copilot user experience is all about making Copilot easier to use. It feels more natural (less techy). It brings some new capabilities and personalisation. This makes the experience far more “personal”. It’s great to see more work being done to create a more seamless and up-to-date experience. This allows them to compete better with Google, Meta and Apple in this fast paced Gen AI development.
This is great to see and needed as update and adoption of Copilot for consumers is nowhere near the adoption of Chat GPT. Part of Microsoft’s “problem” is they are not great at consumer marketing. Copilot (IMO) offers far more value than ChatGPT and includes many features (as standard) that you need to pay for in ChatGPT.
Will this make you revisit and retry Copilot? Let me know your thoughts?
Microsoft yesterday, announced the next stage of the evolution of Microsoft 365 Copilot with Wave 2. Amongst the many new features was the launch of Copilot Pages. This innovative feature is the first step into the new evolution of Copilot which is set transforming how employees interact with Microsoft AI in a new collaborative environment.
What are Copilot Pages?
Copilot Pages is a dynamic, persistent canvas integrated into Copilot chat, designed to facilitate what Microsoft call “multiplayer AI collaboration”. It allows users to turn insightful Copilot responses into durable, editable content that can be shared with teams for further collaboration.
“This is an entirely new work pattern – multiplayer, human to AI to human collaboration”. | Jared Spataro | VP of AI at Work | Microsoft.
Copilot Pages -Key Features
Dynamic Collaboration: With Copilot Pages, employees can work directly with Copilot on a shared page, prompting and refining responses together as a team rather than individually in silos.
Persistent Canvas: The pages are persistent, meaning collaborative efforts are saved and can be revisited and edited at any time by anyone.
Team Learning: This feature encourages learning from each other’s prompts, enhancing the overall quality and depth of the information gathered.
Getting Started with Copilot Pages in 5 Steps
Access Copilot Pages: Open your Copilot chat and look for the new “Pages” tab. Click on it to create a new page or access existing ones.
Create a New Page: Click on “New Page” to start a fresh canvas. You can name your page to keep your projects organized.
Collaborate with Your Team: Invite team members to your page by sharing the link. Everyone can contribute by adding prompts, refining responses, and editing content.
Save and Revisit: Your pages are automatically saved. You can revisit and edit them anytime, ensuring your collaborative efforts are always up-to-date.
Share and Export: Once your page is finished, you can share it with others outside your team or export it for presentations, reports, or further analysis.
Check out the Microsoft Video for more.
Where are Copilot Pages Stored?
Copilot Pages are .loop files stored in a new user-owned SharePoint Embedded container. IT Admins can manage these files using Loop admin switches and other governance tools. The feature supports various compliance and manageability capabilities, including GDPR compliance, Intune device management, and data loss prevention. IT admins manage these .loop files just like any other files (.docx, .pptx, .xlsx, etc.). They support all the features of the SharePoint file system, including everything detailed here.
Additional capabilities, such as programmatic API access for third-party tools, are expected in Q4 CY2024.
Copilot Pages is rolling out “later this month” for Microsoft 365 Copilot subscribers and will soon be available to all Microsoft 365 subscribers. Loop must be enabled in your environment.
This afternoon (16th September 2024), Microsoft passionately announced (almost 9 months after Copilot was officially available to any organisation) the latest updates coming to Microsoft 365 Copilot as part of what they are calling “Wave 2”. The 30-minute-long session, hosted by Microsoft CEO Satya Nadella and Jared- Spataro, unveiled a heap of new features, capabilities and performance enhancements were announced across the entire experience.
Microsoft 365 Copilot (THIS IS NOW IT’S NEW OFFICIAL NAME) provides enterprise data protection, ensuring the same level of security and compliance protection as other services like files, SharePoint, and emails. Microsoft said that significant improvements have also been made to PowerPoint and Excel based on feedback, including the introduction of Python integration in Excel.
Some of these things are “generally available” from today and others are coming in the next few weeks and months. – See the end.
Evolving the purpose and role of Microsoft 365 Copilot
Microsoft told today, how Copilot is evolving from an individual productivity assistant to a collaborative partner at work. Copilot can utilise various content sources such as files, chats, calendar invites, and emails to generate rich outputs based on the needs of the user and teams of people. You will have seen in the various demos how the product demos now showcase how Copilot facilitates collaboration and achieves outcomes, making both personal and teamwork more efficient and effective.
They have also focussed lots on performance and stability enhancements with huge investments in their Azure Data Centres.
Microsoft also wanted to ensure organisations know just how much they focus on providing the same level of enterprise data protection to Copilot as they have with files, email, SharePoint etc.
So, here’s my pick of what’s new and most cool!
1. Copilot Agents
Microsoft is also broadening the definition of “agents“, ranging from personal AI assistants to fully autonomous agents. These agents span across a spectrum, from human-in-the-loop to fully autonomous.
This is the top announcement for me, I think. Agents (aka Custom GPTs,) have been a very popular discussion with my customers. When Microsoft talks about agents, they use it in its broadest term with an agent being anything from an AI assistant helping you retrieve information right (a foundational agent capability), all the way to autonomous support agent, meaning the agent does not need a human to intervene for it or for it to be able to do its work. Wow Right!
You will see Microsoft focusing on agents across the entire spectrum – giving organisations the ability to create agents using natural language to “support whatever custom business process you are trying to automate“. This will be going into public preview later this month Copilot Agent Builder will be part of Copilot Studio as I understand it.
As an example, say an issue out in the field required further research and follow-up and the team keeps all their customer records from deployment info to maintenance reports on a SharePoint site. Like many organisations, there’s loads of valuable information stored here, but it takes ages to sift through it and find what is needed. Now with Copilot Agents, an agent can be built from any SharePoint site library or folder. It’s possible to create an agent with a single clip and in just a few seconds, your agent is ready to be used and shared with your team and it can be simply added to the department’s team’s chat.
Once created, created agents can be customised and things like topics and knowledge can be enhanced as well as the actions it can take. These can be connected to third party apps such as Dynamics 365 Supply Chain Management.
2. Copilot Pages – Powered by Loop
This is the second biggest announcement and combines two of my favourite parts of Microsoft 365 – Copilot and Loop.
Accessed through BizChat, Copilot Pages, allows users to create side-by-side pages for real-time collaboration. Built on Loop components, these pages enable multiple users to work together and update data simultaneously, enhancing teamwork and productivity.
This can be used when you are working in BizChat – pulling Copilot’s response into a sharable canvas (Loop spaces) built for real-time multiplayer collaboration with Al. Copilot can then be used to improve and expand upon subject matter, build visualizations, and bring in additional content.
Biz Chat will be the place where you can start and finish most of your work before you transition it to your format of choice. Within Biz Chat, you’ll also soon see a button to move the output to the final experience – says move to Outlook, move to Word, move to PowerPoint etc., but you can do all of the pre-work in Bizchat which Microsoft’s customers say is where they spend “most” of their time.
3. Biz Chat Enhancements
Copilot Biz Chat, will, as I discussed above have the ability to send output to the final app for you to finish your work. You’ll see a send to button making workflow faster and just feel smoother and more integrated.
4. Utilising Email and Bizchat for Business Insights
Copilot can now use email and Bizchat to identify patterns and information, recall similar situations, and access relevant content from various sources. This feature is designed to help discover strategies such as price reduction, promotional offers, and ad campaigns as example by reasoning over email and chat threads to help solve business challenges.
5. Copilot in PowerPoint Improvements
Copilot democratizes advanced features in Excel by allowing users to use natural language to access them. PowerPoint improvements include the ability to easily build custom narratives, sections, and flow within presentations. Branding options ensure consistency with company logos, fonts, colours, and styles. PowerPoint’s new narrative builder, with creative control over the flow, reordering topics, deleting unwanted ones, and adding new ones.
Copilot helps create presentation outlines quickly, offering image suggestions from approved sources or AI-generated options. It designs slides in company branding with various layout choices.
PowerPoint’s new features include adding picture notes to slides, built-in slide transitions, and animated text. These features help users create professional-looking presentations quickly and easily, using their own corporate-branded content.
Leveraging corporate templates requires that marketing teams integrate their organisations branded assets into a SharePoint OAL (Organization Asset Library) in order to be able to create presentations with organisational images. This is scheduled for release in Q4 2024.
6. Copilot in Word
Copilot in Word has new features including (finally) allowing it to reason over more document sources including emails, chat, meeting content and files etc making this much easier to get documents created while referencing multiple sources of information.
7. Copilot Enhancements in Teams
Improvements are coming to Teams based on user feedback. Copilot can now reason over chat in addition to meeting transcriptions. This entered public preview today.
8. Copilot in Outlook Improvements
Outlook’s new Copilot feature, ‘Prioritise my inbox’, organises emails based on topics, keywords, and important people. It identifies important contacts like your boss and their boss, enhancing email organisation and efficiency.
Since Copilot can reference emails, meetings and attachments as well as knowing who your colleagues are when you are drafting it can save a huge amount of time as it understands the context in which you are working. This new feature is rolling out now, with early access for some insider rings.
Summary
As I am sure you are, I am excited about these new features (and there’s still more to come) and improvements and look forward to your feedback on the announcements.
In summary, here’s what was announced again and when it will be available (according to Microsoft).
Image/Table – (C) Microsoft.
Are there things you were expecting to hear about but didn’t? Oh and if I missed anything, let me know!!!
What’s one of the biggest stumbling blocks to incorporating AI tools like ChatGPT and of course MicrosoftCopilot into daily work? Well, I can tell you that from first-hand experience is it not knowing how or when to use it. In this blog I’ll explore a few scenarios where I believe anyone with a Copilot License can start seeing real tangible value from GenAI today.
What is Copilot in Microsoft 365?
I’m hoping by now that I don’t actually need to answer that one, but… In short Copilot for Microsoft 365 is Microsoft’s Generative AI chat bot, that is grounded (meaning it has access to) your Microsoft email, chat, documents and more and is also integrated (natively) into all your Microsoft 365 apps and services like Word, Excel, Teams, Outlook, Loop etc.
The goal of Microsoft 365 Copilot is to make us all more productive and creative what ever job we do and results from many of the customers we have been working with this past 12 months is impressive.
Overcoming the adoption hurdle
The biggest hurdle to getting regular and good results with Copilot is actually not what the tool can do or can’t, the expertise around ‘good prompting‘, as important as it is, but is in fact, realising the benefits of making Copilot part of everything you do through habit forming.
To do this, we need to get into the habit of using Copilot every day to really see the value we get from it little by little. many of our customers have this same problem and it’s not a Copilot thing, it’s a new technology thing. We are all so busy doing our jobs that many don’t have time to learn new things or try new ways of working.
Good adoption and successful use of any technology requires some input and perseverance from us as users. As we realise the value, we use these technologies more and the value we get from increases exponentially. Think about the first time a company introduced a word processor in place of a typewriter for example!
Adoption and Change Management, whether run internally (as part of any technology deployment) makes a huge difference to successful deployment and Copilot is a big change in how people work and what it can do, so it does need to be handled that way. Stats show that technology projects that have a proper adoption and change programme linked to them are significantly more likely to deliver the desired return on investment. According to Microsoft, proper change management can lead to 85% of users finding tools like Copilot helpful in getting to a good first draft faster.
Adoption and change management is not just training (though that is of course part of it). Its about helping people learn the tools within their roles, to see the benefits and to tell/show other team members so they learn and benefit together. At Cisilion, we know (first hand) and through the dozens of customers we are working with that one of the primary blockers to adoption of Microsoft Copilot is simply not knowing how or when to use it and so simply “forgetting about it”.
My Copilot Hero Scenarios
What follows next is 3 (three) Copilot for Microsoft scenarios that I use all the time that I can honestly say have become habit forming for me and many of my team.
Goodbye Internet Search: Firstly, I very rarely now ever use internet search to find information. Both in work and personal life, whenever I need to find information about something I turn to Copilot. Whether I’m looking at finding out about a new product, event, news story or whether it’s in my personal life, Copilot just gives me the details I need in seconds rather than giving me a page of search results which I have to sift through manually to see what is relevant. If you use SharePoint at work – this becomes even more powerful!
Email and Meetings (and calls): These are definitely the biggest use cases for Copilot in my daily routine. I simply don’t work or handle email and meetings in the same way anymore. One of the things Copilot can do really well is summarise what’s in my inbox and prioritise requests and things that need my attention – especially If I have been away for a few days. The same goes for meetings. I can pay more attention “in” meetings and have Copilot tackle notes for me, summarise things or even check things for me.
Copilot can summarise actions, clarify points, and what is really cool is that it can do this for me even if I can’t actually attend the meeting (through a new feature called “Follow a Meeting“. Copilot in Outlook can summarise long email threads and can even draft replies for me in a professional manner so all I have to do is edit and refine before clicking send. Copilot also works on phone calls if you have Teams Phone by the way!
My Goto First: Copilot is the first place I go when I have a document, presentation or other document to read or reference. What do I mean by that?
Like us all, I get sent a lot of documents to read, review and comment on. I am now in a habit (I think it’s a good one) of using Copilot as my assistant as my first point of call every time. I always ask Copilot to summarise the document (Word does this automatically now when you open a document) so I can quickly understand the key points of the document before I read it more deeply. This is useful for getting up to speed quickly, determining if I need to read it (guess what – sometimes I don’t) or to help me understand the theme as I do read it. I also use Copilot to ask questions about a document (PDF, Word, PowerPoint etc).
I can also ask Copilot questions about the document such as, “does this business case make a clear and strong argument“, or “what is the financial impact of this proposal“, or “what risks have been identified in this project plan“, etc. I can use Copilot to help me spot gaps, or areas that the author might have overlooked or omitted. I can also ask Copilot to summarise things I do not understand in a simpler language or to help me get a new perspective on something.
Summary
Using any new tool, like Copilot sometimes takes time to realise the true value and power of what it can do. Working with Gen AI like Copilot is as revolutionary as the internet was back in the 90s. Many doubted it and now the world would stop without it.
If you are lucky enough to have a Copilot for Microsoft 365 license, then I suggest you try the above. Use it every day and share your successes with your peers. If you don’t have an adoption and training team in house, then reach out to a partner for help, check out the adoption hub at Microsoft or get some ideas from my other blogs, or from YouTube 🙂
Remember, think about and push Copilot to help you get more value at work and at home. Before starting any task, such as a presentation, meeting minutes or follow-up or research, think “Can Copilot help me here?“
Yes – there’s a bit of a learning curve, but the effort you in will be worth it (IMO).
Some video links…
I have a growing handful of use case and scenario videos I am happy to share below… Hope you find the useful. If you do.. Let me know.
Mark your calendars for September 16th, as Microsoft is set to unveil the next phase of Copilot innovation!
Hosted by CEO Satya Nadella and VP of AI at Work Jared Spataro, this short event promises to showcase the next phase of what will continue to evolve the Copilot revolution, which will further see the evolution of what is becoming a game-changer for businesses and tech enthusiasts alike.
What to expect.
There a bunch of things I am expecting to see based on the agenda, the Microsoft 365 Roadmap and other Microsoft posts and community updates. As such here’s what I’m hoping we hear about.
Rebranding and New Features: it will be goodbye to “Copilot in Word” and hello to “Microsoft 365 Copilot in Word”. Yes the kind of re brand and renaming have already announced they are rebranding its Copilot products in a goal to provide a more cohesive experience and consistency in naming. We have already seen this change from Microsoft 365 Copilot to Microsoft Copilot in Microsoft 365…
New Business-Focused Enhancements: With a focus on the business side of Microsoft’s Copilot offerings, they will focus on real life example of how these AI tools can revolutionise the way companies operate with an increased focus on smaller businesses along with enhancement for large enterprises.
From Preview to Release: we expect some of the services like Copilot in Excel to finally become “available” after being in preview for a year, updates to PowerPoint and for Team Copilot to go into public preview and more of the roadmap features to start rolling out such as scheduled prompts and proactive catchup.
Copilot Pro for consumer: I’m hoping to see updates and new features to Copilot Pro Updates. While details are still “under wraps” , I anticipate new features will be announced such as being able to reference files (something Copilot in Microsoft 365 already does) and maybe deeper integration into other apps to make this £19 monthly subscription more worth it.
Registering for the event.
The event is live (and will be available on demand) so to make sure you do not miss out on this chance to elevate your understanding of AI and its potential, Register below.
Back in May, Microsoft unveiled the next generation of PCs with the Copilot + PC which was released for consumers. Today (4th September 2024), Microsoft has once again set a new benchmark with the introduction of Copilot+ PCs for Business users.
Like their consumer counter parts, these next generation “AI devices”, which include the Surface Pro 11th Edition and Surface Laptop 7th Edition, are designed to revolutionise productivity and creativity in the business world. Copilot+ PCs are also shipping from other OEMs such as Dell, Lenovo, Acer, HP etc.
Copilot+ PCs are equipped with the most powerful Neural Processing Units (NPUs) available for Windows PCs, delivering blazing-fast processing power. This allows businesses users to handle the toughest tasks with ease, up to 90% faster than previous models. The integration of advanced AI features, such as live captions and real-time translations, ensures that your team can work smarter and more efficiently.
This blog, re-dives into the main differences between Copilot+ PCs and “non-Copilot PCs”, the improvements over previous models, and why these advancements are crucial for businesses and aims to answer the “why now” questions.
Non-Copilot PCs: Traditional PCs rely more on cloud-based AI processing (since they did not have NPUs), or required the CPU to do the grunt work, which can slow down performance and is dependent on internet connectivity.
Non-Copilot PCs: While still powerful, these devices do not benefit from the same level of AI optimisation and processing efficiency, due to lack of NPU which are key for efficient processing of AI workloads.
Non-Copilot PCs: Typically rely on Wi-Fi or wired connections, which may not offer the same level of mobility and security.
Power, Performance, Productivity
This is the “why now” for Copilot+ PCs. More than just a device refresh, this new class of devices brings exceptional performance, never seen before battery life and the fastest application performance on Windows to date.
Built around the user – Surface Copilot+ PCs provide a seamless and intuitive experience. These devices come with features like adaptive colour, optional OLED and HDR displays, and a flexible kickstand (Surface Pro) making them adaptable to any work environment. The all-day battery life (up to 22 hrs) ensures that your people stay productive without frequent interruptions.
Security: Copilot+ PCs come with advanced security features, including the Microsoft Pluton security processor and Windows Hello biometric authentication. Together these provide robust protection against both physical and digital threats and work seemlessly with your device management tools such as Intune. This comprehensive security framework ensures that your data remains safe and easily managed across the organisation. These enhanced security measures in Copilot+ PCs provide a higher level of protection, making them a more secure choice for businesses handling sensitive data.
Future Proofed Investment : As businesses increasingly turn to AI to innovate, having the right hardware is crucial. Surface Copilot+ PCs are built to scale and adapt as AI capabilities evolve, ensuring that your investment remains relevant and valuable. These devices support local development and execution of AI models, providing the agility needed to stay competitive.
What SKUs are available?
As discussed, there are two standout devices – Laptop 7, Pro 11 and the Surface Pro 5G. Here are the key specs and features from a hardware perspective to note:
Surface Laptop 7
Launch Date: 12th September 2024
Size Options: 13.5″ and 15″
Processors: Snapdragon® X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)
Graphics: Qualcomm® Adreno™ GPU
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
Copilot Key: Yes – for quick access to Copilot in Windows 11
Surface Pro 11
Launch Date: 12th September 2024
Processors: Snapdragon® X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)
Graphics: Qualcomm® Adreno™ GPU
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
Copilot Key: Yes – for quick access to Copilot in Windows 11
Options: New flex Premium keyboard designed to be used either attached to your Pro for the ultimate laptop set-up or detached as a standalone keyboard for a new level of flexibility.
New Surface Pro 5G
Launch Date: October 2024
CPU Options: Available with Intel I5/I7 and Snapdragon X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)/ Intel AI boost
Graphics: Qualcomm® Adreno™ GPU / Intel graphics
Copilot key: Key – for quick access to Copilot in Windows 11
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC– Allows use the built-in NFC reader to sign in with an NFC security key.
Conclusion
Surface Copilot+ PCs stand out due to their advanced AI integration and superior performance. Unlike non-Copilot+ PCs, which may lack dedicated NPUs, Copilot+ PCs offer specialised hardware designed to handle AI tasks efficiently. This results in faster processing times and more accurate AI-driven features.
Video (c) Microsoft
Surface Copilot+ PCs are not just another piece of hardware; they are a strategic investment in your business’s future. By equipping your team with these advanced devices, you can unlock new levels of productivity, security, and innovation, positioning your business for success in an AI-driven world.
Copilot is a super powerful tool but if you are not getting the results you expect, you might be “using it wrong”. This is based on my experience working with organisations large and small over the past year or so.
Momentum continues to increase and we are seeing more and more public case studies show casing the value of Copilot for Microsoft 365. These focus on the “huge” time savings and efficiency gains organisations such as Barnsley Council, Clifford Chance, and Hargreves Lansdown experienced and how it’s now a tool their employees would not be able to give up.
Getting to this stage is not as simple as just allocating a license and turning it on. The “view” of Copilot I see in many organisations, is very different and as such is so important organisations get off on the right foot with Copilot to ensure that their early experiences with Copilot go well, they understand and evaluate where and how it fits and also where it doesn’t (or doesnt yet).
It all starts with the right expections
It’s hardly suprising that expectations of what Copilot can achieve are high. It’s not that they shouldn’t be, but we need to remember that most of what we see online and in demos are staged, based on the “perfect use case”, data in the “right place” and with Copilot embedded across all your apps and services.
You need to make the cool aid before you can drink it.
There are two scenarios with Copilot which I commonly see.
First there are organisations that grab a handful of licenses, allocate them to a bunch of people and then expect Copilot to know everything about everything and do anything you can think of – setting themselves up for a fail or “less successful” trial.
Secondly, there are those that follow the general guidance shared by Microsoft and their Copilot partners, who build a pilot team, annonce the trial (and what they expect of the pilot users), train and educate their users and share feedback amongst the teams to ensure everyone learns from each other before they expand it to more people.
Whilst the second approach, almost always succeeds (assuming the pilot team are engaged and are open to sharing), I still find (in both scenarios) that part of the reason Copilot trials/pilots can fail quickly is that, in my experience, “people” try to go from zero to hero and rather than looking for many small gains, are trying to get Copilot do that one big thing that will totally change their workload and save them hours of manual effort per day or week.
I find this problem goes away in the main, where organisations are working either directly with Microsoft or via their Copilot Adoption Partner, since the specialists they work with have the time to work with the employees to not only coach them through how and what Copilot can do, but also where it (on its own) may not be the answer they are looking for.
So in short, I find that, many people are simply using Copilot wrong, misunderstand what it can and can’t do and then simoly give up on it and go back to what they did before.
It’s not Copilot it’s you!
In this blog, I am going to share the most common Copilot mistaken use cases that make people the most frustrated….and how to fix them….
1. Trying to use Copilot as an automation tool
This is very common. I often see people who have watched the Microsoft marketing videos (often sequence shortened) contour up an image in their mind that Copilot will solve all their business challenges. I see organisations map out end to end business processes they “would like” Copilot to solve for them that are, to be frank, sometimes outside of what Copilot is really designed to (or is able) to do.
Copilot is not an RPA (Robotic Process Automation) tool. Yes, it can do many many things for you – such as reviewing documents, summarising meetings and actions and creating other “things” from them such as summaries, presentations or new documents.
One of things I hear a lot (and experience) is often that Copilot doesn’t (or wont) do things in exactly the way I ask it to and it can be inconsistent if I ask the same thing twice.
This is true and it is one of the “behaviours” of Copilot (and other Generative AI tools like ChatGPT or Gemini). I do find the more specific I am, the more “similar” my responses from Copilot become, but it’s serves back to the point that Copilot is not designed to carry out multi-step activities with a fixed predetermined output. It is also not currently possible to schedule or trigger Copilot based on an event or other trigger. See Prompting.
Tip: Understanding the value and use cases of where Copilot fits into the business process and workflow is key to getting the best results. There are many areas where Copilot will provide real business value (either as a first eye, second opinion, note taker, author or creator). Working with a Copilot specialist partner or building a team of them internally will help the rest of the business get used to working “with” Copilot as the “assistant” it is expecting to be.
One of the most common pitfalls in adopting Copilot is overlooking its grounding capabilities and limitations. Grounding is the term that refers to the context of the data Copilot can access/will access to perform the request you pass it.
One of the unique values of Copilot for Microsoft 365 over “other” Generative AI experiences, is its deep-rooted access, context awareness and understanding of your business data [through the Microsoft Graph] to enhance its functionality and response. This means that, in short, you can ask Copilot about a particular file that someone shared or a meeting you had last tuesday and it will understand the context and content of that scenario and base it’s response around that. This is hugely value and one of the reasons it has so much value in the workplace. You can also point Copilot at specific content that is within your organisation (though these connected services) or via a URL – for example web content.
The limitation of this grounding is also it’s benefit, in that for Copilot to be able to interface with your data (or application services), that data needs to be connected to the Microsoft Graph through either a connector or plug-in. These are sometimes provided (at cost) by the third party provider or can be built by your devops team or your partner.
This is important because if your employees work off data that is stored primarily in a Document Management System (DMS) that is not connected to Microsoft 365, then Copilot will not have visibility over it or it’s data meaning that employees would need to manually copy and paste data from it, to Copilot in order for Copilot to do anything with it.
Tip: When running your initial or later stage Copilot rollout, it’s important to ensure you understand where and how people work in different teams so that you know what data people work on and where it is stored.
This grounding process is key as it allows Copilot to build upon the foundation of previous work, such as project histories or meetings. To maximise Copilot’s potential, it’s important to ensure that relevant data is accessible (through connectors or plug-ins) within Microsoft 365 or stored / migrated to Microsoft 365 (OneDrive, SharePoint etc.). For Copilot to work on meetings, you also need to be using Teams and must ensure they are recorded and/or transcribed.
3. Over simplifying or over complicating Prompts
Another key to Copilot’s effective use is the quality of prompts provided. Unlike an AI powered smart speaker, Copilot can handle really complex and specific requests , allowing you to write up to 2,000 (soon to be 8,000) characters in its input boxes.
This means that prompts can well thought out, detailed and quote refined, leading to more specific and sophisticated responses. I have written other blogs on prompt perfection if you wish to read them.
That said, the key when adopting and getting to know Copilot is to encourage your people / teams to experiment with prompts, iterating them and and refining them to achieve the desired outcomes whilst rememering that the same prompt will rarely generate exactly the same answer.
Whilst simple prompts are often to vague, not specific enough and therefore may not yield the desired/expected results, prompts that are too complex can also be ambiguous, conflict or go “off topic” so getting the right balance is needed.
Tip: Another way to get what you wanted it to make your prompta conversation: Copilot support interative responses meaning that you can have a conversation with it. Writing the perfct prompt is not always easy to do and can be frustrating so feel comfortable in having a conversation with Copilot. You may find the iterative process becomes fundamental to how you work with Copilot and perfecting the response.
You see unlike human assistants, Copilot thrives on repeated, slightly altered instructions to refine its output. This approach requires a shift in mindset from one-shot solutions to ongoing dialogues with Copilot. By embracing this iterative process, businesses can tailor Copilot’s responses to their specific needs more effectively.
4. Not feeding Copilot properly.
One of things I often find when working with Copilot on more “complex” prompts and tasks is that you can tell it to base its response or output based on a specific file that contains the things you want Copilot to do / check / review for me. Whilst Copilot can leverage the Microsoft Search (via Graph API), if you know what file(s), meeting, person etc, you want Copilot to leverage, you can include that in your prompt.
In the example below (a real one that I was working with a customer on), you can see that we are using to Copilot to review some CVs against a Job Description and Criteria document.
Example Copilot for Microsoft 365 Prompt – Grounded with specific data/files
In this example, I am “feeding” Copilot the CVs I want it to review along with a Job Requirements document which contains a table of criteria about the role and the scores available based on this criteria. This means I can focus my prompt on what I need Copilot to do for me using existing data which is used to “ground” it’s response.
Tip: One of the bug bears I hear alot around Copilot is why it can’t fill out a form for me. It cant. However…. you can ask Copilot to create an output for you based on an existing document. The video below shows an example of doing just this.
Conclusion
The integration of Copilot for Microsoft 365 presents a transformative opportunity for businesses.
By educating employees, understanding its grounding capabilities, mastering effective prompting, practising an iterative approach, and implementing a strategic adoption plan, businesses can position their organisations to really see the benefits of Copilot.
I hope the tips above help – welcome your questions and views.
Qualcomm’s Snapdragon X series processors are specifically crafted for PCs, particularly Windows on Arm and Copilot Plus PCs available from HP, Dell, Lenovo, Acer and of course Microsoft Surface. The processors inside these latest generation of devices, integrate the renowned Snapdragon technology from premium smartphones with the demanding performance needs of the PC domain. The goal is to deliver a processor that competes with Intel and Apple in terms of performance, while also offering the energy efficiency typical of smartphones and providing cutting edge NPU performance to power existing and upcoming AI powered applications.
Arm vs Intel: The Copilot Plus PC Revolution
Copilot Plus PCs, like the Surface Laptop 7 are powered by these Snapdragon X Arm chips. The fundamental components shared by all Snapdragon X series chips include Qualcomm’s custom Arm-based Oryon CPU, rather than Intel’s x86, an enhanced version of their Adreno GPU (derived from their mobile devices), the Hexagon NPU for on-chip AI capabilities, and cutting-edge networking technology supporting the latest Wi-Fi 6 & 7 and 5G standards.
On the software front, Microsoft offers an emulation layer within Windows on Arm (WoA) to facilitate the running of x64 applications not yet native to Arm processors. Notably, there is an extensive collection of native Arm applications from Microsoft, Adobe, and other prominent developers.
About the Snapdragon X chipset options
Snapdragon X comes in two major flavours. The X Elite, which powers the first wave of top-tier Copilot Plus PCs, and the X Plus, destined for the more affordable range of Copilot Plus PCs (You’ll see most vendors providing options for both).
Today, Qualcomm has a total of four different Snapdragon X SKUs – three under the X Elite branding and one more affordable X Plus unit. You can see the subtle differences below, with the main differentiator being CPU cores and performance.
All current Snapdragon X models boast a remarkable 45TOPS Neural Processing Unit (NPU), which means they are all equipped to handle the same AI features. An NPU enhances the traditional CPU by adding machine learning (AI) specific computational abilities. An NPU is not only faster but also more energy efficient. This offloads work from the CPU, allowing the NPU to manage AI tasks, similar to how a GPU handles graphics-intensive tasks.
Snapdragon X Elite
12 Oryon CPU cores
Clock speeds up to 4.2Ghz
4.6 TFLOPS GPU (Graphic Processing Unit)
45 TOPS NPU (Neural Processing Unit)
Snapdragon X Plus
10 Oryon CPU cores.
Clock speeds up to 3.4Ghz
3.6 TFLOPS GPU
45TOPS NPU
What about the new Surface Line up?
Snapdragon X offers competitive performance against not just Intel’s latest chips, but also against the Apple M3 and M4. The real star though (not a fan of just CPU benchmarks personally), is that battery life is simply incredible compared to previous generations of devices with initial testing and reports (from others such as here and here) showing these devices comfortably exceeding the demands of a busy workday, positioning these laptops as genuine contenders to the MacBook (which has always somehow always won for battery life). Running emulated x86 apps under emulation will (and does) run the CPU harder which will in turn impact battery life.
This next generation of AI powered PCs sch as Surface Laptop 7 and Surface Pro 10 are two such devices offering superior power, power efficiency and extreeeeeeemley long batter life.
Battery Life Wins
That said, tests by PC Magazine, revealed a result of almost 25 hours usage – making “Surface Laptop one of the longest-latest laptops we’ve ever tested on battery“. In comparison a 13-inch MacBook Air lasted “just” 21 hours and 38 minutes in their testing.
Surface Pro 10 and Surface Laptop 7 are the the first Copilot+ PC which feature these new Snapdragon X Elite and Snapdragon X Pro processors.
PC Magazine said in their comprehensive hands-on review of Surface Laptop 7 that
“…this is easily the best Arm chip we’ve tested yet in a PC. The CPU and GPU performance are there and deliver at least competitive benchmark numbers relative to current-gen Intel and AMD offerings in the early going. Qualcomm is to be commended for that.” | PC Magazine
What is your view on these Copilot Plus PCs? Have you got one yet – what are your first impressions?
In my work life, I am a Technology Officer for Cisilion (a leading UK Microsoft and Cisco technology and service integrator and enabler), but beyond work, I love technology and more importantly, I love to find ways in incorporate new and emerging (or just plain cool) technology into the everyday lives of myself and my family. I’m also a Microsoft MVP, which means I have even more reasons to be a fan and supporter of some of the best and Microsoft – these include Microsoft Designer, Microsoft Clipchamp and of course Microsoft Copilot!
In this blog (with some videos along the way), I’ll show you some of the ways we incorporate the latest Microsoft products into our family activities, routine, and life.
This blog will focus around the recently released Microsoft Designer – which we have been using throughout its development – you’ll see just what a simple to use, yet powerful tool this is and how it has allowed me to blend my professional expertise with my role as a parent and cub leader.
For those new to Designer – you can access it on the web https://designer.microsoft.com or via the mobile app on iOS and Android.
Setting the Scene – About our Family!
I’m married, we have a cat and two young boys (currently nine and seven), the youngest is autistic and the eldest is ADHD (though not officially diagnosed). This means attention to detail is really high, yet patience is low, and they both hate waiting for things or things that take too long and are “boring” are a no no! One loves trains and the other planes (and trains). We created this design in Designer for Christmas Cards in December 2023 🙂
In my work life, I am a Technology Officer, my wife is a teacher that specialises in Special Educational Needs, and in my “spare” time I am a Cub Scout Assistant Leader in my hometown of West Wickham in Kent. My kids love trains, and everything related to them and much of our family time is spend satisfying their craving for train related activities…
Work / Technology Blogs
In my line of work, personal (technical life as a Microsoft MVP) and side-blogger, I use Designer to create inspiring, original and personalised images for blog covers and articles.
The example below is an image design I asked Microsoft Designer to create introducing the new Cyber Security bill announced at the recent Kings Speech in July 2024.
Image Created with Microsoft Designer for a recent Blog
Inspiring Young Minds – Scouting
Consistently looking for ways to ensure young people are ready for the world and life ahead of them, scouting is great. The children learn about working together, solving problems, critical thinking, empathy, the role of people in a community as well some great “life” skills such as exploring the great outside, camping, orienteering, first aid and safety and caring and supporting others.
Technology is a given in schools (well many), the workplace and in the home, but less so in scouting. In the past year, we have been looking at more ways to integrate technology into what we do in simple, yet inclusive ways.
This past year we have been using technology subtly within the “curriculum” without impacting the practical and outdoor nature of the groups purpose. We have digital badges and creative projects and decided early last year (2023) to blend AI design creation into the Cub Scout Group.
After some simple interactive design sessions, we soon had the Cub Scouts designing custom badges, event posters (for a gang show), and promotional advertising (shared over parent social media groups, which not only added a digital touch to what we did, but sparked curiosity and awareness.
Then, last Christmas, the Cubs raised some money for Crisis at Christmas (which fund Christmas dinner and shelter for homeless people) and they together in in groups, created some banner/posters. This was the “winning” one which we used to share the donation to Crisis with
Winning Designer Image from 1st West Wickham Cubs
New Business Ideas
In May 2024, my wife, marketing manager, turned mother, then childminder and now Deputy Pre School manager is looking to venture out and start her our Pre-School aimed at children with Special Education Needs. She had contacted a couple of small graphic design companies to get quotes for a logo design, but then turned to Microsoft Designer Image Creator to see what it could produce. Once she overcame the DALLE-3 “wording and spelling challenges”, she very quickly has a design she loved which she then polished off in Designer Editor. This took minutes and saved her at least £100!
Logo for a new “coming soon” Pre-School
Educating Young People – Showcasing AI Design to Year 2 and Year 4
Towards the end of the summer term, parents were invited to come into my children’s school and talk a bit out their job and an what they do. I had 30 minutes with two classes of year 4 children, followed by a the same with two classes in year 2.
Part of my “talk” involved an interactive session with the children, where we talked about how AI would impact every part of their lives and jobs and used a combination of Microsoft Designer and Microsoft Copilot to create a class mascot and a story to go with it.
End of School Year – Thank you gifts
As the school year ended for my children at the end of July, we bought small teacher gifts and my eldest (nine), took to Designer to create some stickers we could print on sticker paper and attach to the gifts to give them a personalised touch.
Microsoft Designer sticker creation handled the task nicely. We took the images, dropped into PowerPoint to duplicate, and size them, and printed out the stickers to add to plants and chocolates we’d bought/grown for the teaching staff and assistants.
Supporting my children’s passion for Trains
My wider blog on Designer’s capability, is focussed heavily on how we use Designer to add some flair into my son’s hobby around trains and travel. We spend most weekends riding trains, visiting train museums and doing videos about different trains, train lines and doing little challenges.
As we aim to “promote” his videos a little more, we have taken to Microsoft Designer to advertise his work.
Using Microsoft Designer to promote upcoming videos….Endless fun creating different train related images on Microsoft Designer.
Improving our promoting skills
Finally, working with Gen AI tools is a skill in its’ own and takes practice and experimenting to get the “perfect image”. There is a great community of people on social media, including some of the @MSFT365Designer team and users. It’s great to get inspiration from others, share your prompts and take on the challenges of creating new and exciting images.
Why not get involved… Don’t forget to #MicrosoftDesigner.
Get involved in the AI Design Promoting Community
Thanks for Reading
Thanks for reading – I hope this gives some inspiration around how you could use Microsoft Designer for work, personal life, hobbies and more.
I have written a wider blog with video guides about how to use Microsoft Designer, which goes into examples of different ways to use it.⬇️
Microsoft is yet again at the forefront of an AI powered design revolution with formal launch of their AI-powered Designer app which is available on web, and mobile (iOS and Android) after being in preview for a year.
Designer is built all around speed and simplicity, empowering users of any level to quickly create custom images, stickers, greeting cards, and invitations with a professional touch using a wide array of tools, simplified editing tools, a fresh and clean UI and rich AI editing capabilities.
Designer is also free though it does require sign-in with a Microsoft MSA app or Microsoft 365 Personal or Family account. Designer features are also popping up on Commercial apps and services such as Teams. More on this later in the blog.
To do this, simply add square brackets round the elements you want to be “custom” and share the prompt… You can also try many of the pre curated prompts that Microsoft provides in the examples in app.
One of the newest things which was introduced at launch was the concept of design prompt templates. These make help #DesignerCreators with ideas, along with editable prompts to help creative minds get to work quickly. You can simply make any prompt you love (or that people share) with you in a sharable and editable prompt.
To do this, simply add square brackets round the elements you want to be “custom” and copy the prompt to share it with others… You can also try many of the pre curated prompts that Microsoft provides in the examples in app.
Let’s dive into some of the key features. For those that know me, my children love London trains, so the theme of my feature explanation and examples will be very “train centered“.
Firstly, Designer has a rich set of starter apps and templates to help you achive a particular design related task – these range from AI image creation, to greeting cards, social media posts and much much more. You also get some great starter prompts too or creations you can use to get you started if you are having a bit of mind blur! You can access these visually or from the <create> menu at the top of the home page.
Powerful integrated or standalone apps and tools
Designer comes with a full design canvas (this was actually the first part of Designer that was built when the beta debuted about a year ago) along with a growing number of mini apps which make doing simple AI assisted tasks easy and quick. Many of these can also be accessed via the main Designer Canvas (which I highlighted above).
Creating a design from scratch with Microsoft Designer.
The video above is aimed to be a simple whistle-stop tour of the Microsoft Designer Interface. I have used a blank canvas to show just how easy and intuitive it is to create a design from scratch – which in this example is a new design that we will use to promotes my son’s next Train Themed YouTube video.
The sections that follow focus on some of the standalone apps and features that Designer brings in its AI Image Treasure Trove – keep reading!
Using the Designer (mini-apps)
The mobile app – Bringing AI Editing on the Go
The Designer mobile app brings the power of AI editing into the palm of your hand.
It’s a modern, clean app and provides most of the features you get in the browser version with a few things missing – more on that later. In short, you can use the mobile app to easily create images, cards, collages, invitations, drawings and generate decorative borders. The app is also slick and fast – a well-designed and written app.
Since our boys are really into trains, the theme of this and most of the examples will be around trains, as most of our weekends involve trips to train stations and journeys on different trains!!
Starting off, here’s how we used designer to create some inspiring images around the London Underground – using the Designer Mobile App.
The app’s intuitive interface makes it simple for anyone to enhance their creations with a professional touch.
The image below was created with a simple prompt. Designer will even suggest tweaks as you type to help make the image more vibrant and exciting.
Example: Image Restyling
Imagine you’ve taken a photo that’s perfect except for one detail. With Designer, you can easily edit that detail without affecting the rest of the image. The AI-powered tools can recognize and isolate different elements in your photo, allowing you to make precise edits.
Again, this is so quick and easy to use – simple open the tool, select a picture from your gallery (if you have pictures you want to use from your mobile, then you can either use the Phone Link or app, or the QR Code which you can scan with your phone that opens on your phone and lets you simply choose images from your mobile).
You then just choose the restyle image type you would like such as drawing or Claymation, add an optional element and off you go.
Now my only critique with this service/tool is that is not yet available on the mobile app – which to me seems an obvious one to include in mobile – shoot ➡️restyle ➡️post on social.
Example: Collage Creation
Creating a collage is usually quite a time-consuming task and tricky, but not with Designers Collage Creator. Here you can choose/select the photos you want to use, and the Collage app will automatically arrange them into a stylish collage. You can then adjust the layout, add text, and apply filters to perfect your collage.
When you open the Collages app, Designer gives you a set of example designs to give you inspiration or you can start from scratch. You can upload images from your device (or mobile using the QR Code), select background frame design you want and let Designer do its thing. Let’s see in action below…. again, sticking to the train theme!!
Greeting Cards
So, following a trip to London Charing Cross, where my boys got to have a tour of the station (behind the scenes, we used Designer to quickly create a thank you card. For this, we used one of the sample cards and simply modified the prompt. Let’s see this in action.
Create your own ClipArt (and Stickers)
One of the other cool features in Designer is the ability to create Stickers and Clipart. These are quite similar and create process is the same. The main difference being that Stickers have a nice cut-out-able border round them whereas Clipart does not. The main reason for separating them out (I think) is that it’s easier to distinguish between the two types of images – as in, it helps spark imagination.
Designer Clipart (and sticker) creation with a simple prompt.
Here’s another “Train” themed image we created – this was ClipArt using Designer. In the screen shot above, you can see the simple prompt we used and the options it gave us.
Wait there is more – Integration across your Microsoft Apps
The standalone Microsoft Designer app, whilst super intuitive and packed full of features is just the beginning – yet this is just the beginning of the Designer journey. Whilst much of the roadmap is under NDA still, what I can tell you is that Microsoft has already (just) seamlessly integrated Designer into Copilot (both in Copilot Pro for consumer and in the corporate Copilot for Microsoft Space). This has the effect of enhancing capability in apps like Word and PowerPoint, whereby users can now ask Copilot to generate images and designs directly within their documents, streamlining the creative process and making content more personalised and unique.
We have also seen Designer get native integration into Teams Channels and Chat and you’ll start to see it make more appearances across the other Microsoft apps and services.
Designer Document Integration in PowerPoint and Word
Imagine you’re working on a report in Word, or PowerPoint and you need an AI generated graphic to illustrate your point. Instead of switching apps and copying and pasting, you can now use Designer right within Word and PowerPoint to create a custom graphics that fits perfectly with your document’s style and content.
To do this, you can simply ask Copilot in Word or PowerPoint to create an image for you.
Why You Should Try Designer
The Designer app is more than just a tool; it’s a gateway to unleashing your creativity. With its user-friendly interface, AI-powered editing tools, and seamless integration with other Microsoft apps, Designer simplifies the design process, making it accessible to everyone, regardless of their design experience.
Whether you’re a professional designer looking for a convenient way to work on the go, a marketeer who needs some new ideas, a student needing to create presentations for school, or someone who enjoys creating personalised greeting cards for friends and family, Designer has something for you.
Moreover, with the daily boosts offered by Microsoft, you can explore the full potential of the app without any cost. And if you find yourself needing more, the Copilot Pro subscription is a worthwhile investment for the additional benefits it provides.
Conclusion
Microsoft’s Designer app is a game-changer for creators of all levels. With its user-friendly AI tools and cross-platform availability, the possibilities are endless. Embrace the future of design with Microsoft Designer. Try it and use it for free today and see how it can transform your creative process.
As we enter Microsoft’s new fiscal 2025, there a bunch of enhancements coming across the board to the Copilot experience inside the Office Copilot experience which im[acts PowerPoint, Word, Excel and Microsoft Loop. Microsoft regularly update the Office Apps, Team, and rest of their products, including Copilot, but the changes rolling out feel more like a “service pack”!
Here’s the key things coming to the app experiences this month and remember, you can always access the Microsoft 365 Copilot Roadmap –> here <–
AI Powered images coming to PowerPoint and Word.
Microsoft are making it much easier to add visuals to both Word and PowerPoint documents with Microsoft Designer in Copilot. This will make it much easier for content creators to get the right image for a document or presentation and will add to the image options within these apps.
With this update, you will be able to create AI-generated image directly from Word and PowerPoint with a simple prompt in additional to using the existing options for stock images as before.
Up until now, this has required users jumping to a browser to create an image in Bing Image Creator or Microsoft Designers, whereas now, they will be able to do this straight from the Copilot prompt in Word and PowerPoint upon which they will be able to create an image from scratch or find and use an existing image from Microsoft’s stock photography library to select from. Microsoft say that PowerPoint, Designer will automatically add the image into a “compelling slide design”.
Image (c) Microsoft
Additional “Document Support” in PowerPoint
Also coming this month, Copilot will support grounding for presentation creation from both encrypted Word documents and PDF files, providing more options for users to create presentation from. This gives users richer context to build new presentations, in addition to referencing.
Copilot in PowerPoint “General Improvements“
Rolling out in June/July and following lots of feedback from users, creating a new presentation from a Copilot is about to get much better with regards the quality or presentations created with more relevant content and images and improved consistency including:
Refined designs for title, section, and content slides.
Improved presentation structure with agenda, section and conclusion slides.
Enhanced abilities to improve transitions and animations across presentation content.
Copilot is also getting the ability to ground itself on your organisations’ people-centric data and insights from the Microsoft Cloud, Microsoft Graph, and the web using Bing Search. This brings Copilot up to the same level of that of Teams, Copilot Chat and Outlook, meaning that users can stay in the app, ask questions, and maintain focus on creating their presentations without having to jump into dfferent apps or windows.
Copilot in Excel is coming out of Preview
In July, Copilot in Excel is also coming out of “preview”.
The first noticable indication will be that Microsoft drops the “in preview” lable that users currently see when using Copilot in Excel.
Secondly, Copilot in Excel is also getting expanded data structure support, meaning it wont be limited to working with just data in tables. Yes, Copilot in Excel will be able to works on data ranges resembling tables so long as the data being worked on contains a single row of headers on top (such as filtered data). Along with this, Copilot in Excel will also now be able to provide more comprehensive answers, just like Word and PowerPoint, Teams and Outlook,
Next up, the edit box will be available on any Excel worksheet, regardless of the selected cell and Copilot will reason over the nearest table, or data range resembling a table, to the user’s selected grid area on the same worksheet.
Finally, Copilot in Excel will provides more conversational and comprehensive answers to a wide array of Excel-related questions, meaning that users can now receive step-by-step instructions to help with complex formulas, fixing errors in formulas or how to do something in Excel.
Image (C) Microsoft.
Copilot in Loop
Copilot is coming to Loop too – one of my favourite “new” apps, with what Microsoft call “Copilot-assisted Loop page creation”
For those unfamiliar with Microsoft Loop, it is described as “flexible canvases that assist users in organising and sharing their work with teams.”
Loop users can now utilise Copilot to transform a blank page into a structured document primed for team collaboration in record time. Whether starting from scratch or using an existing page or template, Copilot can swiftly generate a Loop page tailored to specific requirements, be it a project plan, a feedback session, or any other collaborative effort.
