Why Microsoft is updating Chat and Channels Experience in Teams

Microsoft Teams has long been a cornerstone for collaboration, and now, with its new chat and channels experience, it’s set to transform how we connect and collaborate even further, makimg it easier to stay in the flow and work with multiple chats and teams channels.

Video (c) Microsoft

Streamlined Communication for Enhanced Productivity

The redesigned interface prioritises ease of use, allowing users to effortlessly triage conversations and stay on top of their most important communications. Whether managing projects, coordinating with teams, or engaging in spontaneous brainstorming sessions, the new experience (which has been in testing for some time) has been designed to ensure that every interaction is seamless and impactful.

Key Features and Enhancements

Intuitive Design: The new layout is simple by default, yet powerful on demand. It’s designed to help users quickly find and respond to messages, reducing the time spent navigating through conversations.

New chat design interface in Teams

The @Mention View: This view in chat gathers all messages directed at you into a single interactive list, making it easier to prioritise and respond to important communications.

The new @ mention view in Teams Chat

Why these changes Matter

These updates are not just about aesthetics; they are about creating a more dynamic and intuitive user experience. By simplifying the interface and enhancing key functionalities, Microsoft Teams aims to boost productivity and ensure that users can collaborate more efficiently and effectively.

New Drag and drop chat and channels in Teams desktop and mobile apps.

User education and readiness

To support users and support staff on the adoption of these new features, Microsoft has provided a wealth of resources, including detailed blogs, instructional videos, and a dedicated microsite on the Microsoft Adoption Center.

These resources are designed to help IT leaders, IT pros, and end users understand and leverage the new capabilities to their fullest potential.


Microsoft is also hosting a live Ask Microsoft Anything (AMA) session on November 12, 2024, where users can see the new features in action and get their questions answered by Teams product experts.


Jeff Tepers’ blog goes into more detail, highlighting the new experience and how it will improve user experience and efficiency Jeff calls it “simple by default, powerful on demand.”

https://www.microsoft.com/en-us/microsoft-365/blog/2024/10/28/streamline-collaboration-with-the-new-chat-and-channels-experience-in-microsoft-teams/



AI-PCs vs Copilot+ PCs: Understanding the Difference

As technology advances, the distinction between AI-PCs and Copilot+ PCs becomes increasingly important. Both types of devices leverage dedicated AI chip sets to enhance the user experience. They support new and upcoming software features. These devices prepare us for the continual wave of AI innovation. Under the name, what are the differences between the specifications and ability of these two types of “next generation” devices?

This blog aims to summarize the similarities and differences between the AI-PC, as dubbed by Intel. It also discusses the Copilot + range of PCs powered by Snapdragon ARM based chip sets.

The AI-PC

AI-PCs, like the Microsoft Surface Laptop 6, are powered by Intel chipsets and are the first of their next generation of personal computers designed to handle complex AI tasks efficiently. These PCs are equipped with Intel Core Ultra processors which also include a dedicated Neural Processing Unit (NPU), which accelerates AI and machine learning workloads directly on the device, providing up to 10 TOPS (Trillion Operations Per Second) of AI performance.

This means faster performance for tasks like real-time language translation, image creation, and enhanced multimedia experiences such as object removal, blur and audio isolation without relying heavily on cloud services or throttling the PCs CPU.

For the average user, this translates to a smoother, more responsive computing experience with smarter features. For IT professionals, it means robust performance for data-intensive applications and improved security through local processing and devices which will perform in a more unified way without “subtle” tasks like back-ground blur in video calls, hammering the CPU or consuming more internet bandwidth.

The Copilot + PC

Copilot+ PCs represent the pinnacle of AI-enhanced computing, designed to deliver unparalleled performance and support for AI-infused applications and extensions. These PCs are powered by Qualcomm’s Snapdragon X Series processors. They feature a turbocharged Neural Processing Uni (NPU). This NPU is capable of performing over 40 trillion operations per second (TOPS). This advanced hardware allows real-time AI functionalities. These include language translation, image generation, and intelligent task management directly on the device. For the average user, this means a seamless, responsive experience with smarter, more intuitive features. For IT pro’s Copilot+ PCs provide more robust performance for data-intensive and AI applications. They enhance security through local processing.

This can also reduce reliance on cloud services with the ability run “some” AI workloads locally depending on what has been coded of course by the software vendor. Examples of this might be background blur which as trivial as it may sound it network and compute intensive and can be performed on an NPU far better and with far less compute power.. This combination of powerful hardware and specialized software makes Copilot+ PCs a significant change in both personal and professional settings.

Copilot+ PCs, on the other hand, take this AI integration a step further. Some examples are the recently released Surface Laptop 7 and Surface Pro 11 devices from Microsoft. There are also devices from all other major manufacturers. These devices feature powerful and dedicated NPUs. They also come with Windows 11 – Copilot “exclusive” software and services enabled. These devices need Copilot+PCs to use them.

Interactions like “click-to-do” and Microsoft’s Recall leverage the advanced NPU’s capabilities. They provide enhanced AI features directly on the device. These interactions reduce CPU and GPU workloads. They allow local AI compute, which will in the long term support local language models.

These devices are powered by Qualcomm’s Snapdragon X series chips, which offer at least 45 TOPS of AI performance. This provides advanced functionalities such as real-time language translation and intelligent task management. It also enables more efficient multitasking. All of these features are included in the Windows 11 24H2 update.

Despite the differences, both AI-PCs and Copilot+ PCs bring enhanced performance for handling AI workloads. These devices provide a more integrated and advanced AI experience, thanks to the combination of powerful hardware and specialised software. At the time of writing the Copilot+ PC range deliver more AI-grunt than AI-PCs. However, the Intel-based AI-PCs will likely be more adopted by large enterprise organisations. These organisations still need to run older legacy applications. These applications have not yet been compiled to run on Windows on Arm (WoA). WoA is needed for Copilot+ PCs which are built on ARM chipsets and not Intel.

Spotting the Difference

The subtle differences between AI PCs and Copilot+ PCs. As endpoint technology continues to evolve, the gaps will most likely close. The 2025 edition of these technologies will continue to evolve. There is also new AI “optimised” PCs from AMD but I have not reviewed these here.

The main way to spot a Copilot+ PC or AI-PC vs an older generation device is the presence of a dedicated “Copilot key”.

The list below highlights the key things found on Copilot + PCs

  • AI Integration: Copilot+ PCs (currently) offer a more integrated AI experience. They include specialised software and features designed to enhance productivity. On the other hand, AI-PCs provide general AI capabilities without the specialized software. Copilot+ PCs are needed to run new Windows features like recall and Click-To-Do.
  • Dedicated AI Key: Copilot+ PCs include a dedicated Copilot key for quick access to AI-powered assistance. This key is not available in “some” AI-PCs. Older generation PCs also lack this feature.
  • Connectivity: Some Copilot+ PCs feature advanced connectivity options. These options include 5G, which is not typically found in AI-PCs or older generation devices.
  • Exclusive Software Features: Copilot+ PCs come with enhanced productivity tools like Recall and Click-To-Do. They also include other third-party features from Adobe, for example.

Conclusion

These new generation of AI-PCs and Copilot+ PCs bring more than just an annual chip set refresh. They are the ennoblement for the current and next wave of creativity. They drive productivity and innovation with the increasing number of AI-powered or AI-enhanced applications.

As always, Surface sets the standard – with their innovative anti reflective and HDR display technology, elegant and sleek design, sustainable and repairable design and unique features like the versatile kickstand along with fluidity of the Slim Pen 2 on Surface Pro, they empower users to achieve more and create without limits.

Windows 365 could be your saviour in the move from Windows 10 to Windows 11

Using Cloud PCs, like Windows 365, could be a strategic move as you plan and migrate from Windows 10 to Windows 11 (which you need to do by October 14th, 2025, if you want to avoid paying for Extended Support Updates (ESU).

Here I discuss a use of Windows 365 as a way to delay the migration to Windows 11, whilst also. Enhancing the migration readienaa, testing and user experience in the Shift to Windows 11 as well as, of course the other benefits that Cloud technology can bring to businesses of all sizes, geographies and sectors.

Why Windows 365?

Windows 365 is a cloud-based service that brings the power and security of a Windows operating system to any device including mobile devices and some modern smart TVs.

Windows 365 streams a full (dedicated) Windows desktop from the cloud, providing highest levels of security, application compatibility and bandwidth optimisation.

It allows users to access their desktop and personalised settings, apps, and data from anywhere with an internet connection and without the need for VPN (though access over VPN or secure remote access is supported).

Image (c) Microsoft

This flexibility makes it an alternative choice for using legacy or older hardware. It is also ideal for bring your own device scenarios and contractors.

Additionally, it supports testing and dual running different operating systems. Benefits around flexibility and accessibility are huge for both users and IT.

Flexibility and Accessibility

  1. Device Independence: Windows 365 lets users access your Windows environment from any device. This includes a PC, tablet, smartphone, and even some smart TVs. This means helps support you can continue using older hardware while still benefiting from the latest Windows 11 features. BYOPC (Bring Your Own PC) is also a key use case.
  2. Secure Remote Work Enablement: Windows 365, helps support hybrid and remote work models. Employees can access their Cloud PCs from anywhere, ensuring productivity and continuity and secure remote access which levergage key Microsoft zero trust security principles include password less, MFA and risk based conditional access.

Management is also super simple with Cloud PC with everything managed from Intune. This includes.

Simplified Management and deployment.

  1. Centralised Management: Windows 365 integrates with Microsoft’s Endpoint Management service (Intune). IT administrators can manage all devices and Cloud PCs from a single console. This simplifies updates, security policies, and compliance management. Cloud PCs can also leverage update technologies such as Windows AutoPatch. For more complex deployments or mixed AVD, Citrix and Windows365 you can also use third party tools such as Nerdio.
  2. Fast Onboarding: Employees (new and existing) can be onboarded quickly by provisioning Cloud PCs within minutes. This reduces the time and effort needed to set up new devices. They can also be accessed across multiple devices for maximum flexibility and agility…
  3. Seamless OS Switching – Windows 365 includes Windows 365 Switch. This feature allows users to easily switch between a local PC and a Cloud PC. Users can be assigned multiple Cloud PCs, for example Windows 10 and Windows 11. This setup is great for testing and learning a new OS like Windows 11.

As you’d imagine, Security is paramount and there’s no shortage of enhanced security for Cloud PCs.

Enhanced Security

  1. Built-in Security Features: Windows 365 includes advanced security features like multi-factor authentication, conditional access, password-less authentication and advanced data encryption. These features help protect sensitive information and reduce the risk of security breaches.
  2. Always Up to Date: Cloud PCs are automatically updated with the latest security patches and updates. This ensures that your systems are always protected against the latest threats. Cloud PCs also support full cloud management technologies include Auto Pilot and Windows Auto Patch.

What about pricing… after all, Cloud PCs require a license subscription to use with pricing for Windows 365 varying based on the specification of the Cloud PC needed.

Costs efficiencies and advoidance

  1. Reduced Hardware Costs: Leverage Windows 365 can help can extend the life of existing hardware (for example hardware that cannot run Windows 11) and reduce the need for frequent hardware upgrades since they can be upgraded with just a change of license key!
  2. Frontline worker efficiencies. Windows 365 Frontline provides the same feature stack and benefits of Windows 365 with the added flexibility to provide Cloud PCs for up to three users with the purchase of a single Windows 365 license, making it ideal for frontline and shift workers as well as seasonal staff.
  3. Scalable and Upgradable: Windows 365 offers flexible subscription plans. These plans can be scaled up or down based on your organization’s needs. This enables businesses to manage costs more effectively. You can choose the right sized Cloud PC for the right task and the right user.
  4. Device Management: Since there is no physical device to manage, management of devices is available remotely around the globe with employee devices being able to be provisioned, updated and recovered 100% remotely.
  5. Support for Windows 10 Extended Security updates are also included with the Windows 365 license which not only helps extend the life of older (but perfectly working devices) and is also great to sustainability!

Seamless Transition and Extensibility

  1. Extended Security Updates (ESU): For organisations that need more time to transition to Windows 11, Windows 365 subscriptions include Extended Security Updates (ESU) for Windows 10 at no additional cost. This provides critical security updates while you plan your migration.
  2. Smooth Migration: Migrating to Windows 365 can be straightforward. Tools and support are available. They help transfer user profiles, documents, and settings seamlessly.

Conclusion

Windows 365 can not only be a physical device alternative for any organisation, but also be used to help ensure a smooth transition from Windows 10 to Windows 11. Windows 365 can help organisations maintain productivity. It enhances security and breathes more life into legacy or older hardware.

It also supports Windows 10 Operating Systems, with Windows 10 Extended Security Updates included at no additional cost helping to extend the life of older devices that can’t run Windows 11 for up to another three years!

Why Windows 11 24H2 could have been called Windows 12

Most of the time, security and annual and semi annual feature updates in Windows are built on the same core OS platform. This means that the changes and new features in these updates are / updated on top of that particular OS build. 

This is not the case with the latest Windows 11 24H2 Update which is starting to roll out now.

Why is the Windows 11 24H2 update different?

Unlike previous updates to Windows 11, Windows 11 24H2 is delivered as an update to existing devices with Windows 11 installed. This update is essentially a whole new version of Windows and yes, some have dubbed it Windows 12 – because it is, in all purposes a new OS version that is installed over (OS Swap) on the top of the existing OS – making it a new version.

This approach is the same as when Windows 11 was released back in 2021 and was (of course) an OS upgrade on-top of Windows 10. Many saw Windows 11 as “just a UI refresh.” But it was actually a totally new build of Windows. It had major architectural and security changes throughout the OS. Updates like Windows 11 version 22H2 and version 23H2 introduced many new features, but these updates were fundamentally built on the same underlying Windows 11 OS platform.

Windows 24H2 is a new OS

Windows 11 24H2 update is built on a totally new platform (codenamed Germanium) which brings fundamental under-the-hood changes to the core of the Windows 11 Operating System. Many of these updates and changes will not be obvious or event visible to a typical user, but many of them are fundamental changes. For example, one significant improvement with this release is much better optimisation for ARM based devices such as the new Snapdragon Powered Copilot+ PC devices like the Surface Laptop 7.

This is also why this update launched preinstalled on Snapdragon X series PCs. The feature set wasn’t completely finished when they launched, but the code base was needed to take advantage of the new features which are now rolling out.

The question asked by many is – “Is Windows 11 24H2 really Windows 12 then“?

So why isn’t it called Windows 12?

Good question. Well, whilst this is a major update under the hood the UI does look the same as before, and in terms of new features for existing PCs, many of the new things are subtle and reflective of the ongoing tweaks and changes such as finally moving those legacy “Control Panel” updates to Settings. As such there is nothing in 24H2 that really says “hey – this is a brand-new operating system” – and that’s a good thing I think (right now anyway).

In the past, we typically received a “new version” of Windows release every three or so years, and as such it was possible to “upgrade” from one to the next if you were willing to buy a new Windows license (or a new device with a new license).

Of course, most people did not want to do that, which meant that most of us (consumers anyway), only got a new OS update when they bought a new PC/Laptop – which included the latest license you needed. for the “current OS”. That’s how Windows upgrades worked for most people anyway!

Windows 11 version 24H2, it is basically the same thing. Whilst this update is available for existing PCs (it’s also free) there’s very little that is new and shiny for existing devices.

All the big news and new features are part of the new generation of devices – the Copilot+ PCs and AI PCs – and most of those new AI features will only work (be activated) on these new devices – since they need a PC with a chipset that includes an NPU with over 40TOPS of performance – this is basically new devices launched after June 18, 2024 (or even later, if you want to get an AI PC based on the AMD or Intel PC).

So back to the point, yes Copilot+ and AI PCs are essentially Windows 12 with all the features it introduces but still under then branding (as the UI has not changed) as Windows 11.

What does a Copilot+ PC and Windows 11 24H2 Bring then?

Right now, what Copilot+ devices do add some cool new AI features which I would say currently appeal to tech enthusiasts and those that run AI workloads (or plan too). You do get live captions with real-time translation in any app, have the ability to use new AI features in apps like Paint using a “cached” LLM on the device and new you’ll soon get features like Recall, Click-To-Do, and generative fill which are also huge new features that are all exclusive to those new Copilot+ and AI PCs devices.

Will there be a Windows 12?

We don’t know to be honest – not yet anyway. It is clear to me that Microsoft are working to ensure they don’t abandon or upset their existing users and create confusion.

With Windows 10 going end of support in October 2025 (that’s a year from now), creating a Windows 12 brand will likely up-set many businesses that are in a transition from Windows 10 to Windows 11.

This version of Windows 11, will include a whole load of features that will be exclusive to the newer AI PC hardware such as the Surface Laptop 7 and Surface Pro 11. This still creates an incentive for people to buy new PC with shiny features (that makes PC companies like Dell, HP, Lenovo, and Microsoft happy) whilst still ensuring the Windows 11 OS is modern and fresh. Existing devices can still upgrade to Windows 24H2, but they won’t get these new AI features (you need that NPU remember).

Will Microsoft ever unveil plans to release a formal Windows 12? I really don’t know at the moment. I think a new “branded” version will come at some point in the next couple of years. They may just call it Windows – something we thought Microsoft were going to do when Windows 10 was released.


What do you think – should Windows just be called Windows 25H1 for example, or do we prefer a version number. I’m a Windows / Surface MVP and I don’t know any more than you right now (of course if I did, I couldn’t tell you – but I honestly do not know!)

There are lots of rumours on social about Windows 12 – tell me your thoughts?

Understanding the EU AI Act and Microsoft’s Commitment to Compliance..

TL:DR

The EU AI Act, effective from August 2024, regulates AI systems within theEU, categorizing them into prohibited, high-risk, and limited or minimal risk. Microsoft is committed to compliance through tools like Purview Compliance Manager, continuous monitoring, data privacy measures, bias mitigation, and transparency initiatives.

Understanding the EU AI Act

The EU AI Act, effective from August 2024, is a comprehensive regulation designed to govern the development, deployment, and use of AI systems within the European Union. It categorises AI systems into three risk levels: prohibited, high-risk, and limited or minimal risk.

  • Prohibited AI Systems: These are AI applications that pose unacceptable risks, such as those that manipulate human behavior or exploit vulnerabilities of specific groups. Organisations must decommission such systems by February 2025.
  • High-Risk AI Systems: These include applications used in biometric identification, critical infrastructure, education, and law enforcement. High-risk systems are permitted but must undergo stringent compliance checks, including conformity assessments by accredited third parties or through self-assessment.
  • Limited or Minimal Risk AI Systems: These cover applications like chatbots and AI-generated content, which are generally permitted but require transparency and informed consent from users.

Key Challenges in AI Compliance

Organisations will likely face several challenges in navigating AI compliance:

  • Ensuring Continuous Compliance: AI regulations are dynamic, and organisations must continuously update their systems to remain compliant. This involves tracking regulatory changes and implementing necessary updates promptly.
  • Managing Data and Privacy: AI systems often process vast amounts of data, including sensitive information. Ensuring that AI applications do not inadvertently access or misuse sensitive data is a significant concern.
  • Addressing Bias and Inaccuracy: AI systems must be trained on diverse and representative data sets to avoid biases. Inaccurate or biased AI outputs can lead to ethical and legal issues.
  • Maintaining Transparency: Organisations must ensure that their AI systems operate transparently, providing clear information on how data is used and decisions are made.

Microsoft’s Commitment to AI Compliance

Microsoft is at the forefront of ensuring AI compliance and ethical use. Here are some key initiatives and tools that demonstrate Microsoft’s commitment:

  • Purview Compliance Manager: Part of the Microsoft Purview family, this tool helps organizations manage compliance with various regulations, including the EU AI Act. It offers templates for different regulatory requirements, enabling organizations to streamline their compliance processes.
  • Continuous Monitoring and Updates: Microsoft ensures that its AI applications, such as Microsoft 365 Copilot, are continuously monitored and updated to comply with evolving regulations. This proactive approach helps organisations stay ahead of compliance requirements.
  • Data Privacy and Security: Microsoft emphasizes robust data privacy and security measures. AI applications are designed to prevent unauthorised access to sensitive data, and tools like Data Loss Prevention (DLP) policies help safeguard information.
  • Bias Mitigation: Microsoft is committed to reducing bias in AI systems. By using diverse data sets and implementing rigorous testing protocols, Microsoft aims to ensure that its AI applications provide fair and accurate results.
  • Transparency and Accountability: Microsoft promotes transparency in AI operations. Users are informed about how their data is used, and AI systems are designed to provide clear explanations for their decisions.

Conclusion

The EU AI Act represents a significant step towards ensuring the ethical and responsible use of AI. As organisations navigate this complex regulatory landscape, Microsoft’s tools and initiatives provide valuable support in achieving compliance. By prioritising continuous monitoring, data privacy, bias mitigation, and transparency, Microsoft is helping organisations harness the power of AI while adhering to the highest standards of ethical conduct.

What organisations can do

As we move forward in this AI-driven future, it’s crucial for every organisation large and small, private and public to stay informed and proactive about regulatory compliance in this space.

If you are invested in Microsoft Technology, be that Microsoft 365 or Azure, ensure to further explore Microsoft’s extensive and comprehensive suite of tools and resources to ensure your organisation and AI connected systems are not only compliant but also ethical and transparent.

1. You can check out Microsoft AI Compliance Hub

2. Check out their YouTube video https://youtu.be/briI9LdiZuc

3. Speak to your Microsoft Partner.

Hands-on with Copilot Voice: An almost human conversation

Copilot Voice Cover


The recent Copilot update is a Game-Changer in AI Voice Technology. In the recent announcements, Microsoft unveiled a new version of its Copilot app for iPhone and Android. The update brings a fresh look and new features. It also includes an impressive voice mode that rivals OpenAI’s ChatGPT Advanced Voice – especially since Microsoft make this available for free – yes free

I have tested both recently. I can confidently say that the new Copilot is a significant upgrade. What’s more, it is totally free to use. This is best read while/after you have watched my hands-on video below.

Hands on with Copilot Voice

User-Friendly Interface and Enhanced Voice Mode

The updated Copilot app boasts a more “consumer-friendly” interface. I do wish they would bring some of the advanced customisations back. The standout feature in this update is most definitely the new voice mode, which on first look (a few app updates before it worked), I thought would be a bit of a fad – but it is absolutely brilliant.

Voice mode offers speech-to-speech functionality, allowing for more natural and engaging conversations. While it may not interrupt as fluidly as OpenAI’s offering (though it’s still in early stages), it feels more casual and less stilted, making interactions feel more like chatting with a friend.

A Conversation That Feels Real

During my testing, I found myself deeply starting to actually forget that I was talking to an AI as the conversation felt natural and real (there was the odd delay. In my hands-on example (see the video below), I participated in a discussion. We talked about “if and when AI could ever become self-aware”. We also considered what the implications might be. Unlike a text-based discussion, this level of engagement goes to show just how fast and how rapid the advancement of natural conversation is becoming.

Copilot appears to adapt its vocal tones and pace during conversations. It emphasizes certain words as we speak.

Perhaps the biggest (pleasant) surprise I found was how Copilot adapted to use slang terms the more I used them too. If I swore or spoke more loudly, it also seemed to detect the change in my tone and adjust its output. I’ll be testing this more to see just how far it can go.

Spoiler: I did find the occasional limitation as the conversation continued, such as occasional delays when I interrupted it and seconds of silence.

Customisation and Accessibility

Copilot offers four voice options: Grove, Canyon, Wave, and Meadow. Unlike ChatGPT, you can modify the speed and tone of these voices, making them sound more natural and suited to your preferences. This feature, combined with the app’s inclination to use slang and short-hand words, makes it easy to forget you’re interacting with a machine. I’m not a fan of all the voices though and they are not currently that localised – with most very American (which is fine for now).

Gemini Live (yes, all the chat bots are discovering their voice) currently gives users a choice of 10, but Microsoft say more voice options will be coming “soon”.

What I also like is that you can customise the speed at which each of the voices speaks. Personally, I find the standard setting is too slow and find that a speed of 1.1x sounds most natural. I also discovered that you can also ask Copilot to speak differently by explaining how you want it to sound – for example, applying a slightly different accent, changing its tone of voice or to be more empathetic but I’d like to think eventually Copilot will do this natively without me asking (after all it’s unlikely you’d ask a human to speak in a different tone!).

Copilot Voice is free

One of the most significant advantages of Copilot is that it’s free to use. Today, OpenAI’s ChatGPT Advanced Voice feature currently requires a $20 monthly subscription, whilst Microsoft makes this feature available to all Copilot users, regardless of their subscription status.

Conclusion

Copilot is now under the leadership of Mustafa Suleyman [Microsoft CEO for AI]. It seems poised to make a significant impact in the AI voice technology market. It builds on its partner OpenAI. Its user-friendly design, natural voice interactions, and accessibility make it a strong competitor against other AI voice models.

The best thing – this is totally free

Try this out. Let me know how in depth you feel during a conversation is and can be with Copilot. How “close” do you think this is in becoming a natural, almost human conversation.

Click-to-Do and new “AI Search” coming to Copilot+ PCs

Microsoft (off the back of Windows 11 24H2 release this week) have unveiled a series of updates to their AI infused Copilot+ PCs, aimed at enhancing the user experience with innovative features.

Copilot+PCs are a new category of PCs released this year by leading OEMs including and debuted by Microsoft and are equipped with NPUs. These devices come in Intel, AMD, and Qualcomm-powered Windows on Arm configurations. Microsoft introduced several new features for both types of these advanced PCs. The newly launched Windows 11 2024 Update (version 24H2) brings new functionalities for all Windows 11 users, with some exclusive enhancements specifically for Copilot+ PC owners. 

These updates further demonstrates Microsoft’s commitment to baking AI assistance into more and more manual or semi manual tasks, and are designed to make everyday tasks more intuitive and efficient, leveraging the power of AI to transform how we interact with our new shiny devices.

New AI experiences in Copilot Plus PCs

These new features are summarised in an extensive Copilot / Windows Blog but the key ones I have summarised below.

Enhanced Search: Find stuff faster and easier.

One of the standout features in this update is the new Enhanced Search. Here, Microsoft has integrated AI-driven improvements deep into Windows search, making it significantly more powerful and user-friendly.

With these enhancements, users can now find files, images, and emails with ease, even if they don’t remember the exact names. Better than a simple search index (you know, that thing that used to grind your PC to a halt), this AI search understands context and can retrieve relevant results based on partial information or related keywords.

Image (c) Microsoft.

For instance, if you’re looking for a presentation you worked on last month but can’t recall the title, simply typing in related terms like “presentation” and “last month” will bring up the correct file. This feature is huge change for how we find and retrieve information and is more human connected in terms of how we think and ask. Plus, if you are anything like me, it should reduce the time spent searching for documents and allowing users to focus on their work.

“AI-powered search makes it dramatically easier to find virtually anything,” says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft. “You no longer need to remember file names and document locations, nor even specific names of words. Windows will better understand your intent and match the right document, image, file, or email”.

Yusuf Mehdi |Executive VP and CMO | Microsoft.

For images this will work extremely well as you won’t need to know the file name and can search for pictures using words, even if the search word isn’t part of the file name!

The improved Windows search will first show up in File Explorer on Copilot Plus PCs from November.

This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “duplicate my screen” into the Settings search box and it will help you find the right settings.

Click to Do: Interacting directly with your screen.

This feature really caught my attention and is definitely one I think I will use.

Click to Do will allows users to interact directly with images and text on their screen to perform quick actions. As an example you might be viewing a webpage or a pdf and see a phone number. You’ll be able to click on it to initiate a call, or clicking on an address to open it in your maps application. This feature streamlines workflows by reducing the number of steps needed to complete tasks.

Image (c) Microsoft

Click to Do works by understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items… It works on any windows, document, image, or even video”

Yusuf Mehdi |Executive VP and CMO | Microsoft.

As an example, you could use Click to Do to perform a visual search on an item that appears in a YouTube video you’re watching or a page you are viewing in a browser. Click to Do is also context-aware, assisting with text-related actions like rewriting, summarising documents, explaining text, and sending emails.

Microsoft have said Click to Do will begin testing with Windows Insiders on Copilot Plus PCs in October, with a gradual rollout planned for November.

The previously announced Recall feature will also be available to Windows Insiders in October on Qualcomm-powered devices, before being rolled out to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November.

I think this could be a real time saver for me and for anyone who does a lot of research, works with high volumes of information and has lots of open windows on their screen(s). By enabling direct interaction with on-screen content, it should help minimise interruptions and keeps the focus on what your are doing without having to open other tools.

Generative AI in Paint: Bringing modern tech to a staple app.

Microsoft Paint is also getting another significant upgrade (which has been in testing with Windows Insiders for a few months) with the introduction of new generative AI tools. These new tools ncluding generative fill, image generation (using Designer) and generative erase, that bring capabilities similar to those found in advanced photo editing software like Photoshop. Layers was also introduced to Paint earlier this year.

Copilot UI : The human touch.

Finally, Microsoft are revamping the general Copilot experience. This is not just about adding new features (though there are some) but are more about a total overhaul and part of their vision to make AI a more human-centric experience.

Their goal is to differentiate Copilot from other AI tools like ChatGPT and Gemin, by focusing on usability and user satisfaction. This approach ensures that the technology adapts to the user’s needs, rather than the other way around.

I covered this in more detail in another blog post below.

Microsoft release huge Copilot (consumer) update…

In a blog post yesterday, Microsoft unveiled a huge overhaul. They also introduced new features which are rolling out “now” to the consumer version of Microsoft Copilot. These updates set out to help them differentiate Copilot from ChatGPT. They aim to bring a more human-centric approach to the user experience.

These experiences are coming to Apple iOS, Android, the Copilot web experience at copilot.microsoft.com and in Copilot in Windows. Microsoft have also announced that Copilot is coming to WhatsApp. It will “help users there experience natural and engaging interactions with Copilot”. Interesting.

This is not available for me yet (I have a Copilot Pro license). Microsoft says that until this rolls out, users will see a message like below. This message pre-advertises the new Copilot experience that is coming “soon”.

In this blog, I’ll cover the key changes, the reasons for change and some of the coolest new features. I’ll also share my take on this and what they mean for users.

New Microsoft Copilot Video

Oh yes, there’s also a Microsoft “sizzle” video below if you don’t want to read my ramblings:

The Human Side of Gen AI?

At the heart of Microsoft’s vision is the belief that technology should enhance human well-being and support our unique qualities. Microsoft say that the revamped Copilot has been designed with this philosophy in mind. It ensures that every interaction is intuitive, personalised, and ultimately beneficial to the user.

Now, this is kind of the part of Copilot that was missing in my view. Other Gen AI tools now do this. They are essentially giving Copilot (for consumer – not Microsoft 365 Copilot) to “get to know you” – this is how they describe it:

“Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests. It understands the context of your life, while safeguarding your privacy, data and security, remembering the details that are most helpful in any situation. It gives you access to a universe of knowledge, simplifying and decluttering the daily barrage of information, and offering support and encouragement when you want it. …..Over time it’ll adapt to your mannerisms and develop capabilities built around your preferences and needs. We are not creating a static tool so much as establishing a dynamic, emergent and evolving interaction. It will provide you with unwavering support to help you show up the way you really want in your everyday life, a new means of facilitating human connections and accomplishments alike.”
Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI

New Copilot Features

The new Copilot experience will be far more than an UI facelift when it arrives. (I don’t have it yet.) It will come with brand new features that promise to re-innovate the ways in which we can use Copilot in our daily lives. The new features include:

  • Copilot Voice: This allows users to interact with their devices using natural language, making technology more accessible and user-friendly. This means you will be able ro engage in natural conversations with Copilot. The current method is more just speech to text and doesn’t really feel like a conversation. This is rolling out “now” for initially available in English in Australia, Canada, New Zealand, the United Kingdom and the US with more regions and languages coming soon.
  • Copilot Daily: Delivered as “cards”, this will provide personalised insights and recommendations to help users manage their day-to-day tasks more efficiently. Microsoft say this content will only be served by trusted news sources – the cite: Reuters, Axel Springer, Hearst Magazines, USA TODAY Network and Financial Times, with more “local sources” coming soon. As Copilot gets to know you, it will bring personalsed feeds and also allow users to have controls over what is served up. This starts rolling out now in the US and UK with other countries following soon.
  • Copilot Vision: which looks so cool, will leverage Microsoft’s vision and seeing AI tools to offer enhanced visual recognition capabilities, making it easier to organise and find information. Microsoft say that this work on all websites and documents. They have taken steps to put “boundaries” on the types of websites Copilot Vision can engage. It also won’t work on pay-walled content initially. It won’t work on sensitive content initially either. This is to protect “users’ and creators’ interests” and copyright. This will be a Copilot Pro Feature and will roll out to US customers first…
  • Think Deeper: This is similar to Deep Search in Bing, whereby Copilot will be able to reason through more complex questions. As such it will take longer to respond and may ask for clarifications before responding. This is really designed to allow Copilot to go beyond basic responses. It will help with more in-depth discussions. It will also aid in challenging questions and research. This is in experimental phase and will more details will come.

Wrap up

The new and enhanced Copilot user experience is all about making Copilot easier to use. It feels more natural (less techy). It brings some new capabilities and personalisation. This makes the experience far more “personal”. It’s great to see more work being done to create a more seamless and up-to-date experience. This allows them to compete better with Google, Meta and Apple in this fast paced Gen AI development.

This is great to see and needed as update and adoption of Copilot for consumers is nowhere near the adoption of Chat GPT. Part of Microsoft’s “problem” is they are not great at consumer marketing. Copilot (IMO) offers far more value than ChatGPT and includes many features (as standard) that you need to pay for in ChatGPT.

Will this make you revisit and retry Copilot? Let me know your thoughts?


Windows Recall: Enhanced Security& Privacy ahead of October Launch

As Windows 11 24H2 gets ready to release, Microsoft has announced major security and privacy upgrades to its (yet to be released) Windows Recall feature which was the flagship new AI powered feature announced on the back of the Copilot Plus PC announcements back in May.

Recall, which was initially met with scepticism and concerns around security and privacy, has now be significantly updated with stronger and more granular protections for privacy, encryption and identity access to make it ready for its “delayed” release next month.

What is Recall?

Recall takes screenshots of active windows on your PC every few seconds, analyses them on-device using a Neural Processing Unit (NPU) and an AI model, and adds the information to an SQLite database. You can later search for this data using natural language to prompt Windows Recall to retrieve relevant screenshots.

I covered Recall in more detail in an earlier blog

Responding to Customer Feedback


Microsoft’s decision to enhance Windows Recall comes after considerable feedback from customers and privacy advocates. The company initially delayed the public release of Recall, opting to make it available for preview with Windows Insiders. This cautious approach allowed Microsoft to refine the feature based on real-world usage and analysis of how it was used whilst they review ways to address the concerns and enhance security and privacy controls.

Putting Users in control of Recall

One of the most significant changes is that Windows Recall is now strictly opt-in. Users must proactively activate the feature, ensuring that no screenshots are taken or saved without explicit consent. This addresses a major concern about privacy and data security. Additionally, users can remove Recall entirely through the optional features settings in Windows, providing total control over its usage.

Advanced Security and Privacy Measures

Windows Recall now includes several advanced security measures designed to protect sensitive information after feedback, development and testing since it was announced in May this year.

Firstly – Recall is an optional feature and can also be removed entirely from the Windows Installation. If a user doesn’t proactively choose to turn it on, recall is off by default, meaning snapshots will not be taken or saved.

If Recall is enabled, all snapshots and associated data are encrypted, with encryption keys protected by the device’s Trusted Platform Module (TPM). This module is tied to the user’s Windows Hello login information and biometric identity, ensuring that no data leaves the computer without the user’s explicit request. Recall snapshots are also only accessible after users authenticate using Windows Hello credentials. This enhanced sign-in security ensures privacy and actively authenticates users before allowing access to their data

Recall also comes with a sensitive information filter designed to protect confidential data, like passwords, credit card numbers, and personal identification details, by automatically applying filters over this content. This uses AI and pattern matching to look for such information adding another level of privacy protection.

Additionally, Recall includes malware protection features like rate-limiting and anti-hammering measures, which prevent unauthorized access attempts.

Recall: Four Principles of Operation

Microsoft has redesigned Recall to function on four core principles:

  1. User control
  2. Encryption of sensitive data
  3. Isolation of services, and
  4. Intentional use.

Recall is always opt-in. Snapshots are not saved unless you choose to use Recall, and everything is stored locally……Recall does not share snapshots or data with Microsoft or third parties, nor between different Windows users on the same device. Windows will ask for permission before saving any snapshots.

David Weston – VP Enterprise and OS Security, Microsoft.

These principles will ensure that users can keep complete control over their data, with the ability to remove snapshots, pause them, or turn them off at any time. Any future choice to share data will need fully informed and explicit action by the user.

    Image (c) Microsoft.

    Conclusion

    In short, the enhanced Windows Recall feature represents a significant step forward in balancing functionality with security and privacy which show Microsoft are licensing to their users and take privacy and security seriously. By addressing key concerns and implementing robust protections, I believe Microsoft has demonstrated its commitment to user trust and data security. As Recall rolls out to Insiders with Copilot+ PCs in October, it will be interesting to see how these enhancements are received and what further innovations Microsoft will bring to the table. What do you think? Will you be trying this out or uninstalling it?

    When will Windows Recall be released?

    Microsoft announced last month that Recall will start rolling out to Insiders with Copilot+ PCs in October as part of the 24H2 release of Windows 11.

    Microsoft looking to remove security vendor access to it’s Windows Kernel following CrowdStrike incident.

    Microsoft is building new Windows security features to prevent another CrowdStrike incident and are in talks to enable them to do to more to allow them to better protect the core of their OS to prevent outages and widespread impact like the CrowdStrike incident which impacted more then 8.5 million devices and is estimated to have caused more than $10b financial impact.

    Fighting against the anti monopolies commissions.

    In an ideal world, Microsoft would have right to protect their core kernel code and prevent any third parties interfering or accessing it.

    Today, however, law is preventing them from doing this to ensure they adhere to the anti monopolies and anti compete laws in many parts of globe. Instead Microsoft are doing all they can to further harden security around the kernel and Windows security in general.

    Their goal is of course to find a comprised way to protect Windows from software issues caused by security vendors to ensure OS integrity without killing third party security vendors but to avoid them needed kernel level access in the first place…

    Enhancing Security without Kernel Access

    Since July, Microsoft has been in talks with leading security vendors, including CrowdStrike, Broadcom and Sophos, to develop a new security  platform in Windows that still allows security vendors to do their thing, but without Microsoft having to expose full kernel access.

    Then last week ( September 10th, 2024), Microsoft, CrowdStrike, and many other security  partners who provide endpoint security technologies got together to discuss ways to boost resiliency and protect our mutual customers’ critical infrastructure.  Aidan Marcuss, Corporate VP of Microsoft Windows and Devices said  “Our objective is to discuss concrete steps we will all take to improve security and resiliency for our joint customers.”

    The goal is to  prevent incidents similar to the CrowdStrike outage and enhance the overall security framework of Windows without monopolosing the endpoint and XDR markets.

    Benefits to Consumers

    For everyday users, this would promises a more secure and stable computing experience in a world where attacks on identity and data theft are increasing at pace. By further reducing the risk of security breaches and system outages, whilst reducing the risk of third party apps and services causing system failures, Microsoft is ensuring that consumers continue to trust them to protect their personal data and maintain smooth operation. Enhanced security measures mean fewer disruptions and a safer online environment, which is crucial in an era where cyber threats are increasingly sophisticated.

    Benefits to Business Users

    For commerciall/business users, they of course would gain significantly from these new security measures. With sensitive corporate data and identity consistency at risk from attack or breach, Microsoft’s enhanced security framework will provide businesses with greater peace of mind and further increase the trust they already have with Microsoft to protect their data, applications and emails.

    Of course, reduced risk of breaches and downtime caused by third party apps and services also translates to increased choice (without fear), and lower costs associated with security incidents and system outages incidents.

    Whilst this should enable businesses to  focus more on their core operations, knowing that their IT infrastructure is robust and secure, it doesn’t remove the need for full business continuity planning….

    Microsoft’s Perspective and Benefit

    For Microsoft, this move is a strategic step to reinforce its commitment to security and reliability. Arguably, Microsoft is the biggest security company in the world and with over a billion devices running the Windows operating system, they have a duty to continue to protect their products from outages caused by, well things out of their control, such as the CrowdStrike update fail!

    By working closely with security vendors and regulatory bodies, Microsoft is not only positioning itself as a leader in the cybersecurity space, but also as a partner that works with its software houses (ISVs) and customers to ensure they still have choice over the aspects of Windows they use (or subscribe too) and the third party vendors they choose to work with.

    So what about the third party security vendors then?

    Security vendors like CrowdStrike, Broadcom, Sophos, Cisco, and Trend Micro also benefit from this collaboration by being part of a more secure and standardised platform. This partnership allows them to continue to innovate and develop advanced security solutions without the complexities and risks associated with kernel access..it also. Means they will continue to get support and help from Microsoft (as a Isv partner) in developing and supporting their products. 

    Potential Concerns and Regulatory Involvement

    Naturally, there are concerns about potential monopolistic practices. Vendors (and those less. Involved in their initiative) may fear that Microsoft might restrict kernel access for third-party products while retaining it for its own, which could limit their ability to compete effectively, pushing customers to jump. Ship and just adopt Microsoft security products and services.

    To address such concerns and ensure transparency, Microsoft has involved US and European government officials in discussions. This move is aimed at addressing regulatory concerns and demonstrating Microsoft’s commitment to a fair and secure computing environment. While the initiative is largely seen as positive, it is crucial for Microsoft to maintain an open and competitive landscape for all security vendors.

    Conclusion

    Microsoft’s new security measures would represent a significant step towards a safer Windows environment. By working closely with security vendors and involving regulatory bodies, Microsoft is striving to create a secure and fair platform for all users making kernel acess more controlled than it is today. This promises numerous benefits for consumers, business users, and security vendors alike, while also addressing potential concerns about competition and transparency.

    Read more. The Register has also covered this story in depth of you want to read more here.

    The “Windows App” now has mobile app support

    Microsoft has given the Windows App “GA” status and released to the masses along with long awaited mobile app support which will open more doors and use cases for Windows Cloud PCs and Virtual Desktops. This will allow businesses to bring the power of Windows to virtually any device. Whether you’re using macOS, iOS, iPadOS, Android, or even another Windows PC, you can now stream a copy of Windows seamlessly.

    You can read the full Microsoft Blog on this > here <

    What’s so good about the Windows App?

    Havig been in preview for some time (previously there were multiple apps to use for different virtualised experiences on Windows such as Remote Desktop app, different websites and third-party apps etc) but now we have a new single experience 🙂 This provides:

    • Unified Experience: The Windows App serves as a single place to streaming all your corporate and development Windows desktops including Windows 365, Azure Virtual Desktop, and Remote Desktop services.
    • Customisable Home screen: Which allows users to tailor the app to suit their needs by pinning specific desktops, configuring the join experience and even simple configuration of things like multi-tasking and app switching with Windows 11 (known as Windows 365 Switch).
    • Multi-Screen Support: The Windows App lets users customise and extend their experience (just like a traditional / physical desktop) with multiple display support.
    • USB Redirection: Windows App allows full support of local USB devices including speakers, mics, webcams, storage devices, and printers as if they are directly connected to your Cloud PC.
    • Single Sign On – The Windows App supports single sign on with Windows 365 and AVD with Entra ID.

    Who can use the Windows App?

    Presently, the app is limited to Microsoft work and school accounts, making it ideal for professionals and students who need to access their work PCs remotely. It’s not available for consumers, but it does make Windows 365 and AVD simple to use on personal BYOD devices that need to access work devices. Something I do often.

    Downloading the Windows App

    The Windows app is available for download from the Microsoft Store and the Apple App Store. It is also available on the Google Play store but is now in public preview.

    User Experience

    The user experience is fantastic and shows the attention to detail, listening to user feedback and alignment with the core Windows Development team. Microsoft have said that the Windows App will start shipping as standard out of box app on Coporate Devices running Windows 11 too.

    Windows 365 Desktop on Samsung S24 via TV

    Windows App on Samsung S24 through TV

    The image above (which is pretty cool) is Windows 365 Running on my Samsung S24 displayed through a TV (using Samsung Dex) – and yes, I am using Copilot on PowerPoint.

    Windows 11 Experience below

    The Future

    I’d love to see Windows App come to more devices like high-end TVs and tablets in the future just like Microsoft have done with Xbox Game Streaming.

    Microsoft fixes hardware glitches across Surface Pro 8, Pro X, and Laptop 6.

    Microsoft has released a bunch of firmware updates which should fix some annoying issues.

    One of the great things about Microsoft owning the hardware and software eco system (in the realm of Surface and Windows), is the telemetry data they have across the board and the ownership they take across hardware and software.

    According to Microsoft there’s been some issues affecting Surface Pro 8, Pro X and Laptop 6 which have (hopefully) been fixes with this latest update.  Let’s dive into the specifics of what these updates address for each device.

    Surface Pro 8 (Intel)

    Some or the reported issues with Surface Pro 8 include issues with Surface Slim Pen, flickering screen issues when using the Surface Dock 2, and even issues with the built in USB-C ports.  This update should fix all those ensuring a smoother and more reliable experience.

    Surface Pro X (Qualcomm / ARM)

    One of my favourite devices (big fan of Windows on ARM), but many users have reported camera issues with the camera app hanging or the camera locking and showing as not working until a reboot. There has also been issues regarding the keyboard when using in Windows Recovery Environment (WinRE) or Windows Preinstallation Environment (WinPE). This firmware update addresses these issues.

    Surface Laptop 6 (Intel)

    A stable for many businesses, the Surface Laptop 6 has seen a number of odd issues particular with the fan and cooling system with reports of the laptop’s fans running excessively (and not turning off), even when the device isn’t under heavy load. This not only affects battery life but can also be quite distracting. This latest update should fix this issue by optimising the fan behavior and improving the system’s response to internal temperature changes, especially when connected to an external monitor and peripherals.

    How to get the firmware updates

    If you’ve been experiencing any of these issues with your Surface device, then updating your device is simple. In most cases these updates will be deployed as part of the regular patch schedule across your business, but if you need to check and deploy manually, then simply head over to Windows Update and download and install any pending updates for your device.

    Windows OS and Surface firmware updates  are essential for maintaining the performance and reliability of your Surface devices even if you are not experiencing any of the issues above.

    Announcing Copilot Wave 2: Exciting New Features and Enhancements

    This afternoon (16th September 2024), Microsoft passionately announced (almost 9 months after Copilot was officially available to any organisation) the latest updates coming to Microsoft 365 Copilot as part of what they are calling “Wave 2”. The 30-minute-long session, hosted by Microsoft CEO Satya Nadella and Jared- Spataro, unveiled a heap of new features, capabilities and performance enhancements were announced across the entire experience.

    Microsoft 365 Copilot (THIS IS NOW IT’S NEW OFFICIAL NAME) provides enterprise data protection, ensuring the same level of security and compliance protection as other services like files, SharePoint, and emails. Microsoft said that significant improvements have also been made to PowerPoint and Excel based on feedback, including the introduction of Python integration in Excel.

    Some of these things are “generally available” from today and others are coming in the next few weeks and months. – See the end.

    Evolving the purpose and role of Microsoft 365 Copilot

    Microsoft told today, how Copilot is evolving from an individual productivity assistant to a collaborative partner at work. Copilot can utilise various content sources such as files, chats, calendar invites, and emails to generate rich outputs based on the needs of the user and teams of people. You will have seen in the various demos how the product demos now showcase how Copilot facilitates collaboration and achieves outcomes, making both personal and teamwork more efficient and effective.

    They have also focussed lots on performance and stability enhancements with huge investments in their Azure Data Centres.

    Microsoft also wanted to ensure organisations know just how much they focus on providing the same level of enterprise data protection to Copilot as they have with files, email, SharePoint etc.

    So, here’s my pick of what’s new and most cool!

    1. Copilot Agents

    Microsoft is also broadening the definition of “agents“, ranging from personal AI assistants to fully autonomous agents. These agents span across a spectrum, from human-in-the-loop to fully autonomous.

    This is the top announcement for me, I think. Agents (aka Custom GPTs,) have been a very popular discussion with my customers. When Microsoft talks about agents, they use it in its broadest term with an agent being anything from an AI assistant helping you retrieve information right (a foundational agent capability), all the way to autonomous support agent, meaning the agent does not need a human to intervene for it or for it to be able to do its work. Wow Right!

    You will see Microsoft focusing on agents across the entire spectrum – giving organisations the ability to create agents using natural language to “support whatever custom business process you are trying to automate“. This will be going into public preview later this month Copilot Agent Builder will be part of Copilot Studio as I understand it.

    As an example, say an issue out in the field required further research and follow-up and the team keeps all their customer records from deployment info to maintenance reports on a SharePoint site. Like many organisations, there’s loads of valuable information stored here, but it takes ages to sift through it and find what is needed. Now with Copilot Agents, an agent can be built from any SharePoint site library or folder. It’s possible to create an agent with a single clip and in just a few seconds, your agent is ready to be used and shared with your team and it can be simply added to the department’s team’s chat.

    Once created, created agents can be customised and things like topics and knowledge can be enhanced as well as the actions it can take. These can be connected to third party apps such as Dynamics 365 Supply Chain Management.


    2. Copilot Pages – Powered by Loop

    This is the second biggest announcement and combines two of my favourite parts of Microsoft 365 – Copilot and Loop.

    Accessed through BizChat, Copilot Pages, allows users to create side-by-side pages for real-time collaboration. Built on Loop components, these pages enable multiple users to work together and update data simultaneously, enhancing teamwork and productivity.

    This can be used when you are working in BizChat – pulling Copilot’s response into a sharable canvas (Loop spaces) built for real-time multiplayer collaboration with Al. Copilot can then be used to improve and expand upon subject matter, build visualizations, and bring in additional content.

    Copilot Pages.

    Biz Chat will be the place where you can start and finish most of your work before you transition it to your format of choice. Within Biz Chat, you’ll also soon see a button to move the output to the final experience – says move to Outlook, move to Word, move to PowerPoint etc., but you can do all of the pre-work in Bizchat which Microsoft’s customers say is where they spend “most” of their time.

    3. Biz Chat Enhancements

    Copilot Biz Chat, will, as I discussed above have the ability to send output to the final app for you to finish your work. You’ll see a send to button making workflow faster and just feel smoother and more integrated.

    4. Utilising Email and Bizchat for Business Insights

    Copilot can now use email and Bizchat to identify patterns and information, recall similar situations, and access relevant content from various sources. This feature is designed to help discover strategies such as price reduction, promotional offers, and ad campaigns as example by reasoning over email and chat threads to help solve business challenges.

    5. Copilot in PowerPoint Improvements

    Copilot democratizes advanced features in Excel by allowing users to use natural language to access them. PowerPoint improvements include the ability to easily build custom narratives, sections, and flow within presentations. Branding options ensure consistency with company logos, fonts, colours, and styles. PowerPoint’s new narrative builder, with creative control over the flow, reordering topics, deleting unwanted ones, and adding new ones.

    Copilot helps create presentation outlines quickly, offering image suggestions from approved sources or AI-generated options. It designs slides in company branding with various layout choices.

    PowerPoint’s new features include adding picture notes to slides, built-in slide transitions, and animated text. These features help users create professional-looking presentations quickly and easily, using their own corporate-branded content.

    Leveraging corporate templates requires that marketing teams integrate their organisations branded assets into a SharePoint OAL (Organization Asset Library) in order to be able to create presentations with organisational images. This is scheduled for release in Q4 2024.

    6. Copilot in Word

    Copilot in Word has new features including (finally) allowing it to reason over more document sources including emails, chat, meeting content and files etc making this much easier to get documents created while referencing multiple sources of information.

    7. Copilot Enhancements in Teams

    Improvements are coming to Teams based on user feedback. Copilot can now reason over chat in addition to meeting transcriptions. This entered public preview today.

    8. Copilot in Outlook Improvements

    Outlook’s new Copilot feature, ‘Prioritise my inbox’, organises emails based on topics, keywords, and important people. It identifies important contacts like your boss and their boss, enhancing email organisation and efficiency.

    Since Copilot can reference emails, meetings and attachments as well as knowing who your colleagues are when you are drafting it can save a huge amount of time as it understands the context in which you are working. This new feature is rolling out now, with early access for some insider rings.

    Summary

    As I am sure you are, I am excited about these new features (and there’s still more to come) and improvements and look forward to your feedback on the announcements.

    In summary, here’s what was announced again and when it will be available (according to Microsoft).

    Image/Table – (C) Microsoft.

    Are there things you were expecting to hear about but didn’t?
    Oh and if I missed anything, let me know!!!

    Microsoft Copilot “Wave 2” is coming…

    Copilot Wave 2

    Mark your calendars for September 16th, as Microsoft is set to unveil the next phase of Copilot innovation!

    Hosted by CEO Satya Nadella and VP of AI at Work Jared Spataro, this short event promises to showcase the next phase of what will continue to evolve the Copilot revolution, which will further see the evolution of what is becoming a game-changer for businesses and tech enthusiasts alike.

    What to expect.

    There a bunch of things I am expecting to see based on the agenda, the Microsoft 365 Roadmap and other Microsoft posts and community updates. As such here’s what I’m hoping we hear about.

    • Rebranding and New Features: it will be  goodbye to “Copilot in Word” and hello to “Microsoft 365 Copilot in Word”. Yes the kind of re brand and renaming have already announced they are rebranding its Copilot products in a goal  to provide a more cohesive experience and consistency in naming. We have already seen this change from Microsoft 365 Copilot to Microsoft Copilot in Microsoft 365…
    • New Business-Focused Enhancements: With a focus on the business side of Microsoft’s Copilot offerings, they will focus on real life example of how these AI tools can revolutionise the way companies operate with an increased focus on smaller businesses along with enhancement for large enterprises.
    • From Preview to Release: we expect some of the services like Copilot in Excel to finally become “available” after being in preview for a year, updates to PowerPoint and for Team Copilot to go into public preview and more of the roadmap features to start rolling out such as scheduled prompts and proactive catchup.
    • Copilot Pro for consumer: I’m hoping to see updates and new features to Copilot Pro Updates. While details are still “under wraps” , I  anticipate new features will be announced such as being able to reference files (something Copilot in Microsoft 365 already does) and maybe deeper integration into other apps to  make this £19 monthly subscription more worth it.

    Registering for the event.

    The event is live (and will be available on demand) so to make sure you do not miss out on this chance to elevate your understanding of AI and its potential, Register below.

    • Date: September 16th 2024
    • Time: 8 AM PT / 11 AM ET / 4 PM UK
    • Platform: LinkedIn

    https://www.linkedin.com/events/7236780403867443202/


    Read the Copilot Public Roadmap: https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=Microsoft%20Search%2CMicrosoft%20Copilot%20(Microsoft%20365)


    Copilot+ PCs: A Game Changer for Businesses?

    Back in May, Microsoft unveiled the next generation of PCs with the Copilot + PC which was released for consumers. Today (4th September 2024), Microsoft has once again set a new benchmark with the introduction of Copilot+ PCs for Business users.

    Like their consumer counter parts, these next generation “AI devices”, which include the Surface Pro 11th Edition and Surface Laptop 7th Edition, are designed to revolutionise productivity and creativity in the business world. Copilot+ PCs are also shipping from other OEMs such as Dell, Lenovo, Acer, HP etc.

    Copilot+ PCs are equipped with the most powerful Neural Processing Units (NPUs) available for Windows PCs, delivering blazing-fast processing power. This allows businesses users to handle the toughest tasks with ease, up to 90% faster than previous models. The integration of advanced AI features, such as live captions and real-time translations, ensures that your team can work smarter and more efficiently.

    This blog, re-dives into the main differences between Copilot+ PCs and “non-Copilot PCs”, the improvements over previous models, and why these advancements are crucial for businesses and aims to answer the “why now” questions.

    Copilot+ PCs vs. Non-Copilot PCs

    1. AI Integration:
      • Copilot+ PCs: These devices are equipped with advanced AI capabilities, thanks to the Neural Processing Unit (NPU) that can handle up to 45 trillion operations per second (TOPS). This allows for efficient AI processing directly on the device, reducing latency and improving performance. These enable new AI workloads and functions within many applications to be enabled and powered by these new NPUs.
      • Non-Copilot PCs: Traditional PCs rely more on cloud-based AI processing (since they did not have NPUs), or required the CPU to do the grunt work, which can slow down performance and is dependent on internet connectivity.
    2. Performance:
    3. Connectivity:

    Power, Performance, Productivity

    This is the “why now” for Copilot+ PCs. More than just a device refresh, this new class of devices brings exceptional performance, never seen before battery life and the fastest application performance on Windows to date.

    1. Enhanced Performance: The new Copilot+ PCs feature significant performance upgrades with the Snapdragon® X Elite and X Plus processors. These processors not only boost productivity but also enhance AI processing capabilities, making them ideal for modern business applications.
    2. Incredible Battery Life: Surface Laptop 7th Edition offers up to 22 hours of battery life, a substantial improvement over previous models. This extended battery life ensures that professionals can work longer without needing to recharge, enhancing productivity on the go. Surface Pro 10 offers more than 18 hours in tests.
    3. Blazing App Performance: Microsoft has dedicated significant resources to the developer ecosystem, ensuring seamless performance for both native and emulated apps on Windows on Arm (WoA). The new Prism emulation engine further enhances performance and reduces CPU usage for emulated apps, surpassing even native apps on earlier models.
    4. Built around the user – Surface Copilot+ PCs provide a seamless and intuitive experience. These devices come with features like adaptive colour, optional OLED and HDR displays, and a flexible kickstand (Surface Pro) making them adaptable to any work environment. The all-day battery life (up to 22 hrs) ensures that your people stay productive without frequent interruptions.

    Copilot+ PCs – Why Now?

    1. Productivity and Efficiency: The AI capabilities of Copilot+ PCs enable businesses to automate routine tasks, analyse data more efficiently, and make informed decisions faster. This leads to increased productivity and operational efficiency.
    2. Security: Copilot+ PCs come with advanced security features, including the Microsoft Pluton security processor and Windows Hello biometric authentication. Together these provide robust protection against both physical and digital threats and work seemlessly with your device management tools such as Intune. This comprehensive security framework ensures that your data remains safe and easily managed across the organisation. These enhanced security measures in Copilot+ PCs provide a higher level of protection, making them a more secure choice for businesses handling sensitive data.
    3. Flexibility and Mobility: With optional 5G connectivity and extended battery life, Copilot+ PCs allow professionals to work from anywhere without compromising on performance or security. This flexibility is crucial in today’s hybrid work environment.
    4. Developer Support: The Windows Copilot Runtime and the availability of on-device AI models make it easier for developers to integrate AI into their applications. This fosters innovation and allows businesses to leverage AI-driven solutions tailored to their specific needs. Aspects such as Windows Studio Effects that bring Background Blur, Automatic Framing and Voice Focus, Portrait Light, Creative Filters and Eye Contact Teleprompter, can be invoked by developers directly in their applications without having to create models or develop the code.
    5. Future Proofed Investment : As businesses increasingly turn to AI to innovate, having the right hardware is crucial. Surface Copilot+ PCs are built to scale and adapt as AI capabilities evolve, ensuring that your investment remains relevant and valuable. These devices support local development and execution of AI models, providing the agility needed to stay competitive.

    What SKUs are available?

    As discussed, there are two standout devices – Laptop 7, Pro 11 and the Surface Pro 5G. Here are the key specs and features from a hardware perspective to note:

    Surface Laptop 7

    • Launch Date: 12th September 2024
    • Size Options: 13.5″ and 15″
    • Processors: Snapdragon® X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)
    • Graphics: Qualcomm® Adreno™ GPU
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
    • Copilot Key: Yes – for quick access to Copilot in Windows 11

    Surface Pro 11

    • Launch Date: 12th September 2024
    • Processors: Snapdragon® X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)
    • Graphics: Qualcomm® Adreno™ GPU
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
    • Copilot Key: Yes – for quick access to Copilot in Windows 11
    • Options: New flex Premium keyboard designed to be used either attached to your Pro for the ultimate laptop set-up or detached as a standalone keyboard for a new level of flexibility.

    New Surface Pro 5G

    • Launch Date: October 2024
    • CPU Options: Available with Intel I5/I7 and Snapdragon X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)/ Intel AI boost
    • Graphics: Qualcomm® Adreno™ GPU / Intel graphics
    • Copilot key: Key – for quick access to Copilot in Windows 11
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC– Allows use the built-in NFC reader to sign in with an NFC security key.

    Conclusion

    Surface Copilot+ PCs stand out due to their advanced AI integration and superior performance. Unlike non-Copilot+ PCs, which may lack dedicated NPUs, Copilot+ PCs offer specialised hardware designed to handle AI tasks efficiently. This results in faster processing times and more accurate AI-driven features.

    Video (c) Microsoft

    Surface Copilot+ PCs are not just another piece of hardware; they are a strategic investment in your business’s future. By equipping your team with these advanced devices, you can unlock new levels of productivity, security, and innovation, positioning your business for success in an AI-driven world.


    You can read more, from Microsoft in the latest community blog update which you can access below: https://techcommunity.microsoft.com/t5/surface-it-pro-blog/accelerate-ai-transformation-with-surface-pro-and-surface-laptop/ba-p/4227521?wt.mc_id=MVP_309187

    Windows 11 August (optional) Update: What is new….


    As we wait for the big 24H2 update due this autumn, Microsoft has quietly rolled out an optional update (going by the name KB5041587) for Windows 11, bringing a host of improvements and new features.

    While this update is not mandatory, it does offer several enhancements that make it worth installing (especially if you have a PC powered by an AMD CPU).

    Overall, the KB5041587 update for Windows 11 brings a range of valuable enhancements for users who frequently share files with Android devices, includes improvements to Narrator, voice typing, and File Explorer.

    Here’s a breakdown of what this update entails and why you might want to install it.

    Performance Boosts for AMD CPUs

    One of the most notable improvements in the KB5041587 update is the performance boost for AMD’s latest CPUs. Users with Ryzen 5000, 7000, and 9000 series processors with up to a 13 percent increase in performance.

    This enhancement addresses the previously disappointing performance of these CPUs, making it a significant update for AMD users.

    Enhanced File Sharing with Android Devices

    This update introduces a new feature that allows users to send files directly to an Android phone via Windows Share.

    Unlike Nearby Sharing, the Android device does not need to be in close proximity to the PC. Instead, it just needs to be paired via Phone Link.

    This feature simplifies the process of transferring photos and documents, making it more convenient and efficient.

    Improvements to Narrator and Voice Typing

    Windows 11’s Narrator feature, which reads out loud the contents of documents and websites, has received improvements in speed and accuracy.

    These enhancements are particularly noticeable when using the Edge browser and reading large documents.

    Additionally, voice typing has been optimized to allow for faster spelling of characters and more commands for text manipulation.

    Bug Fixes in File Explorer

    Several bugs in File Explorer have been addressed in this update. Issues such as the Ctrl + F keyboard shortcut not starting a search and the Shift + Tab shortcut losing keyboard focus have been fixed.

    These fixes contribute to a smoother and more reliable user experience when navigating and managing files.

    Installing the update

    Unlike the regular security and fix updates, the KB5041587 update must be manually installed.

    If you wish to install this one, you will need to navigate to Settings > Windows Update and select the update for installation. This manual process ensures that users have control over whether they want to incorporate these new features and fixes.

    Windows 11 24H2 Update will bring Quality, Performance, and AI updates

    Image showing words Windows 11 24H2 Update

    As we head into September, Microsoft is preparing to start the rollout of their annual Windows 11 feature update, this time focusing on the underlying platform and surface-level quality-of-life improvements and updates as well as some major updates to Windows on Arm (WoA). Windows 11 24H2 (also known as the 2024 Update) is a huge update in fact, including everything from performance increases across the board, UX changes and new AI (of course) features.

    The Windows 11 2024 Update is packed with OS improvements and new features across the board, with special attention given to those running an ARM-based device this time around.

    This update is a much bigger release than last years’ 2023 H2 update, due mainly to a vast number of underlying platform enhancements. There are improvements to Windows Update process, an updated and faster x86 emulation layer for Arm PCs (such as Copilot Plus PCs), and new AI features that will take advantage of newer devices which have a dedicated NPU (neural processing unit.).

    On Copilot+ PCs, this Windows 11 release is also the first include features exclusive to this new category of Windows devices. This means if you don’t yet have a Copilot+ PC, then you miss out on certain features when upgrading to version 24H2, such as the controversial “Windows Recall” AI feature.

    Windows 11 24H2 also promised to be much better for gamers, since it includes many new capabilities that utilise the high-performance hardware of Copilot+ PCs and new software optimisations. An example of innovation is the new emulation engine, Prism. It operates seamlessly, converting x86 or x64 code to Arm64 instructions when you launch an x86 or x64 application on an Arm-based Windows 11 device, all without requiring extra effort from developers.

    Why is this important? Well, given that many of today’s games are written for x86 or x64, Prism unlocks a large back log of games that work great on Arm under emulation. While Windows on Arm has had emulation in the past, the performance improvements of Prism, along with automatic super resolution and the new Snapdragon® X Series processors together emerge as a game-changer.

    So here is a summary of the key changes and updates you can expect in the Windows 24H2 update. Features in Bold are just for Copilot+ PCs.

    Desktop and start menu

    • Phone Link is now integrated with the Start menu
    • Taskbar system tray layout has been further simplified
    • Quick Settings has been rebuilt to be faster and more customisable
    • Windows Spotlight image is now the default wallpaper setting
    • The Taskbar app preview thumbnails now have an animation
    • It’s now possible to set to HDR images as a desktop wallpaper

    File menu

    • The File Explorer home tab now includes updated layout with shared documents.
    • Just like in Edge, you can now duplicate tabs by right clicking the tab.
    • The context menu layout has been updated with better labelling making it easier to use.
    • Added ability to create .7z and .TAR archive formats as well as ZIP files without the need for third party apps.
    • If you use Phone Link, you can view your Android phone’s file system directly in File Explorer

    Native Apps

    • The new Outlook app for email, calendar, and contact is now included in the update (this will replace the mail and calendar app).
    • Photos now includes AI-enhanced generative erase and background editing.
    • The Copilot applet is now a standalone web app – meaning it can be resized and moved around like any other app.
    • Photos can now generate AI images based on user criteria (Copilot+ PC)
    • A new Recall app uses AI to capture everything you do and makes finding things easier (Copilot+ PC).
    • Paint now has built-in generative AI capabilities based on user drawn sketch (Copilot+ PC)

    Settings and other stuff

    • Windows Update now supports checkpoints and hot patching for faster and less obtrusive updates.
    • New PRISM emulation layer makes x86 emulated apps run up to 2x faster and smoother on Arm meaning Arm-based devices.
    • New Voice Clarity feature uses AI to remove background noise picked up by your microphone in supported apps such as Teams.
    • Power settings for plugged/unplugged state can now be configured simultaneously just they could previously in “control panel”
    • Energy Saver mode replaces “battery saver” and now applies to laptops and desktop devices.
    • Devices with the new “Wi-Fi 7” hardware is now supported.
    • AutoSR uses AI to enhances the framerate and quality of games (Copilot+ PC)
    • Live Captions translate languages into English in real-time locally (Copilot+ PC).
    • Advanced Windows Studio Effects enhance your webcam with filters (Copilot+ PC) and some older ARM based PCs such as Surface Pro 9 5G.

    Consumer and Gaming

    • Updates to x86/x64 emulation on Copilot+PCs and other ARM based devices brings significant (up to 2x) performance updates for games running under emulation – needed for games and apps that are not yet “native” ARM.

    Availability and Rollout

    The Windows 11 2024 Update process is rather unique in its rollout and availability this time round. Unlike previous versions of Windows 11, this release is rolling out in two distinct waves. Wave one is has essentially already shipped, but only on new Copilot+ PCs that launched on June 18. If you recently purchased a new Copilot+ PC running the Snapdragon X chipsets then you are already running Windows 11 version 24H2.

    For the rest of the world, Windows 11 24H2 for “non-Copilot+ PCs” is expected to begin rolling out gradually from late September, which is when Windows 11 feature updates normally begin rolling out to users.

    Windows Insiders get it earlier…

    If you want to try out the Windows 11 2024 Update ahead of general availability on non-Copilot+ PCs, you can do so today by joining the Windows Insider Programme.

    Microsoft to further enhance Hybrid Meeting Experiences supporting Multiple Cameras and Views in Teams Rooms.

    Announced by Microsoft in their Teams Roadmap (Roadmap ID 402517), Microsoft Teams continues to innovate the way we connect and collaborate, both in-room and remotely. This latest feature (set to roll out in October 2024) is the Multiple Camera View for Teams Rooms on Windows (not yet announced for Android), which continually promises to revolutionise meeting experiences as the world continue to adapt to hybrid meetings.

    A New Perspective on Collaboration

    This new feature which will support the transmitting of up to four discrete USB camera feeds at once, breathe new life and create new deployment options to revolutionise the use of large(r) areas such as multi-purpose rooms and halls, classrooms, and executive boardrooms, enabling in-room users to switch between multiple video cameras from the console on Teams rooms on Windows.

    Users using Microsoft Teams Rooms set up with multiple USB cameras attached to the MTR will see updated experience, in the form of a video select option on the Microsoft Teams rooms console. With this option, (when more than one video camera is attached to MTR), users will be able to switch between these cameras before and during a Teams meeting by selecting a camera from the list of available cameras.

    Image (c) Microsoft.
    Changing the Video Feeds in Teams Room Control Panel – Image (C) Microsoft.

    This functionality aims to improve visibility and guarantees that remote attendees can smoothly keep up with the proceedings.

    If the device does not have multiple USB cameras set up with Teams Rooms device in the conference rooms, there will be no difference in the experience.

    Benefits for In-Room Participants

    • Increased Inclusivity – Allows hybrid / meetings to cover more, angles and areas within large meeting spaces.
    • Flexibility – Allows easy switching between multiple views during a meeting automatically or manually.
    • Control and Personalisation – In-room participants can toggle the multiple camera view on or off with a simple button press or choose the best view for them.

    Advantages for Remote Participants

    • Inclusive Experience: Feel more connected to the in-room activities.
    • Customisable Views: Choose which camera feed to focus on at any time.
    • Engagement: Improved visibility can lead to better engagement and interaction.

    Enabling or Disabling the Feature

    This feature, when it becomes available, will need to be enabled and configured from the Teams Pro Management portal for each room.

    This update is for Microsoft Teams Rooms for Windows only – there is no indication (if/when) this will be available for Teams Rooms on Android.

    Conclusion

    As we move towards a more hybrid work environment, features like the Multiple Camera View are essential in bridging the gap between physical and virtual meeting spaces, especially in larger meeting spaces.

    Thanks for reading, welcome your feedback and stay tuned for more updates in this space.

    Common Mistakes with Microsoft Copilot and How to Fix Them

    Copilot is a super powerful tool but if you are not getting the results you expect, you might be “using it wrong”. This is based on my experience working with organisations large and small over the past year or so.

    Momentum continues to increase and we are seeing more and more public case studies show casing the value of Copilot for Microsoft 365. These focus on the “huge” time savings and efficiency gains organisations such as Barnsley Council, Clifford Chance, and Hargreves Lansdown experienced and how it’s now a tool their employees would not be able to give up.

    Getting to this stage is not as simple as just allocating a license and turning it on. The “view” of Copilot I see in many organisations, is very different and as such is so important organisations get off on the right foot with Copilot to ensure that their early experiences with Copilot go well, they understand and evaluate where and how it fits and also where it doesn’t (or doesnt yet).

    It all starts with the right expections

    It’s hardly suprising that expectations of what Copilot can achieve are high. It’s not that they shouldn’t be, but we need to remember that most of what we see online and in demos are staged, based on the “perfect use case”, data in the “right place” and with Copilot embedded across all your apps and services.

    You need to make the cool aid before you can drink it.

    There are two scenarios with Copilot which I commonly see.

    First there are organisations that grab a handful of licenses, allocate them to a bunch of people and then expect Copilot to know everything about everything and do anything you can think of – setting themselves up for a fail or “less successful” trial.

    Secondly, there are those that follow the general guidance shared by Microsoft and their Copilot partners, who build a pilot team, annonce the trial (and what they expect of the pilot users), train and educate their users and share feedback amongst the teams to ensure everyone learns from each other before they expand it to more people.

    Whilst the second approach, almost always succeeds (assuming the pilot team are engaged and are open to sharing), I still find (in both scenarios) that part of the reason Copilot trials/pilots can fail quickly is that, in my experience, “people” try to go from zero to hero and rather than looking for many small gains, are trying to get Copilot do that one big thing that will totally change their workload and save them hours of manual effort per day or week.

    I find this problem goes away in the main, where organisations are working either directly with Microsoft or via their Copilot Adoption Partner, since the specialists they work with have the time to work with the employees to not only coach them through how and what Copilot can do, but also where it (on its own) may not be the answer they are looking for.

    So in short, I find that, many people are simply using Copilot wrong, misunderstand what it can and can’t do and then simoly give up on it and go back to what they did before.

    It’s not Copilot it’s you!

    In this blog, I am going to share the most common Copilot mistaken use cases that make people the most frustrated….and how to fix them….

    1. Trying to use Copilot as an automation tool

    This is very common. I often see people who have watched the Microsoft marketing videos (often sequence shortened) contour up an image in their mind that Copilot will solve all their business challenges. I see organisations map out end to end business processes they “would like” Copilot to solve for them that are, to be frank, sometimes outside of what Copilot is really designed to (or is able) to do.

    Copilot is not an RPA (Robotic Process Automation) tool. Yes, it can do many many things for you – such as reviewing documents, summarising meetings and actions and creating other “things” from them such as summaries, presentations or new documents.

    One of things I hear a lot (and experience) is often that Copilot doesn’t (or wont) do things in exactly the way I ask it to and it can be inconsistent if I ask the same thing twice.

    This is true and it is one of the “behaviours” of Copilot (and other Generative AI tools like ChatGPT or Gemini). I do find the more specific I am, the more “similar” my responses from Copilot become, but it’s serves back to the point that Copilot is not designed to carry out multi-step activities with a fixed predetermined output. It is also not currently possible to schedule or trigger Copilot based on an event or other trigger. See Prompting.

    Tip:
    Understanding the value and use cases of where Copilot fits into the business process and workflow is key to getting the best results. There are many areas where Copilot will provide real business value (either as a first eye, second opinion, note taker, author or creator). Working with a Copilot specialist partner or building a team of them internally will help the rest of the business get used to working “with” Copilot as the “assistant” it is expecting to be.

    2. Not understanding Copilot’s Grounding Capabilities

    One of the most common pitfalls in adopting Copilot is overlooking its grounding capabilities and limitations. Grounding is the term that refers to the context of the data Copilot can access/will access to perform the request you pass it.

    One of the unique values of Copilot for Microsoft 365 over “other” Generative AI experiences, is its deep-rooted access, context awareness and understanding of your business data [through the Microsoft Graph] to enhance its functionality and response. This means that, in short, you can ask Copilot about a particular file that someone shared or a meeting you had last tuesday and it will understand the context and content of that scenario and base it’s response around that. This is hugely value and one of the reasons it has so much value in the workplace. You can also point Copilot at specific content that is within your organisation (though these connected services) or via a URL – for example web content.

    The limitation of this grounding is also it’s benefit, in that for Copilot to be able to interface with your data (or application services), that data needs to be connected to the Microsoft Graph through either a connector or plug-in. These are sometimes provided (at cost) by the third party provider or can be built by your devops team or your partner.

    This is important because if your employees work off data that is stored primarily in a Document Management System (DMS) that is not connected to Microsoft 365, then Copilot will not have visibility over it or it’s data meaning that employees would need to manually copy and paste data from it, to Copilot in order for Copilot to do anything with it.

    Tip:
    When running your initial or later stage Copilot rollout, it’s important to ensure you understand where and how people work in different teams so that you know what data people work on and where it is stored.

    This grounding process is key as it allows Copilot to build upon the foundation of previous work, such as project histories or meetings. To maximise Copilot’s potential, it’s important to ensure that relevant data is accessible (through connectors or plug-ins) within Microsoft 365 or stored / migrated to Microsoft 365 (OneDrive, SharePoint etc.). For Copilot to work on meetings, you also need to be using Teams and must ensure they are recorded and/or transcribed.

    3. Over simplifying or over complicating Prompts

    Another key to Copilot’s effective use is the quality of prompts provided. Unlike an AI powered smart speaker, Copilot can handle really complex and specific requests , allowing you to write up to 2,000 (soon to be 8,000) characters in its input boxes.

    This means that prompts can well thought out, detailed and quote refined, leading to more specific and sophisticated responses. I have written other blogs on prompt perfection if you wish to read them.

    That said, the key when adopting and getting to know Copilot is to encourage your people / teams to experiment with prompts, iterating them and and refining them to achieve the desired outcomes whilst rememering that the same prompt will rarely generate exactly the same answer.

    Whilst simple prompts are often to vague, not specific enough and therefore may not yield the desired/expected results, prompts that are too complex can also be ambiguous, conflict or go “off topic” so getting the right balance is needed.

    Tip:
    Another way to get what you wanted it to make your prompt a conversation: Copilot support interative responses meaning that you can have a conversation with it. Writing the perfct prompt is not always easy to do and can be frustrating so feel comfortable in having a conversation with Copilot. You may find the iterative process becomes fundamental to how you work with Copilot and perfecting the response.

    You see unlike human assistants, Copilot thrives on repeated, slightly altered instructions to refine its output. This approach requires a shift in mindset from one-shot solutions to ongoing dialogues with Copilot. By embracing this iterative process, businesses can tailor Copilot’s responses to their specific needs more effectively.

    4. Not feeding Copilot properly.

    One of things I often find when working with Copilot on more “complex” prompts and tasks is that you can tell it to base its response or output based on a specific file that contains the things you want Copilot to do / check / review for me. Whilst Copilot can leverage the Microsoft Search (via Graph API), if you know what file(s), meeting, person etc, you want Copilot to leverage, you can include that in your prompt.

    In the example below (a real one that I was working with a customer on), you can see that we are using to Copilot to review some CVs against a Job Description and Criteria document.

    Example Copilot for Microsoft 365 Prompt – Grounded with specific data/files

    In this example, I am “feeding” Copilot the CVs I want it to review along with a Job Requirements document which contains a table of criteria about the role and the scores available based on this criteria. This means I can focus my prompt on what I need Copilot to do for me using existing data which is used to “ground” it’s response.

    Tip:
    One of the bug bears I hear alot around Copilot is why it can’t fill out a form for me. It cant. However…. you can ask Copilot to create an output for you based on an existing document. The video below shows an example of doing just this.

    Conclusion

    The integration of Copilot for Microsoft 365 presents a transformative opportunity for businesses.

    By educating employees, understanding its grounding capabilities, mastering effective prompting, practising an iterative approach, and implementing a strategic adoption plan, businesses can position their organisations to really see the benefits of Copilot.

    I hope the tips above help – welcome your questions and views.

    Snapdragon X: The power behind Copilot Plus AI PCs

    Picture of a Surface Keyboard with Snapdragon X sticker

    Qualcomm’s Snapdragon X series processors are specifically crafted for PCs, particularly Windows on Arm and Copilot Plus PCs available from HP, Dell, Lenovo, Acer and of course Microsoft Surface. The processors inside these latest generation of devices, integrate the renowned Snapdragon technology from premium smartphones with the demanding performance needs of the PC domain. The goal is to deliver a processor that competes with Intel and Apple in terms of performance, while also offering the energy efficiency typical of smartphones and providing cutting edge NPU performance to power existing and upcoming AI powered applications.

    Arm vs Intel: The Copilot Plus PC Revolution

    Copilot Plus PCs, like the Surface Laptop 7 are powered by these Snapdragon X Arm chips. The fundamental components shared by all Snapdragon X series chips include Qualcomm’s custom Arm-based Oryon CPU, rather than Intel’s x86, an enhanced version of their Adreno GPU (derived from their mobile devices), the Hexagon NPU for on-chip AI capabilities, and cutting-edge networking technology supporting the latest Wi-Fi 6 & 7 and 5G standards.

    On the software front, Microsoft offers an emulation layer within Windows on Arm (WoA) to facilitate the running of x64 applications not yet native to Arm processors. Notably, there is an extensive collection of native Arm applications from Microsoft, Adobe, and other prominent developers.

    About the Snapdragon X chipset options

    Snapdragon X comes in two major flavours. The X Elite, which powers the first wave of top-tier Copilot Plus PCs, and the X Plus, destined for the more affordable range of Copilot Plus PCs (You’ll see most vendors providing options for both).

    Today, Qualcomm has a total of four different Snapdragon X SKUs – three under the X Elite branding and one more affordable X Plus unit. You can see the subtle differences below, with the main differentiator being CPU cores and performance.

    All current Snapdragon X models boast a remarkable 45TOPS Neural Processing Unit (NPU), which means they are all equipped to handle the same AI features. An NPU enhances the traditional CPU by adding machine learning (AI) specific computational abilities. An NPU is not only faster but also more energy efficient. This offloads work from the CPU, allowing the NPU to manage AI tasks, similar to how a GPU handles graphics-intensive tasks.

    • Snapdragon X Elite
      • 12 Oryon CPU cores
      • Clock speeds up to 4.2Ghz
      • 4.6 TFLOPS GPU (Graphic Processing Unit)
      • 45 TOPS NPU (Neural Processing Unit)
    • Snapdragon X Plus
      • 10 Oryon CPU cores.
      • Clock speeds up to 3.4Ghz
      • 3.6 TFLOPS GPU
      • 45TOPS NPU

    What about the new Surface Line up?

    Snapdragon X offers competitive performance against not just Intel’s latest chips, but also against the Apple M3 and M4. The real star though (not a fan of just CPU benchmarks personally), is that battery life is simply incredible compared to previous generations of devices with initial testing and reports (from others such as here and here) showing these devices comfortably exceeding the demands of a busy workday, positioning these laptops as genuine contenders to the MacBook (which has always somehow always won for battery life). Running emulated x86 apps under emulation will (and does) run the CPU harder which will in turn impact battery life.

    This next generation of AI powered PCs sch as Surface Laptop 7 and Surface Pro 10 are two such devices offering superior power, power efficiency and extreeeeeeemley long batter life.

    Battery Life Wins

    That said, tests by PC Magazine, revealed a result of almost 25 hours usage – making “Surface Laptop one of the longest-latest laptops we’ve ever tested on battery“. In comparison a 13-inch MacBook Air lasted “just” 21 hours and 38 minutes in their testing.

    Surface Pro 10 and Surface Laptop 7 are the the first Copilot+ PC which feature these new Snapdragon X Elite and Snapdragon X Pro processors.

    PC Magazine said in their comprehensive hands-on review of Surface Laptop 7 that

    “…this is easily the best Arm chip we’ve tested yet in a PC. The CPU and GPU performance are there and deliver at least competitive benchmark numbers relative to current-gen Intel and AMD offerings in the early going. Qualcomm is to be commended for that.” | PC Magazine


    What is your view on these Copilot Plus PCs? Have you got one yet – what are your first impressions?