Author: rquickenden

Posted on

Click-to-Do and new “AI Search” coming to Copilot+ PCs

Microsoft (off the back of Windows 11 24H2 release this week) have unveiled a series of updates to their AI infused Copilot+ PCs, aimed at enhancing the user experience with innovative features.

Copilot+PCs are a new category of PCs released this year by leading OEMs including and debuted by Microsoft and are equipped with NPUs. These devices come in Intel, AMD, and Qualcomm-powered Windows on Arm configurations. Microsoft introduced several new features for both types of these advanced PCs. The newly launched Windows 11 2024 Update (version 24H2) brings new functionalities for all Windows 11 users, with some exclusive enhancements specifically for Copilot+ PC owners.

These updates further demonstrates Microsoft’s commitment to baking AI assistance into more and more manual or semi manual tasks, and are designed to make everyday tasks more intuitive and efficient, leveraging the power of AI to transform how we interact with our new shiny devices.

New AI experiences in Copilot Plus PCs

These new features are summarised in an extensive Copilot / Windows Blog but the key ones I have summarised below.

Enhanced Search: Find stuff faster and easier.

One of the standout features in this update is the new Enhanced Search. Here, Microsoft has integrated AI-driven improvements deep into Windows search, making it significantly more powerful and user-friendly.

With these enhancements, users can now find files, images, and emails with ease, even if they don’t remember the exact names. Better than a simple search index (you know, that thing that used to grind your PC to a halt), this AI search understands context and can retrieve relevant results based on partial information or related keywords.

Image (c) Microsoft.

For instance, if you’re looking for a presentation you worked on last month but can’t recall the title, simply typing in related terms like “presentation” and “last month” will bring up the correct file. This feature is huge change for how we find and retrieve information and is more human connected in terms of how we think and ask. Plus, if you are anything like me, it should reduce the time spent searching for documents and allowing users to focus on their work.

“AI-powered search makes it dramatically easier to find virtually anything,” says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft. “You no longer need to remember file names and document locations, nor even specific names of words. Windows will better understand your intent and match the right document, image, file, or email”.

Yusuf Mehdi |Executive VP and CMO | Microsoft.

For images this will work extremely well as you won’t need to know the file name and can search for pictures using words, even if the search word isn’t part of the file name!

The improved Windows search will first show up in File Explorer on Copilot Plus PCs from November.

This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “duplicate my screen” into the Settings search box and it will help you find the right settings.

Click to Do: Interacting directly with your screen.

This feature really caught my attention and is definitely one I think I will use.

Click to Do will allows users to interact directly with images and text on their screen to perform quick actions. As an example you might be viewing a webpage or a pdf and see a phone number. You’ll be able to click on it to initiate a call, or clicking on an address to open it in your maps application. This feature streamlines workflows by reducing the number of steps needed to complete tasks.

Image (c) Microsoft

Click to Do works by understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items… It works on any windows, document, image, or even video”

Yusuf Mehdi |Executive VP and CMO | Microsoft.

As an example, you could use Click to Do to perform a visual search on an item that appears in a YouTube video you’re watching or a page you are viewing in a browser. Click to Do is also context-aware, assisting with text-related actions like rewriting, summarising documents, explaining text, and sending emails.

Microsoft have said Click to Do will begin testing with Windows Insiders on Copilot Plus PCs in October, with a gradual rollout planned for November.

The previously announced Recall feature will also be available to Windows Insiders in October on Qualcomm-powered devices, before being rolled out to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November.

I think this could be a real time saver for me and for anyone who does a lot of research, works with high volumes of information and has lots of open windows on their screen(s). By enabling direct interaction with on-screen content, it should help minimise interruptions and keeps the focus on what your are doing without having to open other tools.

Generative AI in Paint: Bringing modern tech to a staple app.

Microsoft Paint is also getting another significant upgrade (which has been in testing with Windows Insiders for a few months) with the introduction of new generative AI tools. These new tools ncluding generative fill, image generation (using Designer) and generative erase, that bring capabilities similar to those found in advanced photo editing software like Photoshop. Layers was also introduced to Paint earlier this year.

Copilot UI : The human touch.

Finally, Microsoft are revamping the general Copilot experience. This is not just about adding new features (though there are some) but are more about a total overhaul and part of their vision to make AI a more human-centric experience.

Their goal is to differentiate Copilot from other AI tools like ChatGPT and Gemin, by focusing on usability and user satisfaction. This approach ensures that the technology adapts to the user’s needs, rather than the other way around.

I covered this in more detail in another blog post below.

Posted on

Microsoft release huge Copilot (consumer) update…

In a blog post yesterday, Microsoft unveiled a huge overhaul. They also introduced new features which are rolling out “now” to the consumer version of Microsoft Copilot. These updates set out to help them differentiate Copilot from ChatGPT. They aim to bring a more human-centric approach to the user experience.

These experiences are coming to Apple iOS, Android, the Copilot web experience at copilot.microsoft.com and in Copilot in Windows. Microsoft have also announced that Copilot is coming to WhatsApp. It will “help users there experience natural and engaging interactions with Copilot”. Interesting.

This is not available for me yet (I have a Copilot Pro license). Microsoft says that until this rolls out, users will see a message like below. This message pre-advertises the new Copilot experience that is coming “soon”.

In this blog, I’ll cover the key changes, the reasons for change and some of the coolest new features. I’ll also share my take on this and what they mean for users.

New Microsoft Copilot Video

Oh yes, there’s also a Microsoft “sizzle” video below if you don’t want to read my ramblings:

The Human Side of Gen AI?

At the heart of Microsoft’s vision is the belief that technology should enhance human well-being and support our unique qualities. Microsoft say that the revamped Copilot has been designed with this philosophy in mind. It ensures that every interaction is intuitive, personalised, and ultimately beneficial to the user.

Now, this is kind of the part of Copilot that was missing in my view. Other Gen AI tools now do this. They are essentially giving Copilot (for consumer – not Microsoft 365 Copilot) to “get to know you” – this is how they describe it:

“Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests. It understands the context of your life, while safeguarding your privacy, data and security, remembering the details that are most helpful in any situation. It gives you access to a universe of knowledge, simplifying and decluttering the daily barrage of information, and offering support and encouragement when you want it. …..Over time it’ll adapt to your mannerisms and develop capabilities built around your preferences and needs. We are not creating a static tool so much as establishing a dynamic, emergent and evolving interaction. It will provide you with unwavering support to help you show up the way you really want in your everyday life, a new means of facilitating human connections and accomplishments alike.”
Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI

New Copilot Features

The new Copilot experience will be far more than an UI facelift when it arrives. (I don’t have it yet.) It will come with brand new features that promise to re-innovate the ways in which we can use Copilot in our daily lives. The new features include:

  • Copilot Voice: This allows users to interact with their devices using natural language, making technology more accessible and user-friendly. This means you will be able ro engage in natural conversations with Copilot. The current method is more just speech to text and doesn’t really feel like a conversation. This is rolling out “now” for initially available in English in Australia, Canada, New Zealand, the United Kingdom and the US with more regions and languages coming soon.
  • Copilot Daily: Delivered as “cards”, this will provide personalised insights and recommendations to help users manage their day-to-day tasks more efficiently. Microsoft say this content will only be served by trusted news sources – the cite: Reuters, Axel Springer, Hearst Magazines, USA TODAY Network and Financial Times, with more “local sources” coming soon. As Copilot gets to know you, it will bring personalsed feeds and also allow users to have controls over what is served up. This starts rolling out now in the US and UK with other countries following soon.
  • Copilot Vision: which looks so cool, will leverage Microsoft’s vision and seeing AI tools to offer enhanced visual recognition capabilities, making it easier to organise and find information. Microsoft say that this work on all websites and documents. They have taken steps to put “boundaries” on the types of websites Copilot Vision can engage. It also won’t work on pay-walled content initially. It won’t work on sensitive content initially either. This is to protect “users’ and creators’ interests” and copyright. This will be a Copilot Pro Feature and will roll out to US customers first…
  • Think Deeper: This is similar to Deep Search in Bing, whereby Copilot will be able to reason through more complex questions. As such it will take longer to respond and may ask for clarifications before responding. This is really designed to allow Copilot to go beyond basic responses. It will help with more in-depth discussions. It will also aid in challenging questions and research. This is in experimental phase and will more details will come.

Wrap up

The new and enhanced Copilot user experience is all about making Copilot easier to use. It feels more natural (less techy). It brings some new capabilities and personalisation. This makes the experience far more “personal”. It’s great to see more work being done to create a more seamless and up-to-date experience. This allows them to compete better with Google, Meta and Apple in this fast paced Gen AI development.

This is great to see and needed as update and adoption of Copilot for consumers is nowhere near the adoption of Chat GPT. Part of Microsoft’s “problem” is they are not great at consumer marketing. Copilot (IMO) offers far more value than ChatGPT and includes many features (as standard) that you need to pay for in ChatGPT.

Will this make you revisit and retry Copilot? Let me know your thoughts?


Posted on

Windows Recall: Enhanced Security& Privacy ahead of October Launch

As Windows 11 24H2 gets ready to release, Microsoft has announced major security and privacy upgrades to its (yet to be released) Windows Recall feature which was the flagship new AI powered feature announced on the back of the Copilot Plus PC announcements back in May.

Recall, which was initially met with scepticism and concerns around security and privacy, has now be significantly updated with stronger and more granular protections for privacy, encryption and identity access to make it ready for its “delayed” release next month.

What is Recall?

Recall takes screenshots of active windows on your PC every few seconds, analyses them on-device using a Neural Processing Unit (NPU) and an AI model, and adds the information to an SQLite database. You can later search for this data using natural language to prompt Windows Recall to retrieve relevant screenshots.

I covered Recall in more detail in an earlier blog

Responding to Customer Feedback


Microsoft’s decision to enhance Windows Recall comes after considerable feedback from customers and privacy advocates. The company initially delayed the public release of Recall, opting to make it available for preview with Windows Insiders. This cautious approach allowed Microsoft to refine the feature based on real-world usage and analysis of how it was used whilst they review ways to address the concerns and enhance security and privacy controls.

Putting Users in control of Recall

One of the most significant changes is that Windows Recall is now strictly opt-in. Users must proactively activate the feature, ensuring that no screenshots are taken or saved without explicit consent. This addresses a major concern about privacy and data security. Additionally, users can remove Recall entirely through the optional features settings in Windows, providing total control over its usage.

Advanced Security and Privacy Measures

Windows Recall now includes several advanced security measures designed to protect sensitive information after feedback, development and testing since it was announced in May this year.

Firstly – Recall is an optional feature and can also be removed entirely from the Windows Installation. If a user doesn’t proactively choose to turn it on, recall is off by default, meaning snapshots will not be taken or saved.

If Recall is enabled, all snapshots and associated data are encrypted, with encryption keys protected by the device’s Trusted Platform Module (TPM). This module is tied to the user’s Windows Hello login information and biometric identity, ensuring that no data leaves the computer without the user’s explicit request. Recall snapshots are also only accessible after users authenticate using Windows Hello credentials. This enhanced sign-in security ensures privacy and actively authenticates users before allowing access to their data

Recall also comes with a sensitive information filter designed to protect confidential data, like passwords, credit card numbers, and personal identification details, by automatically applying filters over this content. This uses AI and pattern matching to look for such information adding another level of privacy protection.

Additionally, Recall includes malware protection features like rate-limiting and anti-hammering measures, which prevent unauthorized access attempts.

Recall: Four Principles of Operation

Microsoft has redesigned Recall to function on four core principles:

  1. User control
  2. Encryption of sensitive data
  3. Isolation of services, and
  4. Intentional use.

Recall is always opt-in. Snapshots are not saved unless you choose to use Recall, and everything is stored locally……Recall does not share snapshots or data with Microsoft or third parties, nor between different Windows users on the same device. Windows will ask for permission before saving any snapshots.

David Weston – VP Enterprise and OS Security, Microsoft.

These principles will ensure that users can keep complete control over their data, with the ability to remove snapshots, pause them, or turn them off at any time. Any future choice to share data will need fully informed and explicit action by the user.

    Image (c) Microsoft.

    Conclusion

    In short, the enhanced Windows Recall feature represents a significant step forward in balancing functionality with security and privacy which show Microsoft are licensing to their users and take privacy and security seriously. By addressing key concerns and implementing robust protections, I believe Microsoft has demonstrated its commitment to user trust and data security. As Recall rolls out to Insiders with Copilot+ PCs in October, it will be interesting to see how these enhancements are received and what further innovations Microsoft will bring to the table. What do you think? Will you be trying this out or uninstalling it?

    When will Windows Recall be released?

    Microsoft announced last month that Recall will start rolling out to Insiders with Copilot+ PCs in October as part of the 24H2 release of Windows 11.

    Posted on

    Microsoft looking to remove security vendor access to it’s Windows Kernel following CrowdStrike incident.

    Microsoft is building new Windows security features to prevent another CrowdStrike incident and are in talks to enable them to do to more to allow them to better protect the core of their OS to prevent outages and widespread impact like the CrowdStrike incident which impacted more then 8.5 million devices and is estimated to have caused more than $10b financial impact.

    Fighting against the anti monopolies commissions.

    In an ideal world, Microsoft would have right to protect their core kernel code and prevent any third parties interfering or accessing it.

    Today, however, law is preventing them from doing this to ensure they adhere to the anti monopolies and anti compete laws in many parts of globe. Instead Microsoft are doing all they can to further harden security around the kernel and Windows security in general.

    Their goal is of course to find a comprised way to protect Windows from software issues caused by security vendors to ensure OS integrity without killing third party security vendors but to avoid them needed kernel level access in the first place…

    Enhancing Security without Kernel Access

    Since July, Microsoft has been in talks with leading security vendors, including CrowdStrike, Broadcom and Sophos, to develop a new security  platform in Windows that still allows security vendors to do their thing, but without Microsoft having to expose full kernel access.

    Then last week ( September 10th, 2024), Microsoft, CrowdStrike, and many other security  partners who provide endpoint security technologies got together to discuss ways to boost resiliency and protect our mutual customers’ critical infrastructure.  Aidan Marcuss, Corporate VP of Microsoft Windows and Devices said  “Our objective is to discuss concrete steps we will all take to improve security and resiliency for our joint customers.”

    The goal is to  prevent incidents similar to the CrowdStrike outage and enhance the overall security framework of Windows without monopolosing the endpoint and XDR markets.

    Benefits to Consumers

    For everyday users, this would promises a more secure and stable computing experience in a world where attacks on identity and data theft are increasing at pace. By further reducing the risk of security breaches and system outages, whilst reducing the risk of third party apps and services causing system failures, Microsoft is ensuring that consumers continue to trust them to protect their personal data and maintain smooth operation. Enhanced security measures mean fewer disruptions and a safer online environment, which is crucial in an era where cyber threats are increasingly sophisticated.

    Benefits to Business Users

    For commerciall/business users, they of course would gain significantly from these new security measures. With sensitive corporate data and identity consistency at risk from attack or breach, Microsoft’s enhanced security framework will provide businesses with greater peace of mind and further increase the trust they already have with Microsoft to protect their data, applications and emails.

    Of course, reduced risk of breaches and downtime caused by third party apps and services also translates to increased choice (without fear), and lower costs associated with security incidents and system outages incidents.

    Whilst this should enable businesses to  focus more on their core operations, knowing that their IT infrastructure is robust and secure, it doesn’t remove the need for full business continuity planning….

    Microsoft’s Perspective and Benefit

    For Microsoft, this move is a strategic step to reinforce its commitment to security and reliability. Arguably, Microsoft is the biggest security company in the world and with over a billion devices running the Windows operating system, they have a duty to continue to protect their products from outages caused by, well things out of their control, such as the CrowdStrike update fail!

    By working closely with security vendors and regulatory bodies, Microsoft is not only positioning itself as a leader in the cybersecurity space, but also as a partner that works with its software houses (ISVs) and customers to ensure they still have choice over the aspects of Windows they use (or subscribe too) and the third party vendors they choose to work with.

    So what about the third party security vendors then?

    Security vendors like CrowdStrike, Broadcom, Sophos, Cisco, and Trend Micro also benefit from this collaboration by being part of a more secure and standardised platform. This partnership allows them to continue to innovate and develop advanced security solutions without the complexities and risks associated with kernel access..it also. Means they will continue to get support and help from Microsoft (as a Isv partner) in developing and supporting their products. 

    Potential Concerns and Regulatory Involvement

    Naturally, there are concerns about potential monopolistic practices. Vendors (and those less. Involved in their initiative) may fear that Microsoft might restrict kernel access for third-party products while retaining it for its own, which could limit their ability to compete effectively, pushing customers to jump. Ship and just adopt Microsoft security products and services.

    To address such concerns and ensure transparency, Microsoft has involved US and European government officials in discussions. This move is aimed at addressing regulatory concerns and demonstrating Microsoft’s commitment to a fair and secure computing environment. While the initiative is largely seen as positive, it is crucial for Microsoft to maintain an open and competitive landscape for all security vendors.

    Conclusion

    Microsoft’s new security measures would represent a significant step towards a safer Windows environment. By working closely with security vendors and involving regulatory bodies, Microsoft is striving to create a secure and fair platform for all users making kernel acess more controlled than it is today. This promises numerous benefits for consumers, business users, and security vendors alike, while also addressing potential concerns about competition and transparency.

    Read more. The Register has also covered this story in depth of you want to read more here.

    Posted on

    The “Windows App” now has mobile app support

    Microsoft has given the Windows App “GA” status and released to the masses along with long awaited mobile app support which will open more doors and use cases for Windows Cloud PCs and Virtual Desktops. This will allow businesses to bring the power of Windows to virtually any device. Whether you’re using macOS, iOS, iPadOS, Android, or even another Windows PC, you can now stream a copy of Windows seamlessly.

    You can read the full Microsoft Blog on this > here <

    What’s so good about the Windows App?

    Havig been in preview for some time (previously there were multiple apps to use for different virtualised experiences on Windows such as Remote Desktop app, different websites and third-party apps etc) but now we have a new single experience 🙂 This provides:

    • Unified Experience: The Windows App serves as a single place to streaming all your corporate and development Windows desktops including Windows 365, Azure Virtual Desktop, and Remote Desktop services.
    • Customisable Home screen: Which allows users to tailor the app to suit their needs by pinning specific desktops, configuring the join experience and even simple configuration of things like multi-tasking and app switching with Windows 11 (known as Windows 365 Switch).
    • Multi-Screen Support: The Windows App lets users customise and extend their experience (just like a traditional / physical desktop) with multiple display support.
    • USB Redirection: Windows App allows full support of local USB devices including speakers, mics, webcams, storage devices, and printers as if they are directly connected to your Cloud PC.
    • Single Sign On – The Windows App supports single sign on with Windows 365 and AVD with Entra ID.

    Who can use the Windows App?

    Presently, the app is limited to Microsoft work and school accounts, making it ideal for professionals and students who need to access their work PCs remotely. It’s not available for consumers, but it does make Windows 365 and AVD simple to use on personal BYOD devices that need to access work devices. Something I do often.

    Downloading the Windows App

    The Windows app is available for download from the Microsoft Store and the Apple App Store. It is also available on the Google Play store but is now in public preview.

    User Experience

    The user experience is fantastic and shows the attention to detail, listening to user feedback and alignment with the core Windows Development team. Microsoft have said that the Windows App will start shipping as standard out of box app on Coporate Devices running Windows 11 too.

    Windows 365 Desktop on Samsung S24 via TV

    Windows App on Samsung S24 through TV

    The image above (which is pretty cool) is Windows 365 Running on my Samsung S24 displayed through a TV (using Samsung Dex) – and yes, I am using Copilot on PowerPoint.

    Windows 11 Experience below

    The Future

    I’d love to see Windows App come to more devices like high-end TVs and tablets in the future just like Microsoft have done with Xbox Game Streaming.

    Posted on

    Microsoft fixes hardware glitches across Surface Pro 8, Pro X, and Laptop 6.

    Microsoft has released a bunch of firmware updates which should fix some annoying issues.

    One of the great things about Microsoft owning the hardware and software eco system (in the realm of Surface and Windows), is the telemetry data they have across the board and the ownership they take across hardware and software.

    According to Microsoft there’s been some issues affecting Surface Pro 8, Pro X and Laptop 6 which have (hopefully) been fixes with this latest update.  Let’s dive into the specifics of what these updates address for each device.

    Surface Pro 8 (Intel)

    Some or the reported issues with Surface Pro 8 include issues with Surface Slim Pen, flickering screen issues when using the Surface Dock 2, and even issues with the built in USB-C ports.  This update should fix all those ensuring a smoother and more reliable experience.

    Surface Pro X (Qualcomm / ARM)

    One of my favourite devices (big fan of Windows on ARM), but many users have reported camera issues with the camera app hanging or the camera locking and showing as not working until a reboot. There has also been issues regarding the keyboard when using in Windows Recovery Environment (WinRE) or Windows Preinstallation Environment (WinPE). This firmware update addresses these issues.

    Surface Laptop 6 (Intel)

    A stable for many businesses, the Surface Laptop 6 has seen a number of odd issues particular with the fan and cooling system with reports of the laptop’s fans running excessively (and not turning off), even when the device isn’t under heavy load. This not only affects battery life but can also be quite distracting. This latest update should fix this issue by optimising the fan behavior and improving the system’s response to internal temperature changes, especially when connected to an external monitor and peripherals.

    How to get the firmware updates

    If you’ve been experiencing any of these issues with your Surface device, then updating your device is simple. In most cases these updates will be deployed as part of the regular patch schedule across your business, but if you need to check and deploy manually, then simply head over to Windows Update and download and install any pending updates for your device.

    Windows OS and Surface firmware updates  are essential for maintaining the performance and reliability of your Surface devices even if you are not experiencing any of the issues above.

    Posted on

    What are Copilot Pages?

    Microsoft yesterday, announced the next stage of the evolution of Microsoft 365 Copilot with Wave 2. Amongst the many new features was the launch of Copilot Pages. This innovative feature is the first step into the new evolution of Copilot which is set transforming how employees interact with Microsoft AI in a new collaborative environment.

    What are Copilot Pages?

    Copilot Pages is a dynamic, persistent canvas integrated into Copilot chat, designed to facilitate what Microsoft call “multiplayer AI collaboration”. It allows users to turn insightful Copilot responses into durable, editable content that can be shared with teams for further collaboration.

    “This is an entirely new work pattern – multiplayer, human to AI to human collaboration”.
    | Jared Spataro | VP of AI at Work | Microsoft.

    Copilot Pages -Key Features

    • Dynamic Collaboration: With Copilot Pages, employees can work directly with Copilot on a shared page, prompting and refining responses together as a team rather than individually in silos.
    • Persistent Canvas: The pages are persistent, meaning collaborative efforts are saved and can be revisited and edited at any time by anyone.
    • Team Learning: This feature encourages learning from each other’s prompts, enhancing the overall quality and depth of the information gathered.

    Getting Started with Copilot Pages in 5 Steps

    1. Access Copilot Pages: Open your Copilot chat and look for the new “Pages” tab. Click on it to create a new page or access existing ones.
    2. Create a New Page: Click on “New Page” to start a fresh canvas. You can name your page to keep your projects organized.
    3. Collaborate with Your Team: Invite team members to your page by sharing the link. Everyone can contribute by adding prompts, refining responses, and editing content.
    4. Save and Revisit: Your pages are automatically saved. You can revisit and edit them anytime, ensuring your collaborative efforts are always up-to-date.
    5. Share and Export: Once your page is finished, you can share it with others outside your team or export it for presentations, reports, or further analysis.

    Check out the Microsoft Video for more.

    Where are Copilot Pages Stored?

    Copilot Pages are .loop files stored in a new user-owned SharePoint Embedded container. IT Admins can manage these files using Loop admin switches and other governance tools. The feature supports various compliance and manageability capabilities, including GDPR compliance, Intune device management, and data loss prevention. IT admins manage these .loop files just like any other files (.docx, .pptx, .xlsx, etc.). They support all the features of the SharePoint file system, including everything detailed here. 

    Additional capabilities, such as programmatic API access for third-party tools, are expected in Q4 CY2024.

    Read more in the Copilot Admin Support Pages:

    Availability

    Copilot Pages is rolling out “later this month” for Microsoft 365 Copilot subscribers and will soon be available to all Microsoft 365 subscribers. Loop must be enabled in your environment.

    Do you have it in your Tennant yet?

    Posted on

    Announcing Copilot Wave 2: Exciting New Features and Enhancements

    This afternoon (16th September 2024), Microsoft passionately announced (almost 9 months after Copilot was officially available to any organisation) the latest updates coming to Microsoft 365 Copilot as part of what they are calling “Wave 2”. The 30-minute-long session, hosted by Microsoft CEO Satya Nadella and Jared- Spataro, unveiled a heap of new features, capabilities and performance enhancements were announced across the entire experience.

    Microsoft 365 Copilot (THIS IS NOW IT’S NEW OFFICIAL NAME) provides enterprise data protection, ensuring the same level of security and compliance protection as other services like files, SharePoint, and emails. Microsoft said that significant improvements have also been made to PowerPoint and Excel based on feedback, including the introduction of Python integration in Excel.

    Some of these things are “generally available” from today and others are coming in the next few weeks and months. – See the end.

    Evolving the purpose and role of Microsoft 365 Copilot

    Microsoft told today, how Copilot is evolving from an individual productivity assistant to a collaborative partner at work. Copilot can utilise various content sources such as files, chats, calendar invites, and emails to generate rich outputs based on the needs of the user and teams of people. You will have seen in the various demos how the product demos now showcase how Copilot facilitates collaboration and achieves outcomes, making both personal and teamwork more efficient and effective.

    They have also focussed lots on performance and stability enhancements with huge investments in their Azure Data Centres.

    Microsoft also wanted to ensure organisations know just how much they focus on providing the same level of enterprise data protection to Copilot as they have with files, email, SharePoint etc.

    So, here’s my pick of what’s new and most cool!

    1. Copilot Agents

    Microsoft is also broadening the definition of “agents“, ranging from personal AI assistants to fully autonomous agents. These agents span across a spectrum, from human-in-the-loop to fully autonomous.

    This is the top announcement for me, I think. Agents (aka Custom GPTs,) have been a very popular discussion with my customers. When Microsoft talks about agents, they use it in its broadest term with an agent being anything from an AI assistant helping you retrieve information right (a foundational agent capability), all the way to autonomous support agent, meaning the agent does not need a human to intervene for it or for it to be able to do its work. Wow Right!

    You will see Microsoft focusing on agents across the entire spectrum – giving organisations the ability to create agents using natural language to “support whatever custom business process you are trying to automate“. This will be going into public preview later this month Copilot Agent Builder will be part of Copilot Studio as I understand it.

    As an example, say an issue out in the field required further research and follow-up and the team keeps all their customer records from deployment info to maintenance reports on a SharePoint site. Like many organisations, there’s loads of valuable information stored here, but it takes ages to sift through it and find what is needed. Now with Copilot Agents, an agent can be built from any SharePoint site library or folder. It’s possible to create an agent with a single clip and in just a few seconds, your agent is ready to be used and shared with your team and it can be simply added to the department’s team’s chat.

    Once created, created agents can be customised and things like topics and knowledge can be enhanced as well as the actions it can take. These can be connected to third party apps such as Dynamics 365 Supply Chain Management.

    2. Copilot Pages – Powered by Loop

    This is the second biggest announcement and combines two of my favourite parts of Microsoft 365 – Copilot and Loop.

    Accessed through BizChat, Copilot Pages, allows users to create side-by-side pages for real-time collaboration. Built on Loop components, these pages enable multiple users to work together and update data simultaneously, enhancing teamwork and productivity.

    This can be used when you are working in BizChat – pulling Copilot’s response into a sharable canvas (Loop spaces) built for real-time multiplayer collaboration with Al. Copilot can then be used to improve and expand upon subject matter, build visualizations, and bring in additional content.

    Copilot Pages.

    Biz Chat will be the place where you can start and finish most of your work before you transition it to your format of choice. Within Biz Chat, you’ll also soon see a button to move the output to the final experience – says move to Outlook, move to Word, move to PowerPoint etc., but you can do all of the pre-work in Bizchat which Microsoft’s customers say is where they spend “most” of their time.

    3. Biz Chat Enhancements

    Copilot Biz Chat, will, as I discussed above have the ability to send output to the final app for you to finish your work. You’ll see a send to button making workflow faster and just feel smoother and more integrated.

    4. Utilising Email and Bizchat for Business Insights

    Copilot can now use email and Bizchat to identify patterns and information, recall similar situations, and access relevant content from various sources. This feature is designed to help discover strategies such as price reduction, promotional offers, and ad campaigns as example by reasoning over email and chat threads to help solve business challenges.

    5. Copilot in PowerPoint Improvements

    Copilot democratizes advanced features in Excel by allowing users to use natural language to access them. PowerPoint improvements include the ability to easily build custom narratives, sections, and flow within presentations. Branding options ensure consistency with company logos, fonts, colours, and styles. PowerPoint’s new narrative builder, with creative control over the flow, reordering topics, deleting unwanted ones, and adding new ones.

    Copilot helps create presentation outlines quickly, offering image suggestions from approved sources or AI-generated options. It designs slides in company branding with various layout choices.

    PowerPoint’s new features include adding picture notes to slides, built-in slide transitions, and animated text. These features help users create professional-looking presentations quickly and easily, using their own corporate-branded content.

    Leveraging corporate templates requires that marketing teams integrate their organisations branded assets into a SharePoint OAL (Organization Asset Library) in order to be able to create presentations with organisational images. This is scheduled for release in Q4 2024.

    6. Copilot in Word

    Copilot in Word has new features including (finally) allowing it to reason over more document sources including emails, chat, meeting content and files etc making this much easier to get documents created while referencing multiple sources of information.

    7. Copilot Enhancements in Teams

    Improvements are coming to Teams based on user feedback. Copilot can now reason over chat in addition to meeting transcriptions. This entered public preview today.

    8. Copilot in Outlook Improvements

    Outlook’s new Copilot feature, ‘Prioritise my inbox’, organises emails based on topics, keywords, and important people. It identifies important contacts like your boss and their boss, enhancing email organisation and efficiency.

    Since Copilot can reference emails, meetings and attachments as well as knowing who your colleagues are when you are drafting it can save a huge amount of time as it understands the context in which you are working. This new feature is rolling out now, with early access for some insider rings.

    Summary

    As I am sure you are, I am excited about these new features (and there’s still more to come) and improvements and look forward to your feedback on the announcements.

    In summary, here’s what was announced again and when it will be available (according to Microsoft).

    Image/Table – (C) Microsoft.

    Are there things you were expecting to hear about but didn’t?
    Oh and if I missed anything, let me know!!!

    Posted on

    Copilot: Good habit forming tips to see value every day.

    What’s one of the biggest stumbling blocks to incorporating AI tools like ChatGPT and of course Microsoft Copilot into daily work? Well, I can tell you that from first-hand experience is it not knowing how or when to use it. In this blog I’ll explore a few scenarios where I believe anyone with a Copilot License can start seeing real tangible value from GenAI today.

    What is Copilot in Microsoft 365?

    I’m hoping by now that I don’t actually need to answer that one, but… In short Copilot for Microsoft 365 is Microsoft’s Generative AI chat bot, that is grounded (meaning it has access to) your Microsoft email, chat, documents and more and is also integrated (natively) into all your Microsoft 365 apps and services like Word, Excel, Teams, Outlook, Loop etc.

    The goal of Microsoft 365 Copilot is to make us all more productive and creative what ever job we do and results from many of the customers we have been working with this past 12 months is impressive.

    Overcoming the adoption hurdle

    The biggest hurdle to getting regular and good results with Copilot is actually not what the tool can do or can’t, the expertise around ‘good prompting‘, as important as it is, but is in fact, realising the benefits of making Copilot part of everything you do through habit forming.

    To do this, we need to get into the habit of using Copilot every day to really see the value we get from it little by little. many of our customers have this same problem and it’s not a Copilot thing, it’s a new technology thing. We are all so busy doing our jobs that many don’t have time to learn new things or try new ways of working.

    Good adoption and successful use of any technology requires some input and perseverance from us as users. As we realise the value, we use these technologies more and the value we get from increases exponentially. Think about the first time a company introduced a word processor in place of a typewriter for example!

    Adoption and Change Management, whether run internally (as part of any technology deployment) makes a huge difference to successful deployment and Copilot is a big change in how people work and what it can do, so it does need to be handled that way. Stats show that technology projects that have a proper adoption and change programme linked to them are significantly more likely to deliver the desired return on investment. According to Microsoft, proper change management can lead to 85% of users finding tools like Copilot helpful in getting to a good first draft faster.

    Adoption and change management is not just training (though that is of course part of it). Its about helping people learn the tools within their roles, to see the benefits and to tell/show other team members so they learn and benefit together. At Cisilion, we know (first hand) and through the dozens of customers we are working with that one of the primary blockers to adoption of Microsoft Copilot is simply not knowing how or when to use it and so simply “forgetting about it”.

    My Copilot Hero Scenarios

    What follows next is 3 (three) Copilot for Microsoft scenarios that I use all the time that I can honestly say have become habit forming for me and many of my team.

    1. Goodbye Internet Search: Firstly, I very rarely now ever use internet search to find information. Both in work and personal life, whenever I need to find information about something I turn to Copilot. Whether I’m looking at finding out about a new product, event, news story or whether it’s in my personal life, Copilot just gives me the details I need in seconds rather than giving me a page of search results which I have to sift through manually to see what is relevant. If you use SharePoint at work – this becomes even more powerful!
    2. Email and Meetings (and calls): These are definitely the biggest use cases for Copilot in my daily routine. I simply don’t work or handle email and meetings in the same way anymore. One of the things Copilot can do really well is summarise what’s in my inbox and prioritise requests and things that need my attention – especially If I have been away for a few days. The same goes for meetings. I can pay more attention “in” meetings and have Copilot tackle notes for me, summarise things or even check things for me.

      Copilot can summarise actions, clarify points, and what is really cool is that it can do this for me even if I can’t actually attend the meeting (through a new feature called “Follow a Meeting“. Copilot in Outlook can summarise long email threads and can even draft replies for me in a professional manner so all I have to do is edit and refine before clicking send. Copilot also works on phone calls if you have Teams Phone by the way!
    3. My Goto First: Copilot is the first place I go when I have a document, presentation or other document to read or reference. What do I mean by that?

    Like us all, I get sent a lot of documents to read, review and comment on. I am now in a habit (I think it’s a good one) of using Copilot as my assistant as my first point of call every time. I always ask Copilot to summarise the document (Word does this automatically now when you open a document) so I can quickly understand the key points of the document before I read it more deeply. This is useful for getting up to speed quickly, determining if I need to read it (guess what – sometimes I don’t) or to help me understand the theme as I do read it. I also use Copilot to ask questions about a document (PDF, Word, PowerPoint etc).

    I can also ask Copilot questions about the document such as, “does this business case make a clear and strong argument“, or “what is the financial impact of this proposal“, or “what risks have been identified in this project plan“, etc. I can use Copilot to help me spot gaps, or areas that the author might have overlooked or omitted. I can also ask Copilot to summarise things I do not understand in a simpler language or to help me get a new perspective on something.

    Summary

    Using any new tool, like Copilot sometimes takes time to realise the true value and power of what it can do. Working with Gen AI like Copilot is as revolutionary as the internet was back in the 90s. Many doubted it and now the world would stop without it.

    If you are lucky enough to have a Copilot for Microsoft 365 license, then I suggest you try the above. Use it every day and share your successes with your peers. If you don’t have an adoption and training team in house, then reach out to a partner for help, check out the adoption hub at Microsoft or get some ideas from my other blogs, or from YouTube 🙂

    Remember, think about and push Copilot to help you get more value at work and at home. Before starting any task, such as a presentation, meeting minutes or follow-up or research, think “Can Copilot help me here?“

    Yes – there’s a bit of a learning curve, but the effort you in will be worth it (IMO).

    Some video links…

    I have a growing handful of use case and scenario videos I am happy to share below… Hope you find the useful. If you do.. Let me know.

    https://youtube.com/@robquickendenmvp?si=8s9NGjjwfGEkLPSZ

    Posted on

    Navigating the Aftermath of the CrowdStrike Cybersecurity Outage: Insights and Strategies

    I run a monthly fireside chat panel discussion with IT and Business leaders from a handful of our Cisilion customers. Today, we talked about the outage and reflected on if, can and what we, the industry and our vendors need to do to minimise/prevent this vast impact happening again. 

    If you missed the "show" - you can watch it below.
    September 2024 – Cisilion Fireside Chat

    In our September 2024, fireside chat, our panel and I delved into the significant impact and lessons that can be learned from the CrowdStrike outage in July which is estimated to have cost more than $10B US and affected more than 8.5 million Windows devices when CrowdStrike distributed a faulty configuration update for its Falcon sensor software running on Windows PCs and servers.

    This update featured a “modification” to a configuration file which was responsible for screening named pipes [Channel File 291]. The faulty update caused an out-of-bounds memory read in the Windows sensor client that resulted in an invalid page fault. The update caused machines to either enter into a bootloop or boot into recovery mode.

    Today’s fireside chat conversation covered a range of topics, from the immediate effects of the outage to long-term strategies for enhancing cybersecurity resilience.

    The Immediate Impact of the CrowdStrike Outage

    The panel began by addressing the widespread disruption caused by the CrowdStrike outage. We discussed the outage’s extensive reach, affecting millions of devices and various sectors, including healthcare, finance, and transportation. In my intro to the episode, I mentioned that “It was really hard to believe…such a small relatively trivial and small update could impact so many people, devices and organisations“. This set the stage for a deeper exploration of the outage’s implications on cybersecurity practices.

    As we kicked off, I praised the collaboration between Microsoft and CrowdStrike in addressing the outage. He mentioned that despite initial blame-shifting in the media, there was a concerted effort to resolve the issue, showcasing the importance of vendor cooperation in crisis management. The panel in short didn’t think there was much more Microsoft could have done – the key was updates and openness which is so critical in a global issue like this – as people and businesses need updates and answers as well as help in restoring systems which both Microsoft and CrowdStrike did in drones.

    Vendor Reliance and Preparedness

    Ken Dickie (Chief Information and Transformation Officer at Leathwaite), emphasised the importance of incident management and the worlds’ reliance on third-party and cloud providers. He shared his insights into the challenges of controlling the fix and the revelation of technology’s utility nature to leadership teams stating that it can be hard to explain to “IT” on “how little control we had over the actual fix“. Matthew Wallbridge (Chief Digital and Information Officer at Hillingdon Council) echoed the sentiment, stressing the need for preparedness and the role of people in cybersecurity, stating, “It’s less about the technology, it’s more about people.”

    Supply Chain Risks

    Matthew raised concerns about supply chain risks, highlighting recent attacks on media and the need for better understanding and mitigation strategies. This part of the discussion underscored the interconnected nature of cybersecurity and the potential vulnerabilities within the supply chain.

    Goher Mohammed (Group Head of InfoSec at L&Q Group.) mentioned the impact on their ITSM due to vendor reliance in the supply chain, which degraded their service, emphasising the need for resilience and contingency plans. This led to further discussions about how important understanding the importance of the Supply Chain validation is in our security and disaster recovery planning and co-ordination. Matt talked frequently about “control the controllable” but ask the right questions to the ones (vendors) you can’t control. Goher said that whilst L&Q were not directly affected, they did experience “degraded service due to supply chain impacts“, emphasising the need for resilience and contingency plans and review of that of their supply chain(s).

    Resilience and Disaster Recovery Planning

    The conversation then shifted to strategies for enhancing resilience. Here I discussed how we at Cisilion are revisiting our own disaster recovery plans to include scenarios like the Crowdstrike outage.

    We discussed a lot about the cost of resilience and that there is a “limit” to what you can mitigate against before the cost skyrockets out of control with very little reduction in risk. It was agreed there are many things that can’t “easily” be mitigated in this particular scenario, but that we can be better prepared.

    The panel talked about various strategies that “could be considered” including recovering to “on-prem”, re-visiting the considerations around multi-cloud strategies and the potential benefits of edge computing in mitigating risks associated with device reliance.

    We also discussed whether leveraging technologies such as Cloud PCs, and Virtual Desktops have a part to play in recovery and preparation as well as whether using Bring Your Own Devices would/could/should be a bigger part of our IT and desktop strategy, along with, of course SASE technology to secure access.

    Goher advised “do a real audit, understand the most critical assets, the impact they have further down the line and whether there is more that can be done to mitigate against outage/failure/issue“. This led us into an interesting side discussion around Secure Access Service Edge (SASE) – emphasising the “importance of not relying on trusted devices alone”.

    The Human Aspect of IT Incidents

    David Maskell (Head of IT and Information Security at Thatcham Research) brought a crucial perspective to the discussion, focusing on the human aspect of IT incidents. He reminded the audience of the importance of supporting IT teams during crises, highlighting the stress and pressure they face. The panel agreed with David, all of whom emphasised the importance of ensuring teams are looked after, highlighting the human aspect of managing IT incidents especially when things are not directly controllable (such with Cloud outages) and the need for good, solid communications to the business.

    Ken also reflected on leadership’s reaction to the outage, emphasising the “gap in understanding the reliance on technology” that many business leaders (especially those not from a techy background) have”. The days of “it’s with IT to fix” are clearly not as simple as they once were!

    Conclusion: The Path Forward

    As we concluded the discussion, the panel dwelled over the lessons and tips to offer viewers, each other and the industry.

    In general the guidance acoss the panel were around

    1. The importance of regular security reviews, external audits, and business continuity testing.
    2. The need to adopt a proactive stance around cyber security and technology outages, ensuring that their teams are prepared (they run testing and attack/outage simulations).
    3. Ask more questions of your supply chains – they may be your weakest link. Are they secure, and are their recovery plans robust?
    4. Map your critical systems and know the impact on an outage – what is the continuity plan – if devices are affected, how can people access your technology – look at Cloud PCs (such as Windows 365), can you support the use of personal devices (look at SASE technologies such as Cisco Secure Connect)
    5. Review your technology dependencies. It’s not necessarily about multi-vendor but this might be a consideration – even for backup.

    In summary, the CrowdStrike outage serves as a stark reminder of the vulnerabilities inherent in our reliance on technology and the critical need for comprehensive cybersecurity strategies.

    Posted on

    Microsoft Copilot “Wave 2” is coming…

    Copilot Wave 2

    Mark your calendars for September 16th, as Microsoft is set to unveil the next phase of Copilot innovation!

    Hosted by CEO Satya Nadella and VP of AI at Work Jared Spataro, this short event promises to showcase the next phase of what will continue to evolve the Copilot revolution, which will further see the evolution of what is becoming a game-changer for businesses and tech enthusiasts alike.

    What to expect.

    There a bunch of things I am expecting to see based on the agenda, the Microsoft 365 Roadmap and other Microsoft posts and community updates. As such here’s what I’m hoping we hear about.

    • Rebranding and New Features: it will be  goodbye to “Copilot in Word” and hello to “Microsoft 365 Copilot in Word”. Yes the kind of re brand and renaming have already announced they are rebranding its Copilot products in a goal  to provide a more cohesive experience and consistency in naming. We have already seen this change from Microsoft 365 Copilot to Microsoft Copilot in Microsoft 365…
    • New Business-Focused Enhancements: With a focus on the business side of Microsoft’s Copilot offerings, they will focus on real life example of how these AI tools can revolutionise the way companies operate with an increased focus on smaller businesses along with enhancement for large enterprises.
    • From Preview to Release: we expect some of the services like Copilot in Excel to finally become “available” after being in preview for a year, updates to PowerPoint and for Team Copilot to go into public preview and more of the roadmap features to start rolling out such as scheduled prompts and proactive catchup.
    • Copilot Pro for consumer: I’m hoping to see updates and new features to Copilot Pro Updates. While details are still “under wraps” , I  anticipate new features will be announced such as being able to reference files (something Copilot in Microsoft 365 already does) and maybe deeper integration into other apps to  make this £19 monthly subscription more worth it.

    Registering for the event.

    The event is live (and will be available on demand) so to make sure you do not miss out on this chance to elevate your understanding of AI and its potential, Register below.

    • Date: September 16th 2024
    • Time: 8 AM PT / 11 AM ET / 4 PM UK
    • Platform: LinkedIn

    https://www.linkedin.com/events/7236780403867443202/

    Read the Copilot Public Roadmap: https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=Microsoft%20Search%2CMicrosoft%20Copilot%20(Microsoft%20365)

    Posted on

    Copilot+ PCs: A Game Changer for Businesses?

    Back in May, Microsoft unveiled the next generation of PCs with the Copilot + PC which was released for consumers. Today (4th September 2024), Microsoft has once again set a new benchmark with the introduction of Copilot+ PCs for Business users.

    Like their consumer counter parts, these next generation “AI devices”, which include the Surface Pro 11th Edition and Surface Laptop 7th Edition, are designed to revolutionise productivity and creativity in the business world. Copilot+ PCs are also shipping from other OEMs such as Dell, Lenovo, Acer, HP etc.

    Copilot+ PCs are equipped with the most powerful Neural Processing Units (NPUs) available for Windows PCs, delivering blazing-fast processing power. This allows businesses users to handle the toughest tasks with ease, up to 90% faster than previous models. The integration of advanced AI features, such as live captions and real-time translations, ensures that your team can work smarter and more efficiently.

    This blog, re-dives into the main differences between Copilot+ PCs and “non-Copilot PCs”, the improvements over previous models, and why these advancements are crucial for businesses and aims to answer the “why now” questions.

    Copilot+ PCs vs. Non-Copilot PCs

    1. AI Integration:
      • Copilot+ PCs: These devices are equipped with advanced AI capabilities, thanks to the Neural Processing Unit (NPU) that can handle up to 45 trillion operations per second (TOPS). This allows for efficient AI processing directly on the device, reducing latency and improving performance. These enable new AI workloads and functions within many applications to be enabled and powered by these new NPUs.
      • Non-Copilot PCs: Traditional PCs rely more on cloud-based AI processing (since they did not have NPUs), or required the CPU to do the grunt work, which can slow down performance and is dependent on internet connectivity.
    2. Performance:
    3. Connectivity:

    Power, Performance, Productivity

    This is the “why now” for Copilot+ PCs. More than just a device refresh, this new class of devices brings exceptional performance, never seen before battery life and the fastest application performance on Windows to date.

    1. Enhanced Performance: The new Copilot+ PCs feature significant performance upgrades with the Snapdragon® X Elite and X Plus processors. These processors not only boost productivity but also enhance AI processing capabilities, making them ideal for modern business applications.
    2. Incredible Battery Life: Surface Laptop 7th Edition offers up to 22 hours of battery life, a substantial improvement over previous models. This extended battery life ensures that professionals can work longer without needing to recharge, enhancing productivity on the go. Surface Pro 10 offers more than 18 hours in tests.
    3. Blazing App Performance: Microsoft has dedicated significant resources to the developer ecosystem, ensuring seamless performance for both native and emulated apps on Windows on Arm (WoA). The new Prism emulation engine further enhances performance and reduces CPU usage for emulated apps, surpassing even native apps on earlier models.
    4. Built around the user – Surface Copilot+ PCs provide a seamless and intuitive experience. These devices come with features like adaptive colour, optional OLED and HDR displays, and a flexible kickstand (Surface Pro) making them adaptable to any work environment. The all-day battery life (up to 22 hrs) ensures that your people stay productive without frequent interruptions.

    Copilot+ PCs – Why Now?

    1. Productivity and Efficiency: The AI capabilities of Copilot+ PCs enable businesses to automate routine tasks, analyse data more efficiently, and make informed decisions faster. This leads to increased productivity and operational efficiency.
    2. Security: Copilot+ PCs come with advanced security features, including the Microsoft Pluton security processor and Windows Hello biometric authentication. Together these provide robust protection against both physical and digital threats and work seemlessly with your device management tools such as Intune. This comprehensive security framework ensures that your data remains safe and easily managed across the organisation. These enhanced security measures in Copilot+ PCs provide a higher level of protection, making them a more secure choice for businesses handling sensitive data.
    3. Flexibility and Mobility: With optional 5G connectivity and extended battery life, Copilot+ PCs allow professionals to work from anywhere without compromising on performance or security. This flexibility is crucial in today’s hybrid work environment.
    4. Developer Support: The Windows Copilot Runtime and the availability of on-device AI models make it easier for developers to integrate AI into their applications. This fosters innovation and allows businesses to leverage AI-driven solutions tailored to their specific needs. Aspects such as Windows Studio Effects that bring Background Blur, Automatic Framing and Voice Focus, Portrait Light, Creative Filters and Eye Contact Teleprompter, can be invoked by developers directly in their applications without having to create models or develop the code.
    5. Future Proofed Investment : As businesses increasingly turn to AI to innovate, having the right hardware is crucial. Surface Copilot+ PCs are built to scale and adapt as AI capabilities evolve, ensuring that your investment remains relevant and valuable. These devices support local development and execution of AI models, providing the agility needed to stay competitive.

    What SKUs are available?

    As discussed, there are two standout devices – Laptop 7, Pro 11 and the Surface Pro 5G. Here are the key specs and features from a hardware perspective to note:

    Surface Laptop 7

    • Launch Date: 12th September 2024
    • Size Options: 13.5″ and 15″
    • Processors: Snapdragon® X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)
    • Graphics: Qualcomm® Adreno™ GPU
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
    • Copilot Key: Yes – for quick access to Copilot in Windows 11

    Surface Pro 11

    • Launch Date: 12th September 2024
    • Processors: Snapdragon® X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)
    • Graphics: Qualcomm® Adreno™ GPU
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
    • Copilot Key: Yes – for quick access to Copilot in Windows 11
    • Options: New flex Premium keyboard designed to be used either attached to your Pro for the ultimate laptop set-up or detached as a standalone keyboard for a new level of flexibility.

    New Surface Pro 5G

    • Launch Date: October 2024
    • CPU Options: Available with Intel I5/I7 and Snapdragon X Plus / Snapdragon® X Elite
    • NPU: Qualcomm® Hexagon™ (45 TOPs)/ Intel AI boost
    • Graphics: Qualcomm® Adreno™ GPU / Intel graphics
    • Copilot key: Key – for quick access to Copilot in Windows 11
    • Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
    • NFC– Allows use the built-in NFC reader to sign in with an NFC security key.

    Conclusion

    Surface Copilot+ PCs stand out due to their advanced AI integration and superior performance. Unlike non-Copilot+ PCs, which may lack dedicated NPUs, Copilot+ PCs offer specialised hardware designed to handle AI tasks efficiently. This results in faster processing times and more accurate AI-driven features.

    Video (c) Microsoft

    Surface Copilot+ PCs are not just another piece of hardware; they are a strategic investment in your business’s future. By equipping your team with these advanced devices, you can unlock new levels of productivity, security, and innovation, positioning your business for success in an AI-driven world.

    You can read more, from Microsoft in the latest community blog update which you can access below: https://techcommunity.microsoft.com/t5/surface-it-pro-blog/accelerate-ai-transformation-with-surface-pro-and-surface-laptop/ba-p/4227521?wt.mc_id=MVP_309187

    Posted on

    Windows 11 August (optional) Update: What is new….


    As we wait for the big 24H2 update due this autumn, Microsoft has quietly rolled out an optional update (going by the name KB5041587) for Windows 11, bringing a host of improvements and new features.

    While this update is not mandatory, it does offer several enhancements that make it worth installing (especially if you have a PC powered by an AMD CPU).

    Overall, the KB5041587 update for Windows 11 brings a range of valuable enhancements for users who frequently share files with Android devices, includes improvements to Narrator, voice typing, and File Explorer.

    Here’s a breakdown of what this update entails and why you might want to install it.

    Performance Boosts for AMD CPUs

    One of the most notable improvements in the KB5041587 update is the performance boost for AMD’s latest CPUs. Users with Ryzen 5000, 7000, and 9000 series processors with up to a 13 percent increase in performance.

    This enhancement addresses the previously disappointing performance of these CPUs, making it a significant update for AMD users.

    Enhanced File Sharing with Android Devices

    This update introduces a new feature that allows users to send files directly to an Android phone via Windows Share.

    Unlike Nearby Sharing, the Android device does not need to be in close proximity to the PC. Instead, it just needs to be paired via Phone Link.

    This feature simplifies the process of transferring photos and documents, making it more convenient and efficient.

    Improvements to Narrator and Voice Typing

    Windows 11’s Narrator feature, which reads out loud the contents of documents and websites, has received improvements in speed and accuracy.

    These enhancements are particularly noticeable when using the Edge browser and reading large documents.

    Additionally, voice typing has been optimized to allow for faster spelling of characters and more commands for text manipulation.

    Bug Fixes in File Explorer

    Several bugs in File Explorer have been addressed in this update. Issues such as the Ctrl + F keyboard shortcut not starting a search and the Shift + Tab shortcut losing keyboard focus have been fixed.

    These fixes contribute to a smoother and more reliable user experience when navigating and managing files.

    Installing the update

    Unlike the regular security and fix updates, the KB5041587 update must be manually installed.

    If you wish to install this one, you will need to navigate to Settings > Windows Update and select the update for installation. This manual process ensures that users have control over whether they want to incorporate these new features and fixes.

    Posted on

    Microsoft Word Introduces Automatic Document Summarisation with Copilot

    Quicker, faster, easier is the goal with this new update for Microsoft Word and Copilot for Microsoft 365 users, which aims to make handling long documents much easier. The feature, known as automatic document summarisation, is now rolling out now to select users.

    Auto Summarise in Word


    Key Highlights include:-

    • Automatic Summaries: With this new feature, Copilot licensed users will receive an automatic summary at the top of their Word documents. This summary synthesises the most important information, allowing users to quickly grasp key points without reading the entire document.
    • Interactive Summaries. Users can expand the summary by clicking the “View more” button, copy it, or even start a new chat with Copilot to discuss the content further. After making edits, a new summary can be generated to reflect the latest changes.
    • Availability: The new feature is gradually rolling out to users with Copilot licenses on word for Windows (version 16.0.17928.20114 or newer), Mac (version 16.88, build 24081116 or newer), and the web. If you don’t see it yet, check back in a few days.


    This new feature is part of Microsoft’s ongoing efforts to enhance productivity and make information processing more efficient. For more details, you can visit the official Microsoft 365 Insider blog.

    Want to see this in action?

    I’ve created a YouTube video that dives deeper into this feature and demonstrates how it works.

    Be sure to check it out for a more detailed video  walkthrough!

    Posted on

    Windows 11 24H2 Update will bring Quality, Performance, and AI updates

    Image showing words Windows 11 24H2 Update

    As we head into September, Microsoft is preparing to start the rollout of their annual Windows 11 feature update, this time focusing on the underlying platform and surface-level quality-of-life improvements and updates as well as some major updates to Windows on Arm (WoA). Windows 11 24H2 (also known as the 2024 Update) is a huge update in fact, including everything from performance increases across the board, UX changes and new AI (of course) features.

    The Windows 11 2024 Update is packed with OS improvements and new features across the board, with special attention given to those running an ARM-based device this time around.

    This update is a much bigger release than last years’ 2023 H2 update, due mainly to a vast number of underlying platform enhancements. There are improvements to Windows Update process, an updated and faster x86 emulation layer for Arm PCs (such as Copilot Plus PCs), and new AI features that will take advantage of newer devices which have a dedicated NPU (neural processing unit.).

    On Copilot+ PCs, this Windows 11 release is also the first include features exclusive to this new category of Windows devices. This means if you don’t yet have a Copilot+ PC, then you miss out on certain features when upgrading to version 24H2, such as the controversial “Windows Recall” AI feature.

    Windows 11 24H2 also promised to be much better for gamers, since it includes many new capabilities that utilise the high-performance hardware of Copilot+ PCs and new software optimisations. An example of innovation is the new emulation engine, Prism. It operates seamlessly, converting x86 or x64 code to Arm64 instructions when you launch an x86 or x64 application on an Arm-based Windows 11 device, all without requiring extra effort from developers.

    Why is this important? Well, given that many of today’s games are written for x86 or x64, Prism unlocks a large back log of games that work great on Arm under emulation. While Windows on Arm has had emulation in the past, the performance improvements of Prism, along with automatic super resolution and the new Snapdragon® X Series processors together emerge as a game-changer.

    So here is a summary of the key changes and updates you can expect in the Windows 24H2 update. Features in Bold are just for Copilot+ PCs.

    Desktop and start menu

    • Phone Link is now integrated with the Start menu
    • Taskbar system tray layout has been further simplified
    • Quick Settings has been rebuilt to be faster and more customisable
    • Windows Spotlight image is now the default wallpaper setting
    • The Taskbar app preview thumbnails now have an animation
    • It’s now possible to set to HDR images as a desktop wallpaper

    File menu

    • The File Explorer home tab now includes updated layout with shared documents.
    • Just like in Edge, you can now duplicate tabs by right clicking the tab.
    • The context menu layout has been updated with better labelling making it easier to use.
    • Added ability to create .7z and .TAR archive formats as well as ZIP files without the need for third party apps.
    • If you use Phone Link, you can view your Android phone’s file system directly in File Explorer

    Native Apps

    • The new Outlook app for email, calendar, and contact is now included in the update (this will replace the mail and calendar app).
    • Photos now includes AI-enhanced generative erase and background editing.
    • The Copilot applet is now a standalone web app – meaning it can be resized and moved around like any other app.
    • Photos can now generate AI images based on user criteria (Copilot+ PC)
    • A new Recall app uses AI to capture everything you do and makes finding things easier (Copilot+ PC).
    • Paint now has built-in generative AI capabilities based on user drawn sketch (Copilot+ PC)

    Settings and other stuff

    • Windows Update now supports checkpoints and hot patching for faster and less obtrusive updates.
    • New PRISM emulation layer makes x86 emulated apps run up to 2x faster and smoother on Arm meaning Arm-based devices.
    • New Voice Clarity feature uses AI to remove background noise picked up by your microphone in supported apps such as Teams.
    • Power settings for plugged/unplugged state can now be configured simultaneously just they could previously in “control panel”
    • Energy Saver mode replaces “battery saver” and now applies to laptops and desktop devices.
    • Devices with the new “Wi-Fi 7” hardware is now supported.
    • AutoSR uses AI to enhances the framerate and quality of games (Copilot+ PC)
    • Live Captions translate languages into English in real-time locally (Copilot+ PC).
    • Advanced Windows Studio Effects enhance your webcam with filters (Copilot+ PC) and some older ARM based PCs such as Surface Pro 9 5G.

    Consumer and Gaming

    • Updates to x86/x64 emulation on Copilot+PCs and other ARM based devices brings significant (up to 2x) performance updates for games running under emulation – needed for games and apps that are not yet “native” ARM.

    Availability and Rollout

    The Windows 11 2024 Update process is rather unique in its rollout and availability this time round. Unlike previous versions of Windows 11, this release is rolling out in two distinct waves. Wave one is has essentially already shipped, but only on new Copilot+ PCs that launched on June 18. If you recently purchased a new Copilot+ PC running the Snapdragon X chipsets then you are already running Windows 11 version 24H2.

    For the rest of the world, Windows 11 24H2 for “non-Copilot+ PCs” is expected to begin rolling out gradually from late September, which is when Windows 11 feature updates normally begin rolling out to users.

    Windows Insiders get it earlier…

    If you want to try out the Windows 11 2024 Update ahead of general availability on non-Copilot+ PCs, you can do so today by joining the Windows Insider Programme.

    Posted on

    Exploring Microsoft Loop 2.0: The new goto tool for Collaborative work

    Microsoft has recently unveiled Loop 2.0, a significant update that promises to enhance the way teams collaborate and work together. With a revamped UI and a host of new features, Loop 2.0 is set to streamline the user experience and integrate seamlessly with the Microsoft 365 suite.

    Simplified User Interface

    The new UI in Loop 2.0 is designed to be clean and simple, removing any unnecessary clutter and focusing on what’s important – your work. The navigation menu on the left side of the app has been reorganized, making it easier to access meeting notes, favorites, recent items, and more.

    New Loop Interface

    Enhanced Creation and Organization

    A new Create button has been prominently placed at the top left, allowing users to quickly create workspaces or draft ideas from anywhere within the app.

    Image (c) Microsoft.

    Additionally, you can now add Loop Components, pages, or ideas to a workspace directly from the breadcrumb at the top, streamlining the process of organising your content.

    Collaborative Meeting Notes

    All Collaborative Meeting Notes from Microsoft Teams are now neatly organised under the Meeting Notes tab in Loop, providing a simple way to access all your meeting notes (these are nested for recurring meetings which is the killer feature for me).

    This feature enables users to create pre-read notes or agenda items for upcoming meetings and to keep track of in meeting notes too within the new Loop experience…

    Note: Today, notes generated by Intelligent Recap are not stored here.. I hope this will soon be added.

    Favorites and Recent Tabs

    The Favorites tab on the navigation bar provides quick access to your most important workspaces, while the Recent tab helps you find your latest Loop pages and components across Microsoft 365, including those created in Teams, Outlook, OneNote, and Whiteboard.

    From Preview to Release

    Loop 2.0 is now rolling out gradually to all commercial customers after being tested with organisations enrolled in the Technology Adoption Program (Tap). Microsoft say it is actively rolling it out.

    This update is part of Microsoft’s broader effort to reduce sign-in prompts, redirects, and delays when accessing their online services, making for a smoother and more efficient user experience.

    Posted on

    Microsoft to further enhance Hybrid Meeting Experiences supporting Multiple Cameras and Views in Teams Rooms.

    Announced by Microsoft in their Teams Roadmap (Roadmap ID 402517), Microsoft Teams continues to innovate the way we connect and collaborate, both in-room and remotely. This latest feature (set to roll out in October 2024) is the Multiple Camera View for Teams Rooms on Windows (not yet announced for Android), which continually promises to revolutionise meeting experiences as the world continue to adapt to hybrid meetings.

    A New Perspective on Collaboration

    This new feature which will support the transmitting of up to four discrete USB camera feeds at once, breathe new life and create new deployment options to revolutionise the use of large(r) areas such as multi-purpose rooms and halls, classrooms, and executive boardrooms, enabling in-room users to switch between multiple video cameras from the console on Teams rooms on Windows.

    Users using Microsoft Teams Rooms set up with multiple USB cameras attached to the MTR will see updated experience, in the form of a video select option on the Microsoft Teams rooms console. With this option, (when more than one video camera is attached to MTR), users will be able to switch between these cameras before and during a Teams meeting by selecting a camera from the list of available cameras.

    Image (c) Microsoft.
    Changing the Video Feeds in Teams Room Control Panel – Image (C) Microsoft.

    This functionality aims to improve visibility and guarantees that remote attendees can smoothly keep up with the proceedings.

    If the device does not have multiple USB cameras set up with Teams Rooms device in the conference rooms, there will be no difference in the experience.

    Benefits for In-Room Participants

    • Increased Inclusivity – Allows hybrid / meetings to cover more, angles and areas within large meeting spaces.
    • Flexibility – Allows easy switching between multiple views during a meeting automatically or manually.
    • Control and Personalisation – In-room participants can toggle the multiple camera view on or off with a simple button press or choose the best view for them.

    Advantages for Remote Participants

    • Inclusive Experience: Feel more connected to the in-room activities.
    • Customisable Views: Choose which camera feed to focus on at any time.
    • Engagement: Improved visibility can lead to better engagement and interaction.

    Enabling or Disabling the Feature

    This feature, when it becomes available, will need to be enabled and configured from the Teams Pro Management portal for each room.

    This update is for Microsoft Teams Rooms for Windows only – there is no indication (if/when) this will be available for Teams Rooms on Android.

    Conclusion

    As we move towards a more hybrid work environment, features like the Multiple Camera View are essential in bridging the gap between physical and virtual meeting spaces, especially in larger meeting spaces.

    Thanks for reading, welcome your feedback and stay tuned for more updates in this space.

    Posted on

    Common Mistakes with Microsoft Copilot and How to Fix Them

    Copilot is a super powerful tool but if you are not getting the results you expect, you might be “using it wrong”. This is based on my experience working with organisations large and small over the past year or so.

    Momentum continues to increase and we are seeing more and more public case studies show casing the value of Copilot for Microsoft 365. These focus on the “huge” time savings and efficiency gains organisations such as Barnsley Council, Clifford Chance, and Hargreves Lansdown experienced and how it’s now a tool their employees would not be able to give up.

    Getting to this stage is not as simple as just allocating a license and turning it on. The “view” of Copilot I see in many organisations, is very different and as such is so important organisations get off on the right foot with Copilot to ensure that their early experiences with Copilot go well, they understand and evaluate where and how it fits and also where it doesn’t (or doesnt yet).

    It all starts with the right expections

    It’s hardly suprising that expectations of what Copilot can achieve are high. It’s not that they shouldn’t be, but we need to remember that most of what we see online and in demos are staged, based on the “perfect use case”, data in the “right place” and with Copilot embedded across all your apps and services.

    You need to make the cool aid before you can drink it.

    There are two scenarios with Copilot which I commonly see.

    First there are organisations that grab a handful of licenses, allocate them to a bunch of people and then expect Copilot to know everything about everything and do anything you can think of – setting themselves up for a fail or “less successful” trial.

    Secondly, there are those that follow the general guidance shared by Microsoft and their Copilot partners, who build a pilot team, annonce the trial (and what they expect of the pilot users), train and educate their users and share feedback amongst the teams to ensure everyone learns from each other before they expand it to more people.

    Whilst the second approach, almost always succeeds (assuming the pilot team are engaged and are open to sharing), I still find (in both scenarios) that part of the reason Copilot trials/pilots can fail quickly is that, in my experience, “people” try to go from zero to hero and rather than looking for many small gains, are trying to get Copilot do that one big thing that will totally change their workload and save them hours of manual effort per day or week.

    I find this problem goes away in the main, where organisations are working either directly with Microsoft or via their Copilot Adoption Partner, since the specialists they work with have the time to work with the employees to not only coach them through how and what Copilot can do, but also where it (on its own) may not be the answer they are looking for.

    So in short, I find that, many people are simply using Copilot wrong, misunderstand what it can and can’t do and then simoly give up on it and go back to what they did before.

    It’s not Copilot it’s you!

    In this blog, I am going to share the most common Copilot mistaken use cases that make people the most frustrated….and how to fix them….

    1. Trying to use Copilot as an automation tool

    This is very common. I often see people who have watched the Microsoft marketing videos (often sequence shortened) contour up an image in their mind that Copilot will solve all their business challenges. I see organisations map out end to end business processes they “would like” Copilot to solve for them that are, to be frank, sometimes outside of what Copilot is really designed to (or is able) to do.

    Copilot is not an RPA (Robotic Process Automation) tool. Yes, it can do many many things for you – such as reviewing documents, summarising meetings and actions and creating other “things” from them such as summaries, presentations or new documents.

    One of things I hear a lot (and experience) is often that Copilot doesn’t (or wont) do things in exactly the way I ask it to and it can be inconsistent if I ask the same thing twice.

    This is true and it is one of the “behaviours” of Copilot (and other Generative AI tools like ChatGPT or Gemini). I do find the more specific I am, the more “similar” my responses from Copilot become, but it’s serves back to the point that Copilot is not designed to carry out multi-step activities with a fixed predetermined output. It is also not currently possible to schedule or trigger Copilot based on an event or other trigger. See Prompting.

    Tip:
    Understanding the value and use cases of where Copilot fits into the business process and workflow is key to getting the best results. There are many areas where Copilot will provide real business value (either as a first eye, second opinion, note taker, author or creator). Working with a Copilot specialist partner or building a team of them internally will help the rest of the business get used to working “with” Copilot as the “assistant” it is expecting to be.

    2. Not understanding Copilot’s Grounding Capabilities

    One of the most common pitfalls in adopting Copilot is overlooking its grounding capabilities and limitations. Grounding is the term that refers to the context of the data Copilot can access/will access to perform the request you pass it.

    One of the unique values of Copilot for Microsoft 365 over “other” Generative AI experiences, is its deep-rooted access, context awareness and understanding of your business data [through the Microsoft Graph] to enhance its functionality and response. This means that, in short, you can ask Copilot about a particular file that someone shared or a meeting you had last tuesday and it will understand the context and content of that scenario and base it’s response around that. This is hugely value and one of the reasons it has so much value in the workplace. You can also point Copilot at specific content that is within your organisation (though these connected services) or via a URL – for example web content.

    The limitation of this grounding is also it’s benefit, in that for Copilot to be able to interface with your data (or application services), that data needs to be connected to the Microsoft Graph through either a connector or plug-in. These are sometimes provided (at cost) by the third party provider or can be built by your devops team or your partner.

    This is important because if your employees work off data that is stored primarily in a Document Management System (DMS) that is not connected to Microsoft 365, then Copilot will not have visibility over it or it’s data meaning that employees would need to manually copy and paste data from it, to Copilot in order for Copilot to do anything with it.

    Tip:
    When running your initial or later stage Copilot rollout, it’s important to ensure you understand where and how people work in different teams so that you know what data people work on and where it is stored.

    This grounding process is key as it allows Copilot to build upon the foundation of previous work, such as project histories or meetings. To maximise Copilot’s potential, it’s important to ensure that relevant data is accessible (through connectors or plug-ins) within Microsoft 365 or stored / migrated to Microsoft 365 (OneDrive, SharePoint etc.). For Copilot to work on meetings, you also need to be using Teams and must ensure they are recorded and/or transcribed.

    3. Over simplifying or over complicating Prompts

    Another key to Copilot’s effective use is the quality of prompts provided. Unlike an AI powered smart speaker, Copilot can handle really complex and specific requests , allowing you to write up to 2,000 (soon to be 8,000) characters in its input boxes.

    This means that prompts can well thought out, detailed and quote refined, leading to more specific and sophisticated responses. I have written other blogs on prompt perfection if you wish to read them.

    That said, the key when adopting and getting to know Copilot is to encourage your people / teams to experiment with prompts, iterating them and and refining them to achieve the desired outcomes whilst rememering that the same prompt will rarely generate exactly the same answer.

    Whilst simple prompts are often to vague, not specific enough and therefore may not yield the desired/expected results, prompts that are too complex can also be ambiguous, conflict or go “off topic” so getting the right balance is needed.

    Tip:
    Another way to get what you wanted it to make your prompt a conversation: Copilot support interative responses meaning that you can have a conversation with it. Writing the perfct prompt is not always easy to do and can be frustrating so feel comfortable in having a conversation with Copilot. You may find the iterative process becomes fundamental to how you work with Copilot and perfecting the response.

    You see unlike human assistants, Copilot thrives on repeated, slightly altered instructions to refine its output. This approach requires a shift in mindset from one-shot solutions to ongoing dialogues with Copilot. By embracing this iterative process, businesses can tailor Copilot’s responses to their specific needs more effectively.

    4. Not feeding Copilot properly.

    One of things I often find when working with Copilot on more “complex” prompts and tasks is that you can tell it to base its response or output based on a specific file that contains the things you want Copilot to do / check / review for me. Whilst Copilot can leverage the Microsoft Search (via Graph API), if you know what file(s), meeting, person etc, you want Copilot to leverage, you can include that in your prompt.

    In the example below (a real one that I was working with a customer on), you can see that we are using to Copilot to review some CVs against a Job Description and Criteria document.

    Example Copilot for Microsoft 365 Prompt – Grounded with specific data/files

    In this example, I am “feeding” Copilot the CVs I want it to review along with a Job Requirements document which contains a table of criteria about the role and the scores available based on this criteria. This means I can focus my prompt on what I need Copilot to do for me using existing data which is used to “ground” it’s response.

    Tip:
    One of the bug bears I hear alot around Copilot is why it can’t fill out a form for me. It cant. However…. you can ask Copilot to create an output for you based on an existing document. The video below shows an example of doing just this.

    Conclusion

    The integration of Copilot for Microsoft 365 presents a transformative opportunity for businesses.

    By educating employees, understanding its grounding capabilities, mastering effective prompting, practising an iterative approach, and implementing a strategic adoption plan, businesses can position their organisations to really see the benefits of Copilot.

    I hope the tips above help – welcome your questions and views.

    Posted on

    Snapdragon X: The power behind Copilot Plus AI PCs

    Picture of a Surface Keyboard with Snapdragon X sticker

    Qualcomm’s Snapdragon X series processors are specifically crafted for PCs, particularly Windows on Arm and Copilot Plus PCs available from HP, Dell, Lenovo, Acer and of course Microsoft Surface. The processors inside these latest generation of devices, integrate the renowned Snapdragon technology from premium smartphones with the demanding performance needs of the PC domain. The goal is to deliver a processor that competes with Intel and Apple in terms of performance, while also offering the energy efficiency typical of smartphones and providing cutting edge NPU performance to power existing and upcoming AI powered applications.

    Arm vs Intel: The Copilot Plus PC Revolution

    Copilot Plus PCs, like the Surface Laptop 7 are powered by these Snapdragon X Arm chips. The fundamental components shared by all Snapdragon X series chips include Qualcomm’s custom Arm-based Oryon CPU, rather than Intel’s x86, an enhanced version of their Adreno GPU (derived from their mobile devices), the Hexagon NPU for on-chip AI capabilities, and cutting-edge networking technology supporting the latest Wi-Fi 6 & 7 and 5G standards.

    On the software front, Microsoft offers an emulation layer within Windows on Arm (WoA) to facilitate the running of x64 applications not yet native to Arm processors. Notably, there is an extensive collection of native Arm applications from Microsoft, Adobe, and other prominent developers.

    About the Snapdragon X chipset options

    Snapdragon X comes in two major flavours. The X Elite, which powers the first wave of top-tier Copilot Plus PCs, and the X Plus, destined for the more affordable range of Copilot Plus PCs (You’ll see most vendors providing options for both).

    Today, Qualcomm has a total of four different Snapdragon X SKUs – three under the X Elite branding and one more affordable X Plus unit. You can see the subtle differences below, with the main differentiator being CPU cores and performance.

    All current Snapdragon X models boast a remarkable 45TOPS Neural Processing Unit (NPU), which means they are all equipped to handle the same AI features. An NPU enhances the traditional CPU by adding machine learning (AI) specific computational abilities. An NPU is not only faster but also more energy efficient. This offloads work from the CPU, allowing the NPU to manage AI tasks, similar to how a GPU handles graphics-intensive tasks.

    • Snapdragon X Elite
      • 12 Oryon CPU cores
      • Clock speeds up to 4.2Ghz
      • 4.6 TFLOPS GPU (Graphic Processing Unit)
      • 45 TOPS NPU (Neural Processing Unit)
    • Snapdragon X Plus
      • 10 Oryon CPU cores.
      • Clock speeds up to 3.4Ghz
      • 3.6 TFLOPS GPU
      • 45TOPS NPU

    What about the new Surface Line up?

    Snapdragon X offers competitive performance against not just Intel’s latest chips, but also against the Apple M3 and M4. The real star though (not a fan of just CPU benchmarks personally), is that battery life is simply incredible compared to previous generations of devices with initial testing and reports (from others such as here and here) showing these devices comfortably exceeding the demands of a busy workday, positioning these laptops as genuine contenders to the MacBook (which has always somehow always won for battery life). Running emulated x86 apps under emulation will (and does) run the CPU harder which will in turn impact battery life.

    This next generation of AI powered PCs sch as Surface Laptop 7 and Surface Pro 10 are two such devices offering superior power, power efficiency and extreeeeeeemley long batter life.

    Battery Life Wins

    That said, tests by PC Magazine, revealed a result of almost 25 hours usage – making “Surface Laptop one of the longest-latest laptops we’ve ever tested on battery“. In comparison a 13-inch MacBook Air lasted “just” 21 hours and 38 minutes in their testing.

    Surface Pro 10 and Surface Laptop 7 are the the first Copilot+ PC which feature these new Snapdragon X Elite and Snapdragon X Pro processors.

    PC Magazine said in their comprehensive hands-on review of Surface Laptop 7 that

    “…this is easily the best Arm chip we’ve tested yet in a PC. The CPU and GPU performance are there and deliver at least competitive benchmark numbers relative to current-gen Intel and AMD offerings in the early going. Qualcomm is to be commended for that.” | PC Magazine

    What is your view on these Copilot Plus PCs? Have you got one yet – what are your first impressions?

    Posted on

    Microsoft wants to lock down the kernel after CrowdStrike hiccup knocks out millions of Windows devices.

    Windows Kernel Security - Image by Designer (AI)

    Microsoft is reviewing their options and looking to push for significant changes to their Windows security architecture in the after math of the major outage caused by a “faulty” CrowdStrike update last a couple of week back. The impact of the faulty update, is thought to have afftected around 8.5 million Windows devices and services when the faulty update caused Windows devices to reboot and enter their protected recovery mode.

    Microsoft acknowledges the inherent ‘tradeoff’ kernel-level cybersecurity solutions pose and confirms the root cause of the global outage.

    This has prompted Microsoft to reassess the level of control that third party security vendors have over the deepest parts of their operating system and they are considering limiting kernel- level access for these vendors.

    “This incident shows clearly that Windows must prioritize change and innovation in the area of end-to-end resilience“. | John Cable | Microsoft see blog post,

    Time to bring control back?

    John Cable, Microsoft’s VP of program management for Windows servicing and delivery, discussed passionately their viewpoint in a blog post named “Windows resiliency: Best practices and the path forward.” In this post, he emphasised the need for “end-to-end resilience” and discussed potential changes Microsoft are reviewing that could mean restricting kernel access for third party security vendors such as CrowdStrike.

    Snipit from John Cable’s blog post | July 2024


    The CrowdStrike update bug, which resulted in widespread system crashes, has clearly highlighted the risks associated with allowing third-party security apps and services to operate at the kernel level – a new approach is needed.

    Privileged access, though advantageous for detecting threats, can result in disastrous failures if mishandled. Microsoft is investigating alternatives that circumvent future kernel access issues, including VBS enclaves and the Azure Attestation service. Employing Zero Trust methodologies, these solutions aim to bolster security without incurring the dangers inherent in kernel-level operations.

    Why do Microsoft let third parties access the kernel?

    In short, they dont have much choice (see below).

    While Microsoft may be looking to further restrict access to its Windows kernel going forward, they have used this event to  explain why third-parties antivirus and security vendors to access the “core of Windows” the first place.

    The Windows kernel is a deep layer of its operating system. Kernel-level cybersecurity lets developers do more to protect machines, can perform better, and can be harder for threat actors to alter or disable.

    When a kernel-level cybersecurity solution loads at the earliest possible time, it gives users (and companies) the most data and context possible when threats arise and also ensures protection can kick in at the earliest stage of the Operating Systems boot up stage rather than waiting for the OS to load and then running as a normal system process.

    The EU may prevent changes over anti-trust claims

    Whilst this makes common sense to most, after all why shouldn’t Microsoft be able to restrict access to ensure stability of an operating system used by more than a billion users, their push for change is likley to face resistance from both cybersecurity vendors and regulators.

    Back in 2006, Microsoft tried to restrict kernel access around the release of Windows Vista, but was met with opposition and a ruling that preventing them doing this, citing anti compete. In contrast, however, Apple successfully managed to lock down their kernel level
    access in macOS in 2020. The market for Windows software is of course far larger than Apple’s MacOS and Microsoft is an open platform for developers to build upon so any changes will need to be done in a way that make this possible without preventing developers software doing what they are supposed to do!

    Microsoft has attributed part of the CrowdStrike outage to the 2009 European Union antitrust agreement, which mandates that Microsoft must provide kernel-level access to third-party software vendors. Conversely, Apple started to phase out kernel extensions in macOS in 2020, encouraging software vendors to adopt the “system extension framework” due to its reliability and security advantages.

    It is not the first and wont be the last time either that the EU have played the anti-trust card. Microsoft has recently had to decouple Teams from Microsoft 365 as a response to competitors such as Zoom citing Mcirosoft have an unfair advantage. They have had recent claims against them with Internet Explorer and Edge.

    Zero Trust Kernel Protection mayt be the way forward

    The blog post indicates that Microsoft is not proposing a complete shutdown of access to the Windows kernel. Rather, it highlights alternatives like the newly introduced VBS enclaves, which offer an isolated computing environment that doesn’t necessitate kernel mode drivers for tamper resistance.

    “These examples use modern Zero Trust approaches and show what can be done to encourage development practices that do not rely on kernel access…We will continue to develop these capabilities, harden our platform, and do even more to improve the resiliency of the Windows ecosystem, working openly and collaboratively with the broad security community vendors”.
    John Cable | Microsoft Windows VP

    Trade off between “anti-compete” and stability.

    Microsoft acknowledges that the tradeoff of kernel-level cybersecurity products is that if it glitches out, it can’t be easily fixed, saying in their blog that. “all code operating at kernel level requires extensive validation because it cannot fail and restart like a normal user application.”

    As such companies have to demonstrate strict quality and testing controls over their software. The CrowdStrike issue occurred since this wasn’t a new product but” simply” and software patch by CrowdStrike that… well, went wrong.

    Microsoft can’t vet every patch and every update released by their “trusted” ISVs/third parties, especially when it comes to security updates which these security vendors need to roll out requently.

    “There is a tradeoff that security vendors must rationalise when it comes to kernel drivers. Since kernel drivers run at the most trusted level of Windows, where containment and recovery capabilities are by nature constrained, security vendors must carefully balance needs like visibility and tamper resistance with the risk of operating within kernel mode.” | Microsoft

    What ever happens – businesses still need to have backup and remediation processed in place.

    In response to the CrowdStrike incident, Microsoft deployed over 5,000 support engineers to aid affected organizations and provided continuous updates via the Windows release health dashboard. They rapidly developed recovery tools to assist companies in their recovery efforts, while emphasising the significance of business continuity planning, secure data backups, and the adoption of cloud-native strategies for managing Windows devices to bolster resilience against future incidents.

    Further whitepapers and guidance will be released in the coming months and I expect this will lead to Microsoft, and their third party vendors releasing more recovery tools and guidance.

    Summary

    Microsoft “confirmed that CrowdStrike’s analysis that this was a read-out-of-bounds memory safety error in the CrowdStrike developed CSagent.sys driver,” Microsoft explained in their technical analysis of the crash and why the impact was so huge in a technical paper published last week.

    Reviewing the security architecture and access to the kernel is definately needed, but their approach and desire to prevent future issues with third party glitches will likley be at the brunt of complaints from third party security vendors and the EU anti-compete regulators.

    Apple “seem” to have a much easier ride when it comes to doing what they want – they say “jump” and developers say “how high”. Microsoft repeatedly have to “please” regulators far more – this recent huge global impact, may work in Microsoft’s favour however, to bring some control and governance in the name of system and business stability which I am sure will get the backing of everyone and every organisation impacted.

    One thing is for certain -Microsoft wont take this sitting down. They will work hard to continue to protect their OS which is run on billions of devices and used by almost all coporations, education and crititical infrastrucutre. Change will happen!

    Proudly powered by WordPress