Tag: Copilot Plus PC

Microsoft (off the back of Windows 11 24H2 release this week) have unveiled a series of updates to their AI infused Copilot+ PCs, aimed at enhancing the user experience with innovative features.

Copilot+PCs are a new category of PCs released this year by leading OEMs including and debuted by Microsoft and are equipped with NPUs. These devices come in Intel, AMD, and Qualcomm-powered Windows on Arm configurations. Microsoft introduced several new features for both types of these advanced PCs. The newly launched Windows 11 2024 Update (version 24H2) brings new functionalities for all Windows 11 users, with some exclusive enhancements specifically for Copilot+ PC owners. 

These updates further demonstrates Microsoft’s commitment to baking AI assistance into more and more manual or semi manual tasks, and are designed to make everyday tasks more intuitive and efficient, leveraging the power of AI to transform how we interact with our new shiny devices.

These new features are summarised in an extensive Copilot / Windows Blog but the key ones I have summarised below.

Enhanced Search: Find stuff faster and easier.

One of the standout features in this update is the new Enhanced Search. Here, Microsoft has integrated AI-driven improvements deep into Windows search, making it significantly more powerful and user-friendly.

With these enhancements, users can now find files, images, and emails with ease, even if they don’t remember the exact names. Better than a simple search index (you know, that thing that used to grind your PC to a halt), this AI search understands context and can retrieve relevant results based on partial information or related keywords.

For instance, if you’re looking for a presentation you worked on last month but can’t recall the title, simply typing in related terms like “presentation” and “last month” will bring up the correct file. This feature is huge change for how we find and retrieve information and is more human connected in terms of how we think and ask. Plus, if you are anything like me, it should reduce the time spent searching for documents and allowing users to focus on their work.

For images this will work extremely well as you won’t need to know the file name and can search for pictures using words, even if the search word isn’t part of the file name!

The improved Windows search will first show up in File Explorer on Copilot Plus PCs from November.

This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “duplicate my screen” into the Settings search box and it will help you find the right settings.

Click to Do: Interacting directly with your screen.

This feature really caught my attention and is definitely one I think I will use.

Click to Do will allows users to interact directly with images and text on their screen to perform quick actions. As an example you might be viewing a webpage or a pdf and see a phone number. You’ll be able to click on it to initiate a call, or clicking on an address to open it in your maps application. This feature streamlines workflows by reducing the number of steps needed to complete tasks.

As an example, you could use Click to Do to perform a visual search on an item that appears in a YouTube video you’re watching or a page you are viewing in a browser. Click to Do is also context-aware, assisting with text-related actions like rewriting, summarising documents, explaining text, and sending emails.

Microsoft have said Click to Do will begin testing with Windows Insiders on Copilot Plus PCs in October, with a gradual rollout planned for November.

The previously announced Recall feature will also be available to Windows Insiders in October on Qualcomm-powered devices, before being rolled out to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November.

I think this could be a real time saver for me and for anyone who does a lot of research, works with high volumes of information and has lots of open windows on their screen(s). By enabling direct interaction with on-screen content, it should help minimise interruptions and keeps the focus on what your are doing without having to open other tools.

Generative AI in Paint: Bringing modern tech to a staple app.

Microsoft Paint is also getting another significant upgrade (which has been in testing with Windows Insiders for a few months) with the introduction of new generative AI tools. These new tools ncluding generative fill, image generation (using Designer) and generative erase, that bring capabilities similar to those found in advanced photo editing software like Photoshop. Layers was also introduced to Paint earlier this year.

Copilot UI : The human touch.

Finally, Microsoft are revamping the general Copilot experience. This is not just about adding new features (though there are some) but are more about a total overhaul and part of their vision to make AI a more human-centric experience.

Their goal is to differentiate Copilot from other AI tools like ChatGPT and Gemin, by focusing on usability and user satisfaction. This approach ensures that the technology adapts to the user’s needs, rather than the other way around.

I covered this in more detail in another blog post below.