Tag: AI-PC

Posted on

Recall “Recalled” Again: Microsoft’s Copilot+PC Flagship Feature Faces Further Delays

Recall Recalled again feature image

In a move that has surprised few, Microsoft has once again delayed the rollout of its controversial Recall feature for Copilot AI PCs. Initially planned for a June release to coincide with the new Copilot+PCs launch, Recall was then postponed to October while Microsoft addressed initial concerns around privacy and security.

This week however, Microsoft has yet again delayed this again with testing for Windows Insiders coming (so we are told) in December, which unfortunately falls after Ignite.

Microsoft Recall….

Security Concerns and Refinements

Recall’s primary value is to create a timeline of screenshots that users can scroll through and search. However, early testing revealed by security researchers discovered that the core database storing these screenshots and tagging was not encrypted, posing a massive security risk.

Microsoft have since addressed this by fully encrypting the database and requiring Windows Hello authentication for access.

Microsoft have also confirmed that Recall will now be an opt-in feature, allowing users to completely uninstall it if they choose.

Microsoft’s Cautious Approach

Brandon LeBlanc, senior product manager of Windows, enforced Microsoft’s commitment to delivering a secure and trusted experience with Recall.

Microsoft need to get this right in order to maintain trust with its customer base. He stated that the additional time is necessary to refine the feature before previewing it with Windows Insiders. Despite these assurances, social media shows huge skepticism about whether Microsoft will meet the new December deadline and even if they might scrap the feature all together. This will be a shame, as the value around it looks. Promising and is really ( currently) the one killer reason consumers were looking at when looking at investing in Copilot+ PCs outside of the huge battery life that these Qualcomm Snapdragon Powered devices deliver.

The verge covered this in an exclusive interview

Wider AI privacy concerns

The repeated delays and security issues surrounding Recall highlight broader concerns within the AI industry.

There is a growing perception that companies are rushing to release new features without fully considering the potential consequences.

Microsoft’s cautious approach with Recall is a step in the right direction, but it also underscores the need for more rigorous testing and security measures in AI development.

Will Recall still be exclusive to Copilot+ PCs?

That’s a good question.

When Microsoft announced the Copilot+PC back in June, Recall was the flagship feature and it was unique to the device’s (and kinda stole the show).

Since then AMD and Intel have released their new AI PC chipsets offering similar NPU performance to the Snapdragon chips in Copilot+ PCs like Surface Pro 11 and Surface Laptop 7.

We now have NPU turbocharged PCs with Snapdragon® X Series, AMD Ryzen™ AI 300 Series and Intel® Core™ Ultra 200V Series devices after all.

We don’t know if this will remain an exclusive (I don’t see why it would) and if all the “exclusive AI features” that are part of Windows 11 24H2 will soon be lit up in any decide with a dedicated NPU.

From what I can… It will be supported… But some features are limited to Snapdragon, so we will have to wait and see….

Coming soon then… Or will it?

While the future of Recall still remains uncertain, Microsoft’s efforts to address security concerns and refine the feature are commendable, I just hope they haven’t missed the boat. We’ve already seen Apple quietly move forward with Apple Intelligence (clever) and it’s now embedded in MacOS. Microsoft need to move quick and innovate here to regain confidence and innovative is their mission to empower every person on the planet to achieve more (with their technology)!

Consumers, IT professionals, industry experts and social media will be keenly observing whether the Recall gets the release and value reputation it received back in June, with  a secure and functional version of Recall to define what AI can really do in Windows.

I hope succeeds and brings life to the new AI PCs and Copilot+PCs or of it quietly gets canceled as skeptics seem to think…

Posted on

AI-PCs vs Copilot+ PCs: Understanding the Difference

As technology advances, the distinction between AI-PCs and Copilot+ PCs becomes increasingly important. Both types of devices leverage dedicated AI chip sets to enhance the user experience. They support new and upcoming software features. These devices prepare us for the continual wave of AI innovation. Under the name, what are the differences between the specifications and ability of these two types of “next generation” devices?

This blog aims to summarize the similarities and differences between the AI-PC, as dubbed by Intel. It also discusses the Copilot + range of PCs powered by Snapdragon ARM based chip sets.

The AI-PC

AI-PCs, like the Microsoft Surface Laptop 6, are powered by Intel chipsets and are the first of their next generation of personal computers designed to handle complex AI tasks efficiently. These PCs are equipped with Intel Core Ultra processors which also include a dedicated Neural Processing Unit (NPU), which accelerates AI and machine learning workloads directly on the device, providing up to 10 TOPS (Trillion Operations Per Second) of AI performance.

This means faster performance for tasks like real-time language translation, image creation, and enhanced multimedia experiences such as object removal, blur and audio isolation without relying heavily on cloud services or throttling the PCs CPU.

For the average user, this translates to a smoother, more responsive computing experience with smarter features. For IT professionals, it means robust performance for data-intensive applications and improved security through local processing and devices which will perform in a more unified way without “subtle” tasks like back-ground blur in video calls, hammering the CPU or consuming more internet bandwidth.

The Copilot + PC

Copilot+ PCs represent the pinnacle of AI-enhanced computing, designed to deliver unparalleled performance and support for AI-infused applications and extensions. These PCs are powered by Qualcomm’s Snapdragon X Series processors. They feature a turbocharged Neural Processing Uni (NPU). This NPU is capable of performing over 40 trillion operations per second (TOPS). This advanced hardware allows real-time AI functionalities. These include language translation, image generation, and intelligent task management directly on the device. For the average user, this means a seamless, responsive experience with smarter, more intuitive features. For IT pro’s Copilot+ PCs provide more robust performance for data-intensive and AI applications. They enhance security through local processing.

This can also reduce reliance on cloud services with the ability run “some” AI workloads locally depending on what has been coded of course by the software vendor. Examples of this might be background blur which as trivial as it may sound it network and compute intensive and can be performed on an NPU far better and with far less compute power.. This combination of powerful hardware and specialized software makes Copilot+ PCs a significant change in both personal and professional settings.

Copilot+ PCs, on the other hand, take this AI integration a step further. Some examples are the recently released Surface Laptop 7 and Surface Pro 11 devices from Microsoft. There are also devices from all other major manufacturers. These devices feature powerful and dedicated NPUs. They also come with Windows 11 – Copilot “exclusive” software and services enabled. These devices need Copilot+PCs to use them.

Interactions like “click-to-do” and Microsoft’s Recall leverage the advanced NPU’s capabilities. They provide enhanced AI features directly on the device. These interactions reduce CPU and GPU workloads. They allow local AI compute, which will in the long term support local language models.

These devices are powered by Qualcomm’s Snapdragon X series chips, which offer at least 45 TOPS of AI performance. This provides advanced functionalities such as real-time language translation and intelligent task management. It also enables more efficient multitasking. All of these features are included in the Windows 11 24H2 update.

Despite the differences, both AI-PCs and Copilot+ PCs bring enhanced performance for handling AI workloads. These devices provide a more integrated and advanced AI experience, thanks to the combination of powerful hardware and specialised software. At the time of writing the Copilot+ PC range deliver more AI-grunt than AI-PCs. However, the Intel-based AI-PCs will likely be more adopted by large enterprise organisations. These organisations still need to run older legacy applications. These applications have not yet been compiled to run on Windows on Arm (WoA). WoA is needed for Copilot+ PCs which are built on ARM chipsets and not Intel.

Spotting the Difference

The subtle differences between AI PCs and Copilot+ PCs. As endpoint technology continues to evolve, the gaps will most likely close. The 2025 edition of these technologies will continue to evolve. There is also new AI “optimised” PCs from AMD but I have not reviewed these here.

The main way to spot a Copilot+ PC or AI-PC vs an older generation device is the presence of a dedicated “Copilot key”.

The list below highlights the key things found on Copilot + PCs

  • AI Integration: Copilot+ PCs (currently) offer a more integrated AI experience. They include specialised software and features designed to enhance productivity. On the other hand, AI-PCs provide general AI capabilities without the specialized software. Copilot+ PCs are needed to run new Windows features like recall and Click-To-Do.
  • Dedicated AI Key: Copilot+ PCs include a dedicated Copilot key for quick access to AI-powered assistance. This key is not available in “some” AI-PCs. Older generation PCs also lack this feature.
  • Connectivity: Some Copilot+ PCs feature advanced connectivity options. These options include 5G, which is not typically found in AI-PCs or older generation devices.
  • Exclusive Software Features: Copilot+ PCs come with enhanced productivity tools like Recall and Click-To-Do. They also include other third-party features from Adobe, for example.

Conclusion

These new generation of AI-PCs and Copilot+ PCs bring more than just an annual chip set refresh. They are the ennoblement for the current and next wave of creativity. They drive productivity and innovation with the increasing number of AI-powered or AI-enhanced applications.

As always, Surface sets the standard – with their innovative anti reflective and HDR display technology, elegant and sleek design, sustainable and repairable design and unique features like the versatile kickstand along with fluidity of the Slim Pen 2 on Surface Pro, they empower users to achieve more and create without limits.

Posted on

AI-PCs – what’s the hype all about?

The new buzz in the world of PCs is all about the “AI PC”. This term is the latest messaging being banded around from PC/Laptop manufacturers with a view to ensure that people, families and organisations are taking this next generation of PC into account when planning their legacy hardware upgrades over the next 12-18 months.

AI analytics and modeling require vast amounts of data, which are best suited for cloud, but performing some workloads at the device level delivers more efficient processing, or inferencing, by being offloaded to the device. These efficiencies could be applied to:

  • Visual inferencing: AI applied directly to the camera feed
  • Audio inferencing: AI applied to audio inputs
  • Live transcription: AI applied to language processing

New AI-PCs are being designed and built with specialised processors (NPUs) to support executing those models, and more, locally, in real time.

You don’t need to look very far to see the phrase “AI PC” everywhere both from Intel and leading device manufacturers including Microsoft, but what is the tech behind the latest tech phrase?

You may be aware that Microsoft recently launched the Surface Pro 10 and Surface Laptop 6 – both of these fit into the new “AI-PC” catagory!

Note: AI is the capability of a computer program or a machine to "think, learn, and take actions without being explicitly encoded with commands".

So what is an AI PC?

In short an AI-PC needs to have these three key components:

  • An Chipset with a new NPU, CPU and GPU built-in
  • Windows 11 and Copilot in Windows
  • A Copilot Key (technically).

Of course CPUs and GPUs have been around for a long time, but it is the NPU (Neural Processing Unit) that is new in PCs and it is this that is the key part of an AI-PC. The NPU (or AI-Boost as Intel calls it) is designed to process AI workloads locally rather than in the cloud which brings many improvements for the user, including processor efficiency, improved battery life and increased security.

The NPU is a dedicated microprocessor designed to efficiently handle AI-specific tasks, such as executing predictive models, processing machine learning algorithms, or powering generative AI applications.

Surface AI-PC – Available on Surface Pro 9, 10 and Surface Laptop 6

The Intel Core Ultra processors featured in AI-PCs like Surface Pro 10 and Laptop 6 provide a holistic approach to running AI workloads on PC. These different processors offer programming versatility to developers that maximise the three type of microprocessors – CPU, GPU, and their new, integrated NPU. With an AI-PC, each microprocessor (compute engine) has its own specialisation, but in the context of AI on Cloud PCs mean they work together when using AI workloads with:

  • The CPU being ideal for general and traditional compute workload as well as light-weight, single inference AI tasks. Think “accelerating cloud-delivered AI” while minimising impact on overall system performance.
  • The GPU being ideal for AI infused into media and 3D rendering apps and tasks. Users can perform data visualisation tasks, create and manipulate 3D images, or generate elaborate reports, enabling your team to efficiently tackle complex data workloads.
  • The new AI-Boosting NPU which is designed specifically for sustained and efficient offloading of AI models such as Windows Studio Effects.

What are the benefits of an AI-PC?

In short – performance, battery life and enabling new AI-Powered experiences.

Windows and many other apps have AI features within their applications sets, but put simply with AI-PCs these AI features and tools will work much quicker and will unlock additional NPU-Specific features.

The NPU is a dedicated microprocessor designed to efficiently handle AI-specific tasks, such as executing predictive models, processing machine learning algorithms, or powering generative AI applications. The image below shows the difference between a video app’s back-ground blur using a CPU vs an NPU. The device on the right is a Surafce Pro 9 with dedicated NPU and it is easy to see how much better the AI effect is when it is processing the AI workload locally.

Image showing the difference between a video app’s background blur on a CPU vs. an NPU.

The key thing about the AI-PC is the impact on the CPU processing AI workloads when there is an NPU present. With AI features like voice and video effects in Windows and the wealth of AI features in apps like Adobe, CPU workload is dramatically reduced as the NPU does the AI grunt work (and is far more efficient at running them) This leads to a more efficient device, increased battery life and a more responsive OS and applications for users. The image below illustrates the impact savings running smilar tasks on a PC vs an “AI-PC”.

Image (c) Microsoft – March 2024

AI-PCs will empwer and improve many experiences – as compute for AI workloads moves to more local-mode and hybrid-mode processing. This goes beyond just video effects and speech and will include things like object detection “seeing AI”, gesture tracing, security and many more.

Intel claim that “AI PCs with an Intel Core Ultra processor are able to edit videos more than 230% faster and perform AI image editing tasks 52% faster.

AI PCs are also set to be defined by how they align with Microsoft’s Windows operating system as well. One of the most consumer-facing AI products right now is Microsoft Copilot, which is slowly rolling out to Windows 11 devices and we’re set to see a dedicated Copilot key on some laptops in the future too. Over time this will also take advantage of local AI-processing with AI-PCs

Note: Today, Copilot operates in the cloud and thus does not utilize a computer’s onboard NPU. However, this is expected to change, as Microsoft has announced plans for new system architectures that will enhance Windows AI experiences by integrating the GPU, CPU, NPU, and the cloud.

Will the birth of the AI-PC reboot the PC market?

I think the AI PC will be the PC of the next decade.

The PC market has been in decline for several years, but IDC predict that 2024 is estimated to see a 3.7 percent year-over-year increase in shipments, ending the decline the market has seen since the highs of the COVID-19 pandemic.

We are seeing Microsoft, Dell, HP and Lenovo, jumping on AI PCs and with the next two years likely to be the time that more organisations really start to experiment and test AI within their organisations, the rise of the AI-PC is set (according to IDC) to kickstart the PC business again.

Proudly powered by WordPress