At CES 2025 in Las Vegas this week, Microsoft’s head of Windows devices, Pavan Davuluri, announced that Phi Silica, a Small Language Model (SLM), will be integrated into the Windows runtime as part of Copilot in the first quarter of 2025 to provide offline use and performance boosts whilst also paving the way for additional features and privacy enhancements made possible through local processing.
What’s a Language Model?
Before diving into the details, it’s important to understand what a language model is. Language models are designed to comprehend, generate, and perform human-like language tasks, having been trained on vast amounts of data. However, not all language models are the same – they come in different sizes, large and small, each with unique strengths and weaknesses tailored to specific requirements.
The main differences between small and large language models lie in their size, capabilities, and resource requirements.
LLMs are ideal for applications needing high accuracy and versatility, such as advanced search, chatbots and content generation.
SLMs are generally more suited for specific, lightweight applications, like mobile apps and edge devices and laptops such which have local NPUs like Copilot+ PCs.
SLMs are coming to Windows 11
The Phi Silica SLM, which was first showcased at Microsoft Build in Seattle in May 2024, is designed to complement the Large Language Model (LLM) that runs in the cloud allowing specific AI workloads and processing to be run locally or handed over and run in parallel with the cloud based LLMs.
Small, but mighty, on-device SLM
Microsoft
Why? Well, whilst LLMs are typically faster and more accurate, they require cloud-based operations and can be costly to run and inflict subscription fees (think Microsoft 365 Copilot). SLMs, on the other hand, can run many and other AI-driven applications and tasks locally on PCs, ensuring privacy and preventing data leakage to the cloud. However, SLMs are less sophisticated and require dedicated Neural Processing Units (NPUs) to provide these local AI capabilities. Hello Copilot+PCs.
Copilot+ PCs and AI PCs
The NPUs (Neural Processing Units) in Copilot+ PCs are designed to be highly power-efficient, capable of performing trillions of operations per second (TOPS) while consuming very little power. Specifically, on devices with Snapdragon X Elite processors, the Phi Silica model’s context processing uses only 4.8 milliwatt-hours (mWh) of energy on the NPU.
Additionally, the token iterator stage of the model shows a 56% improvement in power consumption compared to running on the CPU. This efficiency allows Phi Silica to operate without overloading the CPU and GPU, ensuring smooth performance and minimal impact on other applications.
Microsoft said that features like Windows Recall, Click-to-Do and other AI functionalities will soon be able to leverage these SLMs. Phi Silica uses a 3.3 billion parameter model, fine-tuned by Microsoft for both accuracy and speed and will. Improve performance, enhance privacy and enable more “offline” usage.
In this review I look at the Surface Laptop 7 which I’ve been using daily for the past 3 weeks. We look at asterics, performance, battery life and more. It’s the first Copilot+PC from Microsoft which is set to yet again set the standards on the future of AI powered Windows devices!
I first got my hands on one of these devices last month at Microsoft Ignite 2024 in Chicago, where I had the pleasure to spend time with the global Surface Team in the community hub in the middle of the Ignite Expo Hall.
On show were the very latest Surface Copilot + PCs which feature the Qualcomm Snapdragon X powered devices that deliver over 45 Trillion Operations per Second (TOPS) of NPU power.
As part of the demo showcase, the devices were running the latest “insider” builds of Windows 11 where new innovative AI features within Windows, such as Recall and Click-To-Do, as well as updates to apps from leading developers including Adobe who were showcasing the next wave of innovation that is possible by harnessing the power of local NPUs on these new Copilot + PCs.
My History with Surface
I’ve been a fan of Surface many years, having owned, borrowed, or used numerous models since we transitioned to Surface around the Surface Pro 4 era. I even had a Surface Pro v1 and a Surface RT with Arm chipset running Windows 8 back in 2012 – devices I still have today in my “museum”.
As a Microsoft MVP, I’m also lucky to get access to demo and trial devices through the year which has given me some great perspectives of the continual evolution, advancements and innovation that Surface brings, not only to end user compute, but to the development and innovation of Windows.
Until recently, my daily device has been the Surface Pro 9 5G. This is a Qualcomm powered ARM device running Windows on Arm (WoA). I also have a smaller (Intel powered) Laptop Go, which I use when traveling light!
My latest laptop, and the focus of todays’ blog is the 13.8″ Surface Laptop 7. This is the latest generation of Copilot+ PCs. It is powered by the latest Qualcomm Snapdragon X Elite Arm processor and it truly a thing of beauty!
Not only does Surface Laptop 7 look absolutely gorgeous, with its premium sleek black finish, but the ‘instant on’ feature and Windows Hello ESS (which stands for Enhanced Sign-in Security) means that I am signed in instantly – no delay, and no “looking for you”. You click the button; the device wakes up and you are in.
Windows Hello ESS uses specialized hardware and software components, including Virtualization Based Security (VBS) and Trusted Platform Module 2.0 (TPM 2.0), to isolate and protect biometric data. This ensures that biometric data, like facial recognition or fingerprint information, is securely stored and processed
What are Copilot+ PCs?
The Qualcomm Snapdragon powered Copilot+ PC is designed to deliver an unparalleled user experience, combining cutting-edge technology with seamless performance and truly all day battery life combined with whisper quiet operation. These are powered by Qualcomm Snapdragon Plus and Elite processors (Arm processors) and run Windows on ARM as the core Windows Operating System.
Windows has traditionally run on machines that are powered by x86 / x64 processors, but more recently, also runs on devices powered by Arm processors. That is the case for the current generation of Copilot+PCs like Laptop 7 and Surface Pro 11.
Arm-powered devices are particularly interesting because the power-frugal nature of the Arm architecture enables these devices to offer longer battery life while delivering great performance. Arm Systems on Chip (SoC) often include other key features such as a powerful CPU, GPU, Wi-Fi & mobile data networks, as well as Neural Processor Units (NPUs) for accelerating AI workloads.
For most users, the differences between Windows on Arm and Windows running in x86/x64 are invisible other than the performance and efficiency improvements Arm based devices can bring to Windows.
The Laptop 7 I have been using is the 13.8 inch device with 32GB RAM and 1TB SSD.
Surface Laptop 7: The Out of Box Experience
From the moment I unboxed the device it gleamed with the high quality, premium elegance that is Surface. People often ask me what it is about Surface that I love compared to “other” brands.
Surface Laptop 7 Copilot+ PC
You only have to hold and feel a Surface to fall in love with it. It is truly elegant and premium device in every way, but more importantly, Surface is designed to showcase the very best of the Windows and is always the innovator and leader upon which other OEMs are “inspired” to copy. From touch screen, 2-in-1,to pen and ink and Windows Hello, these features were all born with Surface. Copilot+ PCs are no different. The stage is set for the future of AI powered devices.
Next there is the sustainability factor. Surface is built from more recycled materials with the enclosure being constructed of >67.2% recycled materials, including 100% recycled aluminum. Surface Laptop is another step toward Microsoft’s goal to be carbon negative, water positive, and achieve zero waste by 2030.
Surface Laptop 7: What’s under the hood?
This is a Surface through and through. High Quality, premium finish, and fantastically put together with the all the best hardware to make Windows shine.
Horse Power – Unlike the Surface Laptop 1-6, Laptop 7 is powered by ARM processors. Microsoft offer a choice of Snapdragon X Plus (10-core) or Snapdragon X Elite (12-core). The 15-inch version by comparison only offers the Snapdragon X Elite.
Connectivity: Surface Laptop 7 ships with the latest Wi-Fi 7 and Bluetooth 5.4, along with two USB-C Thunderbolt 4 ports, and and “old-skool” USB-A. There’s also a 3.5mm headset jack, a microSDXC card slot, and the standard Surface-Connect Port too! The device can be charged via the Surface Port and/or USB-C.
Cameras and Video: The “web-cam2 is a 1080p Full HD camera for your Teams or Webex calls and also incorporates the Windows Hello Biometric / Facial security. Video and images are enhanced by Windows Studio Effects powered by the Surface Laptop 7’s local NPU.
Audio: On board we get the usual Dual Studio Mics with AI powered voice focus, OmniSonic stereo speakers with Dolby Atmos® and support for Bluetooth LE Audio
Display – The screen on the 13.8″ Surface Laptop 7 supports a resolution of 2304 x 1536 with contrast ratio of 1400:1 and refresh rate of 120Hz. The screen is fully multi-point touch enabled and is finished with a coating of Corning’s Gorilla Glass 5. The is no Surface Pen support (but to be honest, the form factor doesn’t really lend itself to pen and ink).
Keyboard: Surface Laptop gives you a full size keyboard. The is plenty of travel in the keys and decent traction. The keys also have back-lighting with different levels of brightness. You also get a sizeable trackpad. You even get the Copilot Key 🙂
Surface Laptop 7: Secure from Chip to Cloud
Surface Laptop 7 (along with Surface Pro 11), powered by Qualcomm Snapdragon, are also examples of Microsoft’s commitment to robust security through their chip-to-cloud approach.
Central to this security architecture is the Microsoft Pluton TPM 2.0, which provides a hardware-based root of trust, ensuring that sensitive data, such as encryption keys and user credentials, are securely stored and protected from tampering. This is complemented by Windows 11’s Secured-Core PC capabilities, which integrate hardware, firmware, and software protections to defend against sophisticated cyber threats and attacks.
Additionally, these devices feature Windows Hello face authentication with Enhanced Sign-in Security, offering seamless and secure biometric authentication. This leverages advanced facial recognition algorithms and hardware-level security to provide a fast and secure login experience.
Finally, Microsoft Defender is fully integrated at hardware and Operating System level to provide comprehensive enterprise protection against malware, viruses, and other cyber threats, further enhancing identity and privacy protection.
These features make Surface Laptop 7 and Surface Pro 11 secure, reliable choices for users and organisations who need the highest levels of protection for their data and privacy.
App Support – Will my Apps Work with ARM?
In short yes (almost certainly).
Application compatibility with Windows on Arm has always been a concern and I have seen many people, and organisations avoid “non Intel” Windows devices for fear their app will not work.
Outside the original Surface RT, I have been using ARM based Surface devices since the Surface Pro X. Today, I am yet to encountered any apps that do not work on my ARM powered devices. Every applications I use (including some from Adobe) now have native ARM versions of their apps.
Prism Emulation works as a software simulator, just-in-time compiling blocks of x86 instructions into Arm64 instructions with optimisations to improve performance of the emitted Arm64 code.
For any app you encounter for where there is not an ARM-native app, Windows 11 leverages Microsoft’s PRISM emulator. This provides x86 and x64 emulation to run non-ARM native apps in emulation mode, which the Surface Laptop 7 runs perfectly well. The benefit of using (and having) native ARM applications however is to allow users to fully benefit from the power and battery efficiency that these devices offer over the intel variants.
Microsoft App Assure is a service designed to help organisations ensure their applications run smoothly on Windows 11, including those on ARM-based devices. With App Assure, Microsoft offers expert support to resolve any compatibility issues, providing peace of mind when transitioning or updating applications to run on ARM architecture. This support is crucial for organisations embracing the efficiency and performance benefits of Windows on ARM.
Printers and Peripherals – will they work on ARM?
In short – most will.
When considering a transition to Windows on ARM devices, one of the primary concerns is whether printers and other peripherals will work seamlessly. Personally I have no issues at all. I use a Surface Dock, blue tooth keyboard and mouse, USB external webcam and an Epson Ink Jet Printer. Most modern peripherals will work without issues.
Printers (well older ones) can be a little more challenging due to lack of driver support, but Microsoft is actively working to improve this by developing more ‘Class drivers’ for legacy hardware.
Whilst the situation is improving, organisations with older or specialised hardware (we see a lot in education and manufacturing) may find they need to still with Intel variants for now, or at least check compatibility before moving to Windows on ARM.
Microsoft's approach of replacing legacy drivers with "class drivers" is part of their broader strategy to simplify and standardise driver support across Windows devices, including ARM-based systems. Class drivers are intermediate drivers that provide a simple interface between a vendor-written "minidriver" and the Windows operating system. This means that instead of each hardware manufacturer creating and maintaining their own drivers, they can use a standardised class driver provided by Microsoft.
Better Together – Windows 11 and Copilot+PCs
Windows 24H2 (along with some new Windows features that are currently in Preview) are set to revolutionise the user experience with a suite of new AI-powered tools designed to enhance productivity and streamline tasks.
Among the most anticipated features is Windows Recall, which allows users to search for files, emails, and web pages by describing what they remember, rather than relying on keywords. This feature, powered by multiple AI models running locally on the device, aims to significantly reduce the time spent searching for information.
Windows Recall (Preview)
Click to Do enables quick actions with text or images found in Recall’s snapshots (or from any screen), making it easier to copy text or share images. This is similar to Google Circle-To-Do feature you might have on your smart phone!
Another exciting addition is the Windows Copilot Runtime, which integrates over 40 different AI models, including a Small Language Model (SLM) and an Optical Character Recogniser. These enable the new tools like Click-To-Do along with new Windows features such as Live Captions, Auto Super Resolution, Generative Fill and Windows Studio Effects.
These all work locally (using the NPU) without sending data to the cloud. These tools not only enhance accessibility and visual quality but also provide a seamless and efficient user experience.
This prevents the CPU getting overloaded and slowing down your device, making things like Teams call with video filters applied, much less processor intensive and better quality.
Surface Laptop 7: Value for Money
Pricing of course varies by region and also your sector. It also varies if you are a consumer or corporate, so if buying for work, speak to you Microsoft Surface Partner.
On Microsoft’s official website, pricing for Surface Laptop 7 starts at £944 (inc VAT).
The model I am using is the 13.8″, Snagdragon X Elite with 32GB RAM and 1TB SSD which took the price up to just over £1,500.
In comparison (everyone always compares to Apple), the cost of the Mac Book Pro 14″ of close to equivalent spec is just shy of £2,000
Surface Laptop 7 – Summing it up
In the past few weeks, using Surface Laptop 7 has really enforced my love and passion for Surface and Windows on Arm powered devices and the future potential of Copilot+PCs.
Compared to a Intel Powered Surface Laptop 6, everything about this device feels faster and more responsive compared to any previous device (even my ARM powered Surface Pro 9) that I have used.
The device is lightening fast, silent (like it makes no noise at all) as it has no fans, and battery life averages over 17 hours of actual use between charges (and that is connected to an external screen too). I never take power supply when I go out.
The device wakes up and signs me in instantly when I lift the lid, thanks to Windows Hello ESS and when working, the device doesnt even apprear to get warm.
Video and Audfio Quality is enhanced by the new Windows Studio Effects in Windows 11, which leverages the NPU for superior audio quality and voice isolation and features like Eye Contact and local background blurring has a huge impact on video calls.
The new and exciting AI features like Microsoft Recall and Click- to-Do (in preview), along with the other Windows 11 enhancements are also great to use (these only run on Copilot+PCs today).
If you are not a fan of PWA (progressive web apps), the Microsoft is bringing good news. Windows Insiders are getting a new version of the Copilot app for Windows 10 and 11 which replaces the web-based application with a new native version.
The old app (or current app if you are not a Windows Insider) is a Progressive Web App which limits some of the Windows control such as quick view that is available in native Windows Apps. recently ChatGPT published their Windows App into the Microsoft Store and this latest update from Microsoft now makes the Copilot a real app too!
With this update, the previous Copilot progressive web app (PWA) is replaced with a native version. After installing the Copilot app update, when you run Copilot, you will see it appear in your system tray.
Microsoft Windows Insider Team
Whilst it’s hard to notice immediately differences, after installing the updated version (1.24112.123.0) Copilot on Windows is now a “proper” app rather than a WebApp.
This also means that Quick View can be used now with Copilot which lets you move the quick view window and resize it to suit your workflow. By default, the Copilot app in Windows uses the RegisterHotKey function and sets Alt + Space keyboard shortcut to open Copilot in Quick View mode which can be used to open and close Copilot’s quick view whenever you need it.
If you need to switch / flip back to the main Copilot app window, then this can be done by clicking the icon at the top left corner of the quick view window.
Devices with the dedicated Copilot key will open the Copilot app up the main window.
Microsoft has recently expanded the testing of its innovative Recall AI feature to Intel- and AMD-powered AI and Copilot Plus PCs. Initially available on Qualcomm-powered devices only, this feature is now accessible to a broader range of devices for testing.
Initially recalled due to privacy concerns this is now in Public Preview for Windows Insiders on the Dev Channel.
Recall works by taking screenshots of almost everything you do on your Copilot+ PC, (these are devices with dedicated NPUs that run at 45 Trillion Operations per Second (TOPS) or more). Recall makes it easy to search and recall past activities such as “the train route I was looking at on Tuesday” rather then scanning back through Internet search history.
Recall on Copilot+ PCs
This feature is entirely optional to use, but when enabled enabled, helps users find previous work, content or Internet data through natural language search or an interactive scrollable timeline.
As the user, you are completely in control of what snapshots are saved and how long for, and have the ability to delete them as needed, ensuring upmost privacy and security. Snaps shots require TPM, secure boot and Windows Hello to be active on the device and Microsoft has not access to the data which is encrypted on your device.
The power of Edge AI
Unlike services like Copilot, Recall and many of the newer Copilot+ PC features leverage local LLM models on the device as well as the NPU’s present on Copilot+ PC devices like the Surface Laptop 7 and Pro 11 range. As such when you install the #WindowsInsider Dev builds, you’ll also notice that Windows Updates installs a number of processing services as well as the Phi Silica LLM.
Recalls’ enhanced security and privacy
Microsoft has implemented many new security updates and controls to address initial concerns raised by security folk and early testers.
As I mentioned, accessing snapshots now requires Windows Hello for authentication, and the feature mandates the use of BitLocker and Secure Boot. Additionally, Recall can now automatically detects and excludes sensitive information like credit card details and passwords from being saved.
Click-to-Do and more AI features
Alongside Recall, Microsoft is also allowing Insiders on Copilot+ PCs to test out Click to Do feature, which recognise text and images in snapshots and content in screen allowing users to perform actions like copying text, invoking Copilot, saving and editing images and more. This functionality extends beyond Recall, enabling users to take actions on images and text with a simple Windows + Q key or Windows Key + mouse click.
In Paint, the new Cocreator top lets you create art and images by simply typing in text prompts. The Photos app has also been updated with new tools including Image Creator, which lets users make images from text prompts, and Restyle Image, which lets users add different artistic styles to their existing photos. You also get powerful generative erase tools which can be accessed directly from the app or from Click-To-Do.
These tools use local AI and analysis models on the Copilot+ PCs to work efficiently on the device itself through the use of the NPU.
Conclusion
Microsoft initially only made these features available for Snapdragon (ARM based) Copilot+ PCs but with this update they are continuing to u lease the new AI features in Windows 11 to more devices. The expansion of Recall to Intel and AMD Copilot+ PCs marks a step forward in enhancing user experience and productivity on this next generarion of devices.
