Posts

Posted on

The Future of AI Agents and shift to Agentic AI

Image of Satya Nadella

In a recent podcast episode with Bill Gurley and Brad Gerstner, Satya Nadella – CEO of Microsoft, discussed a wide range of topics related to his role at Microsoft, the state of the technology, business growth and capitalism in this new “AI Era”.

The podcast which you can watch on YouTube here covered some interesting topics including the Future of AI Agents and their potential to transform how we interact with technology. In this blog (worth a listen), Satya gives his predications/insights into the future of AI Agents and emphasises that AI agents will fundamentally change the landscape of software-as-a-service (SaaS) solutions, predicting that the traditional notion of business applications will collapse in the era of agentic AI.

What is Agentic AI?

Agentic AI refers to artificial intelligence systems that can make decisions and take actions autonomously, without direct human intervention. These systems are designed to perceive their environment, reason about the best course of action, and execute tasks independently. In short these agents are designed to function as workplace teammates, capable of handling various tasks across different applications.

As example, in e-commerce platforms, instead of static, rule based chatbots, agentic AI-driven systems can track a customer’s journey, personalised recommendations, and assist with returns seamlessly without user / supervisor input. These agents will be able to actively learn from interactions, optimising the customer journey in real time and learning about user preferences.

Agentic AI typically inhibits the following features:

  • Autonomy: Agentic AI systems can operate independently, making decisions based on input data and predefined goals.
  • Adaptability: These systems can adapt to changing circumstances and inputs, adjusting their actions to achieve their objectives.
  • Proactivity: Agentic AI can anticipate user needs and take actions without explicit instructions, making them more proactive in their behavior.
  • Collaboration: In the future, agentic AI systems will be able to work together in multi-agent networks, collaborating to handle complex tasks that a single agent cannot manage alone.

Changes Ahead for AI Agents

The video / podcast is an hour and a half (but an enjoyable and informative listen). Reading between the sections, Satya talks extensively about where he sees AI Agents evolving massively through 2025. I have summarised this below.

Increasing Sophistication and Capabilities

AI agents will become increasingly sophisticated and capable, eventually replacing traditional software applications. These agents will be able to understand and anticipate user needs, providing personalised and proactive assistance. They will leverage advanced natural language processing (NLP) and machine learning algorithms to interact with users in a more human-like manner.

Autonomous AI Agents

Through 2025. we will see autonomous AI agents handle more and more complex tasks with minimal human oversight, optimising workflows and enhancing efficiency across industries. These agents will streamline workflows, manage intricate operations, and simplify everyday activities. For example, OpenAI’s “Operator Agents” will autonomously execute multi-step processes, such as scheduling meetings or managing projects.

Multi-Agent Networks

Sayta talks abiut the “future” being a place that is not about singular agents but more about networks or systems of agents where agents can discover and collaborate with other agents. These multi-agent networks will enable agents to handle tasks that they can’t do themselves by invoking other agents (agents talking to other agents). This collaborative approach will enhance the overall capabilities and efficiency of AI agents.

Vertical AI Agents

Vertical AI agents, which are specialised for specific industries, are expected to have their moment in 2025. These agents will dominate their respective fields by offering tailored solutions that address industry-specific challenges. For example, retail AI agents will act as personal shoppers, offering personalised recommendations and optimising inventory management.

Persistent Memory and Personalisation

AI systems with persistent memory will enable highly personalized interactions, transforming AI into long-term companions that adapt to user preferences and habits. This capability will allow AI agents to provide more relevant and context-aware assistance, enhancing user experiences.

Emotional Intelligence

Future AI agents are expected to possess emotional intelligence, allowing them to understand and respond to human emotions. This will enable more empathetic and effective interactions, particularly in customer service and healthcare settings.

Integration with IoT and Personal Devices

AI agents will increasingly integrate with the Internet of Things (IoT) and personal devices. This integration will enable seamless interactions across various platforms and devices, creating a more connected and efficient ecosystem. For example, AI agents in smart homes will manage household tasks, monitor energy usage, and provide personalized recommendations.

Ethical AI and Transparency

As AI agents become more prevalent, there will be a greater emphasis on ethical AI and transparency in decision-making. Ensuring that AI agents operate responsibly and transparently will be crucial for gaining user trust and acceptance. This includes addressing issues related to data privacy, bias, and accountability.

Proactive AI Agents

Proactive AI agents will anticipate user needs and take actions without explicit instructions. For example, an AI assistant might reorganize your day based on traffic updates and weather, reschedule missed appointments, and even draft personalized messages. This proactive approach will make AI agents more valuable and indispensable in daily life.

Enhanced Communication and Collaboration Tools

AI agents will enhance communication and collaboration tools, making it easier for teams to work together. These agents will facilitate real-time collaboration, manage project timelines, and provide insights to improve productivity. They will also assist in content creation, research, and workflow automation.

Shift and the of SaaS apps?

Another interesting section to listen too is at around 31 minutes, where Satya talks about his vision of how AI agents could potentially replace traditional SaaS (Software as a Service) applications. Whilst something that will not happen over night, he talked about the shift from business apps with connectors into other apps, but in an agent to agent and agent to back-end system.

We can already have connectors into applications like SAP, Dynamics etc. A great quote he used was “when was the last time any of us really went to a business application” In the AI age, we access the data in these systems from a mesh of data sources which over time, these back-end SaaS systems would eventually become obsolete as AI agents take over multi-repository CRUD (Create, Read, Update, Delete) operations. This shift would lead to the collapse of conventional business applications, with AI agents handling the core logic.

The idea will be that you simply pull information from systems through AI Agents such as looking up customer details, updating inventories, changing a contact in NetSuite CRM for example or checking delivery status for an order.

Other examples, Sayta talked about with regards AI Agents included:

Infinite Memory: He explained that infinite memory refers to the ability of AI agents to retain and recall information over extended periods, much like a human’s long-term memory. This capability will allows AI agents to build on past interactions and experiences, making them more effective and personalized in their responses and actions.

Proactive Task Management: AI agents are envisioned to operate autonomously, handling complex tasks such as processing customer returns, managing shipping invoices, and optimizing supply chain operations. This proactive approach reduces the reliance on user-initiated interactions, further diminishing the need for traditional SaaS applications.

Automation of Business Logic: Satya explained that AI agents would be able to automate many backend business processes, creating a new tier of multi-agent orchestration. This means that business logic, which is currently hardcoded into individual applications, will be managed by AI agents across multiple apps or databases and will adapt based on useage and need.

Integration with Existing Tools: Nadella highlighted the integration of Python with Excel as an example. AI agents can use Excel’s visualisation capabilities for advanced tasks, transforming it into a more intelligent and autonomous tool. This integration demonstrates how AI agents can enhance existing applications, making them more efficient and reducing the need for traditional SaaS apps.

Posted on

My 2024 year in Blogs Recap

This blog takes a stroll back down the 2024 memory lane and looks at some of the highlights I have seen through 2024 from a technology (I fo.cus here mainly on Cisco and Microsoft) and what we achived at Cisilion – where I’m the CTO. We are sarting with January and working thriugh to December 2024.

January 2024

February 2024

  • Cisilion opened our new corporate brand and also opened our new Client Experience Centre. Technological Innovation and Personalised Engagement in the Era of Digital Collaboration – News & Blog – Cisilion. This included new logo, new corporate values and a new website https://www.cisilion.com. We reimaged our values of Trust, Excellence and Agility and are embedding these across all we do.
  • Cisilion were also crowned one of 17 partners in the UK as Microsoft Cyber Security Investment Partner due to our exemplar work in helping organisations leverage the best of Microsoft Threat Protection, Identity and Access Control and Data Protection.
  • Cisco Live 2024 saw over 16,000 people – the largest in person attendance in more than 6 years. The theme was very much aligned with the industry buzz and innovation around AI with Cisco emphatic statement “there is no AI without a network”. This was very much the theme and focussed on Cisco’s innovations and vision around the network and Data Centre fabric for the AI era that is among us. 

Mar 2024

  • Cisco completed the acquisition of Splunk which they acquired in November 2023 for $28billion.Cisco say that the combination of Cisco and Splunk will provide truly comprehensive visibility and insights across an organization’s entire digital footprint, delivering an unprecedented level of resilience through the most extensive and powerful security and observability product portfolio on the market.
  • Microsoft Security Copilot goes Generally Available: and is priced on PAYG basis. Microsoft’s Copilot for Security available April 1st – Modern Work and AI Blog
Cisco and Splunk

April 2024

  • Cloud Security: Cisco Announces Cisco Hypershield . Not planned for release until sometime in 2025, Hypershield is different to traditional security products and is integrated directly into the network’s fabric, offering a revolutionary approach to protecting digital infrastructure services in data centres, protecting applications, devices, and data across public and private data centers, clouds, and physical locations.Cisco Hypershield: New Era of Distributed, AI-Native Security

May 2024

  • The AI Powered PC: Microsoft announce the next generation of Computing with the Copilot+ PC, built in partnership with Qualcomm. At the heart of the Copilot+ PCs lies groundbreaking ARM CPU and NPU technology, capable of over 45 trillion operations per second, powering a new era of AI experiences on Windows PCs. They are designed to run AI workloads with unprecedented efficiency and speed, outperforming competitors and enabling features like Recall, Cocreator, and Live Captions. These will power the next wave of edge AI. https://robquickenden.blog/2024/05/sufacepro11-laptop7/
Copilot+ PC

June 2024

July 2024

News: Global Outage

  • CrowdStrike update bug causes global IT outages as update bricks Windows devices and costs the economy big time with flights grounded and huge disruption everywhere.

How did CrowdStrike causes Windows Screen Recovery loop on millions of Windows devices

Cyber Security

Fun and creativity

August 2024

September 2024

News: Cyber Security

Security:

Customer Success:

October 2024

Work

November 2024

December 2024

Accreditations:

Happy and prosperous 2025

I’d finally like to thank all my followers and subscribers a very happy new year!

Posted on

Windows 11: Using your camera in multiple apps simultaneously

Windows 11 is set to make a huge change to how we use cameras and webcams on Windows 11 PCs with the introduction of advanced camera features. These new functionalities, currently available in the Windows 11 Insider Preview Build in the Dev Channel, promise to enhance accessibility and usability for a wide range of users.

Previously, Windows allowed camera access to only one application at a time, which caused conflicts and limited multitasking capabilities. With this new feature, multiple applications can now access and utilise the camera feed simultaneously.

Key Features and Benefits

  • Multi-App Camera Support: One of the standout features is the ability for multiple applications to be able to access your devices camera/webcam at the same time. This is particularly beneficial for people who need to stream video to different platforms at the same time. For instance, remote workers can now participate in multiple virtual meetings without needing to switch between applications (and turn off their cameras), and in the consumer space, gamers can stream their gameplay on various platforms concurrently.
  • Basic Camera Function: Designed to improve stability of “older” webcams and deices and to help with debugging, Microsoft are introducing a feature limiting the webcam’s features to the essentials. This ensures that the camera can operate at its most basic level, which is useful if other features are causing issues.
  • Enhanced Accessibility: Developed in conjunction with accessibility and hard-of-hearing community, the multi-app support feature also enables video streaming to both a sign language interpreter and the end audience simultaneously. This could be a significant step forward in making technology more inclusive and accessible.

Use Cases

  • Remote Work and Collaboration: With the multi-app camera support, professionals working from home can join multiple video conferences at once, making it easier to manage different meetings and collaborations without the hassle of switching between apps.
  • Content Creation and Streaming: Gamers and content creators will find the new features particularly useful. They can now stream their content on multiple platforms simultaneously, reaching a broader audience and enhancing their streaming capabilities.
  • Educational Purposes: Teachers and educators can leverage these features to conduct virtual classes more effectively. For example, they can stream their lessons to different platforms or groups of students at the same time, ensuring that everyone has access to the content.

Enabling and using the Feature

You need to be running Windows Insider Build 26120.2702 or later.

To activate the feature, users need to head over to settings and enable the “Multi-App Camera” setting by toggling it on as shown in the screenshot below.

Advanced Camera Controls in Windows 11

Once enabled you’ll be able to use your camera(s) in multiple apps. The shot below shows the camera app and a Teams video call using the same camera simultenuously.

Still more to come

Microsoft has also said that more options are coming in the advanced camera settings, including the ability to choose and customise things like resolution and frame rate for the webcam/Camera(s).

These enhancements (also fed by user feedback from the Windows Feedback Hub), will provide users with greater control over their camera settings, allowing for a more customised and optimised experience.

Posted on

Microsoft Surface Laptop 7  Review

In this review I look at the Surface Laptop 7 which I’ve been using daily for the past 3 weeks. We look at ascetics, performance, battery life and more. It’s the first Copilot+PC from Microsoft which is set to yet again set the standards on the future of AI powered Windows devices!

I first got my hands on one of these devices last month at Microsoft Ignite 2024 in Chicago, where I had the pleasure to spend time with the global Surface Team in the community hub in the middle of the Ignite Expo Hall.

On show were the very latest Surface Copilot + PCs which feature the Qualcomm Snapdragon X powered devices that deliver over 45 Trillion Operations per Second (TOPS) of NPU power.

As part of the demo showcase, the devices were running the latest “insider” builds of Windows 11 where new innovative AI features within Windows, such as Recall and Click-To-Do, as well as updates to apps from leading developers including Adobe who were showcasing the next wave of innovation that is possible by harnessing the power of local NPUs on these new Copilot + PCs.

My History with Surface

I’ve been a fan of Surface many years, having owned, borrowed, or used numerous models since we transitioned to Surface around the Surface Pro 4 era. I even had a Surface Pro v1 and a Surface RT with Arm chipset running Windows 8 back in 2012 – devices I still have today in my “museum”.

As a Microsoft MVP, I’m also lucky to get access to demo and trial devices through the year which has given me some great perspectives of the continual evolution, advancements and innovation that Surface brings, not only to end user compute, but to the development and innovation of Windows.

Until recently, my daily device has been the Surface Pro 9 5G. This is a Qualcomm powered ARM device running Windows on Arm (WoA). I also have a smaller (Intel powered) Laptop Go, which I use when traveling light!

My latest laptop, and the focus of todays’ blog is the 13.8″ Surface Laptop 7. This is the latest generation of Copilot+ PCs. It is powered by the latest Qualcomm Snapdragon X Elite Arm processor and it truly a thing of beauty!

Not only does Surface Laptop 7 look absolutely gorgeous, with its premium sleek black finish, but the ‘instant on’ feature and Windows Hello ESS (which stands for Enhanced Sign-in Security) means that I am signed in instantly – no delay, and no “looking for you”. You click the button; the device wakes up and you are in.

Windows Hello ESS uses specialized hardware and software components, including Virtualization Based Security (VBS) and Trusted Platform Module 2.0 (TPM 2.0), to isolate and protect biometric data. This ensures that biometric data, like facial recognition or fingerprint information, is securely stored and processed

What are Copilot+ PCs?

The Qualcomm Snapdragon powered Copilot+ PC is designed to deliver an unparalleled user experience, combining cutting-edge technology with seamless performance and truly all day battery life combined with whisper quiet operation. These are powered by Qualcomm Snapdragon Plus and Elite processors (Arm processors) and run Windows on ARM as the core Windows Operating System.

Windows has traditionally run on machines that are powered by x86 / x64 processors, but more recently, also runs on devices powered by Arm processors. That is the case for the current generation of Copilot+PCs like Laptop 7 and Surface Pro 11.

Arm-powered devices are particularly interesting because the power-frugal nature of the Arm architecture enables these devices to offer longer battery life while delivering great performance. Arm Systems on Chip (SoC) often include other key features such as a powerful CPU, GPU, Wi-Fi & mobile data networks, as well as Neural Processor Units (NPUs) for accelerating AI workloads.

For most users, the differences between Windows on Arm and Windows running in x86/x64 are invisible other than the performance and efficiency improvements Arm based devices can bring to Windows.

The Laptop 7 I have been using is the 13.8 inch device with 32GB RAM and 1TB SSD.

Surface Laptop 7: The Out of Box Experience

From the moment I unboxed the device it gleamed with the high quality, premium elegance that is Surface. People often ask me what it is about Surface that I love compared to “other” brands.

Surface Laptop 7 Copilot+ PC

You only have to hold and feel a Surface to fall in love with it. It is truly elegant and premium device in every way, but more importantly, Surface is designed to showcase the very best of the Windows and is always the innovator and leader upon which other OEMs are “inspired” to copy. From touch screen, 2-in-1,to pen and ink and Windows Hello, these features were all born with Surface. Copilot+ PCs are no different. The stage is set for the future of AI powered devices.

Next there is the sustainability factor. Surface is built from more recycled materials with the enclosure being constructed of >67.2% recycled materials, including 100% recycled aluminum. Surface Laptop is another step toward Microsoft’s goal to be carbon negative, water positive, and achieve zero waste by 2030.

Surface Laptop 7: What’s under the hood?

This is a Surface through and through. High Quality, premium finish, and fantastically put together with the all the best hardware to make Windows shine.

  • Horse Power – Unlike the Surface Laptop 1-6, Laptop 7 is powered by ARM processors. Microsoft offer a choice of Snapdragon X Plus (10-core) or Snapdragon X Elite (12-core). The 15-inch version by comparison only offers the Snapdragon X Elite.
  • Connectivity: Surface Laptop 7 ships with the latest Wi-Fi 7 and Bluetooth 5.4, along with two USB-C Thunderbolt 4 ports, and and “old-skool” USB-A. There’s also a 3.5mm headset jack, a microSDXC card slot, and the standard Surface-Connect Port too! The device can be charged via the Surface Port and/or USB-C.
  • Cameras and Video: The “web-cam2 is a 1080p Full HD camera for your Teams or Webex calls and also incorporates the Windows Hello Biometric / Facial security. Video and images are enhanced by Windows Studio Effects powered by the Surface Laptop 7’s local NPU.
  • Audio: On board we get the usual Dual Studio Mics with AI powered voice focus, OmniSonic stereo speakers with Dolby Atmos® and support for Bluetooth LE Audio
  • Display – The screen on the 13.8″ Surface Laptop 7 supports a resolution of 2304 x 1536 with contrast ratio of 1400:1 and refresh rate of 120Hz. The screen is fully multi-point touch enabled and is finished with a coating of Corning’s Gorilla Glass 5. The is no Surface Pen support (but to be honest, the form factor doesn’t really lend itself to pen and ink).
  • Keyboard: Surface Laptop gives you a full size keyboard. The is plenty of travel in the keys and decent traction. The keys also have back-lighting with different levels of brightness. You also get a sizeable trackpad. You even get the Copilot Key 🙂

Surface Laptop 7: Secure from Chip to Cloud

Surface Laptop 7 (along with Surface Pro 11), powered by Qualcomm Snapdragon, are also examples of Microsoft’s commitment to robust security through their chip-to-cloud approach.

Central to this security architecture is the Microsoft Pluton TPM 2.0, which provides a hardware-based root of trust, ensuring that sensitive data, such as encryption keys and user credentials, are securely stored and protected from tampering. This is complemented by Windows 11’s Secured-Core PC capabilities, which integrate hardware, firmware, and software protections to defend against sophisticated cyber threats and attacks.

Additionally, these devices feature Windows Hello face authentication with Enhanced Sign-in Security, offering seamless and secure biometric authentication. This leverages advanced facial recognition algorithms and hardware-level security to provide a fast and secure login experience.

Finally, Microsoft Defender is fully integrated at hardware and Operating System level to provide comprehensive enterprise protection against malware, viruses, and other cyber threats, further enhancing identity and privacy protection.

These features make Surface Laptop 7 and Surface Pro 11 secure, reliable choices for users and organisations who need the highest levels of protection for their data and privacy.

App Support – Will my Apps Work with ARM?

In short yes (almost certainly).

Application compatibility with Windows on Arm has always been a concern and I have seen many people, and organisations avoid “non Intel” Windows devices for fear their app will not work.

Outside the original Surface RT, I have been using ARM based Surface devices since the Surface Pro X. Today, I am yet to encountered any apps that do not work on my ARM powered devices. Every applications I use (including some from Adobe) now have native ARM versions of their apps. 

Prism Emulation works as a software simulator, just-in-time compiling blocks of x86 instructions into Arm64 instructions with optimisations to improve performance of the emitted Arm64 code.

For any app you encounter for where there is not an ARM-native app, Windows 11 leverages Microsoft’s PRISM emulator. This provides x86 and x64 emulation to run non-ARM native apps in emulation mode, which the Surface Laptop 7 runs perfectly well. The benefit of using (and having) native ARM applications however is to allow users to fully benefit from the power and battery efficiency that these devices offer over the intel variants.

Microsoft App Assure is a service designed to help organisations ensure their applications run smoothly on Windows 11, including those on ARM-based devices. With App Assure, Microsoft offers expert support to resolve any compatibility issues, providing peace of mind when transitioning or updating applications to run on ARM architecture. This support is crucial for organisations embracing the efficiency and performance benefits of Windows on ARM.

Printers and Peripherals – will they work on ARM?

In short – most will.

When considering a transition to Windows on ARM devices, one of the primary concerns is whether printers and other peripherals will work seamlessly. Personally I have no issues at all. I use a Surface Dock, blue tooth keyboard and mouse, USB external webcam and an Epson Ink Jet Printer. Most modern peripherals will work without issues.

Printers (well older ones) can be a little more challenging due to lack of driver support, but Microsoft is actively working to improve this by developing more ‘Class drivers’ for legacy hardware.

Whilst the situation is improving, organisations with older or specialised hardware (we see a lot in education and manufacturing) may find they need to still with Intel variants for now, or at least check compatibility before moving to Windows on ARM. 

Microsoft's approach of replacing legacy drivers with "class drivers" is part of their broader strategy to simplify and standardise driver support across Windows devices, including ARM-based systems. Class drivers are intermediate drivers that provide a simple interface between a vendor-written "minidriver" and the Windows operating system. This means that instead of each hardware manufacturer creating and maintaining their own drivers, they can use a standardised class driver provided by Microsoft.

Better Together – Windows 11 and Copilot+PCs

Windows 24H2 (along with some new Windows features that are currently in Preview) are set to revolutionise the user experience with a suite of new AI-powered tools designed to enhance productivity and streamline tasks.

Among the most anticipated features is Windows Recall, which allows users to search for files, emails, and web pages by describing what they remember, rather than relying on keywords. This feature, powered by multiple AI models running locally on the device, aims to significantly reduce the time spent searching for information.

Windows Recall (Preview)

Click to Do enables quick actions with text or images found in Recall’s snapshots (or from any screen), making it easier to copy text or share images. This is similar to Google Circle-To-Do feature you might have on your smart phone!

Another exciting addition is the Windows Copilot Runtime, which integrates over 40 different AI models, including a Small Language Model (SLM) and an Optical Character Recogniser. These enable the new tools like Click-To-Do along with new Windows features such as Live Captions, Auto Super Resolution, Generative Fill and Windows Studio Effects.

These all work locally (using the NPU) without sending data to the cloud. These tools not only enhance accessibility and visual quality but also provide a seamless and efficient user experience.

This prevents the CPU getting overloaded and slowing down your device, making things like Teams call with video filters applied, much less processor intensive and better quality.

Surface Laptop 7: Value for Money

Pricing of course varies by region and also your sector. It also varies if you are a consumer or corporate, so if buying for work, speak to you Microsoft Surface Partner.

On Microsoft’s official website, pricing for Surface Laptop 7 starts at £944 (inc VAT).

The model I am using is the 13.8″, Snagdragon X Elite with 32GB RAM and 1TB SSD which took the price up to just over £1,500.

In comparison (everyone always compares to Apple), the cost of the Mac Book Pro 14″ of close to equivalent spec is just shy of £2,000

Surface Laptop 7 – Summing it up

In the past few weeks, using Surface Laptop 7 has really enforced my love and passion for Surface and Windows on Arm powered devices and the future potential of Copilot+PCs.

Compared to a Intel Powered Surface Laptop 6, everything about this device feels faster and more responsive compared to any previous device (even my ARM powered Surface Pro 9) that I have used.

The device is lightening fast, silent (like it makes no noise at all) as it has no fans, and battery life averages over 17 hours of actual use between charges (and that is connected to an external screen too). I never take power supply when I go out.

The device wakes up and signs me in instantly when I lift the lid, thanks to Windows Hello ESS and when working, the device doesnt even apprear to get warm.

Video and Audfio Quality is enhanced by the new Windows Studio Effects in Windows 11, which leverages the NPU for superior audio quality and voice isolation and features like Eye Contact and local background blurring has a huge impact on video calls.

The new and exciting AI features like Microsoft Recall and Click- to-Do (in preview), along with the other Windows 11 enhancements are also great to use (these only run on Copilot+PCs today).

Posted on

The Windows Copilot app is now a “real” app

If you are not a fan of PWA (progressive web apps), the Microsoft is bringing good news. Windows Insiders are getting a new version of the Copilot app for Windows 10 and 11 which replaces the web-based application with a new native version.

The old app (or current app if you are not a Windows Insider) is a Progressive Web App which limits some of the Windows control such as quick view that is available in native Windows Apps. recently ChatGPT published their Windows App into the Microsoft Store and this latest update from Microsoft now makes the Copilot a real app too!

In the announcement, Microsoft said that

With this update, the previous Copilot progressive web app (PWA) is replaced with a native version. After installing the Copilot app update, when you run Copilot, you will see it appear in your system tray.

Microsoft Windows Insider Team

Whilst it’s hard to notice immediately differences, after installing the updated version (1.24112.123.0) Copilot on Windows is now a “proper” app rather than a WebApp.

This also means that Quick View can be used now with Copilot which lets you move the quick view window and resize it to suit your workflow. By default, the Copilot app in Windows uses the RegisterHotKey function and sets Alt + Space keyboard shortcut to open Copilot in Quick View mode which can be used to open and close Copilot’s quick view whenever you need it.

If you need to switch / flip back to the main Copilot app window, then this can be done by clicking the icon at the top left corner of the quick view window.

Devices with the dedicated Copilot key will open the Copilot app up the main window.

Posted on

Streamlining Copilot Adoption: Reducing Data Oversharing in Microsoft 365

One of the concerns I often talk to organisations about, is the fear that Copilot might surface sensitive information that it should not have access to due to IT/Compliance teams not really knowing who has access to what. The phrase “Security through obscurity” is often what we heard being used.

The primary cause of this is the over-permissioning and sharing of files, which is a growing concern for organisations and one of the “blockers” often cited in Copilot Adoption.

The over-sharing problem

The ability to reason over employee data and shared organisational data is one of Microsoft 365 Copilot’s strengths over other Gen AI tools (that need feeding). These responses Copilot gives and the content it creates rely on access to data that the user already has access to across their organisation’s Microsoft 365 environment. And here often lies the problem. If an organisation has low levels of data governance, no data classification and labelling, combined with high levels of over-sharing can create real concerns for IT and Data Compliance teams.

One of the reasons that Copilot often has access to data that it “perhaps” shouldn’t have is not due to security flaw or issue across Copilot or Microsoft 365, but because files or sites have been shared too widely and have no (or the wrong) privacy and sensitivity set. Addressing this is no small task since many organisations will have million of files and tens of thousands of SharePoint and Teams sites.

Organisations and even teams within organisations often operate at various levels of maturity in governing SharePoint data. While some orgaanisations strictly monitor permissions and oversharing of content, others do not. The situation is further complicated because many people, teams and organisations have “legitimate” reasons to share “some” data widely within the organisation. This can mean users in your organisation may make choices that result in the oversharing of SharePoint content. As an example

  • Users may save critical files in locations accessible to a wider audience than intended.
  • Users may prefer sharing content with large groups rather than specific individuals.
  • Users might not pay close attention to permissions when uploading files.
  • Users may not understand how to use sensitivity labelling (if enabled) to control access.

Services such as Microsoft SharePoint and Microsoft Copilot for Microsoft 365 utilise all data to which individual users have at least View permissions, which might include broadly shared files that the user is unaware of. As a result, users might see these applications as exposing content that was overshared. Oversharing can lead to sensitive information being exposed to unintended recipients. Users, while well intentioned, might not always grasp the implications of their sharing choices. They might overlook permissions or opt for convenience over security.

As a result, it’s important to use the permission models in SharePoint to ensure the right users or groups have the right access to the right content within your organisation. The following sections describe the key steps that administrators can implement to configure their SharePoint permissions model to help prevent data oversharing.

Dealing with Oversharing

The good news is that Microsoft is adding new features to SharePoint and Purview to make it easier to see, understand and control over sharing across Microsoft 365 with a hope to help adoption efforts and wider roll out of Microsoft 365 Copilot. This includes new Data Security Posture Management (DSPM) and enhancements for Data Loss Prevention policies in Microsoft 365 Copilot, and SharePoint Advanced Management. These can help automate site access reviews at scale and add controls to restrict access to sites if they contain highly sensitive information.

Microsoft have also released a blueprint guide for organisations planning to or deploying Copilot. These are nicely tailored to adjust to those with mainly Microsoft 365 E3 and E5 licenses respectively.

These new tools IMO are going to be vital to help organisation understand and address oversharing so they feel more feel confident in their employees adopting AI tools like Microsoft 365 Copilot.

AI is really good at finding information, and it can surface more information than you would have expected. This is why it’s really important to address oversharing. Typically, these issues are a by-product of good collaboration, particularly across Teams, SharePoint sites and OneDrive.

Alex Pozin | Director of Product Marketing | Microsoft

From early 2025, Microsoft will make access to SharePoint Advanced Management (SAM) available at no extra cost to Microsoft 365 Copilot subscriptions. Outside of this, SharePoint premium (which includes SAM ) will be available at a cost of around $3 per user each month.)

New Capabilities in SharePoint Advanced Management

There are also new features for SAM that Microsoft says will provide greater control over access to SharePoint files. 

  • New permission state reports (available now) can identify “overshared” SharePoint sites. The site access review feature can then provide a easy way to ask site owners to review and address permissions.
  • Restricted Content Discovery – which should start to roll out this month in public preview (December 2024), will allow IT admins to prevent Copilot from searching and processing data in specific sites for content and result generation. This does not prevent direct access to the site meaning that users can access the content directly as normal. This feature builds on the SharePoint Restricted Access Control, which was released last year, and lets IT admins restrict site access to specific sites to just “site owners” only, while also preventing Copilot from indexing and summarising files in these sites.

One of the use cases for this, are for where there are data locations containing information that needs to be contained to a set of people – such as financial reports, M&A planning, amnd other secret stuff. IT need to be confident that these locations and files will not show up in SharePoint searches and will be well out the reach of Copilot or other AI tools, essentially making sure that nobody can accidently or unintentionally be aware of, see or access the content. This is where Restricted Content Discovery comes in – locking down and hiding this information from plain site and from Copilot’s retrieval augmentation and indexing.

New Capabilities in Microsoft Purview

Microsoft are also adding new capabilities in Purview too. Purview is available as standalone or is part of Microsoft 365 E5.

/

Microsoft Purview is a centralised hub within Microsoft 365 that helps organisations meet regulatory and compliance requirements. It helps organisations manage their compliance obligations, protect sensitive data, and mitigate risks within their Microsoft 365 environment.

Here, there are new tools to help identify “overshared files” that can be accessed by Copilot. These includes oversharing assessments for Microsoft 365 Copilot in the Data Security Posture Management (DPSM) tool which is now in Public Preview (from December 2024) and can be accessed via the newly revamped Purview portal.

DSPM Portal in Microsoft Purview

The oversharing assessments are designed to highlight data that may present exposure risk by scanning files for sensitive data and identifying data repositories such as SharePoint and Teams sites where access permissions appear to be too wide and broad. The tool will also provide recommendations to admins and site owners for ways to mitigate oversharing risk, such as adding sensitivity labels or restricting access from SharePoint.

For example, DSPM can detect and help you deal with controlling ethical behaviour in AI (example demo environment below). For all the recommendation, Microsoft provides a simple step by step “wizard” to help IT and Compliance add policies.


Microsoft Purview Data Loss Prevention for Microsoft 365 Copilot, also in public preview, enables IT and security admins to create data loss prevention (DLP) policies to exclude certain documents from being processed by Copilot based on a the file or sites sensitivity label. This applies to files held in SharePoint and OneDrive, but can be configured at other levels, such as group, site, and user, to provide more flexibility around who can access what.

Insider Risk Management has also been updated to detect “risky AI usage.” This even includes user prompts that contain sensitive information and attempts by users to access unauthorised sensitive information. What’s key to note here is that this feature is not just limited to Microsoft 365 Copilot and also also covers Copilot Studio, and ChatGPT Enterprise.

Oversharing Blue Prints

I really like this. Microsoft’s new blueprint resource pages on Microsoft Learn provide recommended approaches and guidance for organisations to help them understand, mitigate and manage oversharing during what they define as the three main stages of Microsoft 365 Copilot deployment.

  • Pilot [Pilot]
  • Wider Deployment [Deploy at Scale]
  • Organisational Rollout [Operate]

Microsoft provide two blueprint designs. A “foundational path” and what they call an “optimised path” that uses some of the more Microsoft 365 advanced data security and governance tools found in Microsoft 365 E5 subscriptions.

Is there funding available to help?

It depends – but most likely!

Microsoft have a Cyber Security Investment Program open to select/specialist partners like Cisilion. These provide funded workshops, assessments and proof of value deployments across key Security workloads including Microsoft Purview as well as structured Copilot pilot deployments, vision and value

Organisations should speak to their Microsoft Solutions Partner for more information. You can contact Cisilion here should you need to.

Conclusion

In many of the discussions I and my team at Cisilion have with customers, we see that almost all of the organisations we work still have concerns over data governance in the realm of AI access. Of these most expect Microsoft to help them address these whilst some have already invested in third party tools to help them get a “grip” on their data and sharing.

We have seen a plethora of customers invest/upgrade to high-tier Microsoft 365 plans (including E5 Security and Compliance) or full Microsoft 365 E5 in order to gain access to Microsoft Purview. Some argue these tools should be provided as part of their Copilot investment, so it is great to see Microsoft meeting customers in the middle and at least providing some of these tools as part of this license investment.

The issue is not Copilot per-say, but it is that Copilot with it’s ability to access compnay data is causing more organisations to double down and look at the existing issues they have of too many SharePoint Sites, too much over sharing, orphaned data (data with no owner) inadequate data classification and labeling.

By addressing security and data governance and levering the new tools available, this at least should solve one of the blockers to AI adoption.

The second is Adoption and Change Management – more on that in the next blog post!

Useful links.

Posted on

Microsoft’s Recall hits preview on Qualcomm, Intel and AMD AI and Copilot+ PCs

Microsoft has recently expanded the testing of its innovative Recall AI feature to Intel- and AMD-powered AI and Copilot Plus PCs. Initially available on Qualcomm-powered devices only, this feature is now accessible to a broader range of devices for testing.

What is Recall?

Recall was the keynote Windows feature announced when Microsoft unleashed the Copilot+ PC  when they were released in September this year.

Initially recalled due to privacy concerns this is now in Public Preview for Windows Insiders on the Dev Channel.

Recall works by taking screenshots of almost everything you do on your  Copilot+ PC, (these are devices with dedicated NPUs that run at 45 Trillion Operations per Second (TOPS) or more). Recall makes it easy to search and recall past activities such as “the train route I was looking at on Tuesday” rather then scanning back through Internet search history.

Recall on Copilot+ PCs

This feature is entirely optional to use, but when enabled enabled, helps users find previous work, content or Internet data through natural language search or an interactive scrollable timeline.

As the user, you are completely in control of what snapshots are saved and how long for, and have the ability to delete them as needed, ensuring upmost privacy and security. Snaps shots require TPM, secure boot and Windows Hello to be active on the device and Microsoft has not access to the data which is encrypted on your device.

The power of Edge AI

Unlike services like Copilot, Recall and many of the newer Copilot+ PC features leverage local LLM models on the device as well as the NPU’s present on Copilot+ PC devices like the Surface Laptop 7 and Pro 11 range. As such when you install the #WindowsInsider Dev builds, you’ll also notice that Windows Updates installs a number of processing services as well as the Phi Silica LLM.

Recalls’ enhanced security and privacy

Microsoft has implemented many new security updates and controls to address initial concerns raised by security folk and early testers.

As I mentioned, accessing snapshots now requires Windows Hello for authentication, and the feature mandates the use of BitLocker and Secure Boot. Additionally, Recall can now automatically detects and excludes sensitive information like credit card details and passwords from being saved.

Click-to-Do and more AI features

Alongside Recall, Microsoft is also allowing Insiders on Copilot+ PCs to test out Click to Do feature, which recognise text and images in snapshots and content in screen allowing users to perform actions like copying text, invoking Copilot, saving and editing images and more. This functionality extends beyond Recall, enabling users to take actions on images and text with a simple Windows + Q key or Windows Key + mouse click.

In Paint, the new Cocreator top lets you create art and images by simply typing in text prompts. The Photos app has also been updated with new tools including Image Creator, which lets users make images from text prompts, and Restyle Image, which lets users add different artistic styles to their existing photos. You also get powerful generative erase tools which can be accessed directly from the app or from Click-To-Do.

These tools use local AI and analysis models on the Copilot+ PCs to work efficiently on the device itself through the use of the NPU.

Conclusion

Microsoft initially only made these features available for Snapdragon (ARM based) Copilot+ PCs but with this update they are continuing to u lease the new AI features in Windows 11 to more devices. The expansion of Recall to Intel and AMD Copilot+ PCs marks a step forward in enhancing user experience and productivity on this next generarion of devices.

What do you think of Recall and Click-to-Do?

Posted on

Windows and Devices – Summary of Ignite Announcements

Introduction

Copilot was very much front and center at Microsoft Ignite last month. However, the Windows ecosystem also had lots of coverage. This includes Windows 11, new devices, Windows 365, and Windows 365 Link. Along with this, Microsoft talked in depth about the importance of the new Windows Security Initiative.

This forms part of the Secure Futures Initiative , a wider efforts to ensure everything access the Microsoft eco-system is secure by design and secure by default.

The Windows Security Intuitive is a comprehensive effort to ensure that Windows remains the most reliable and secure platform on earth. This blog summarise the key Windows and Devices announcements from Ignite 2024.

The Windows Keynote session at Ignite was delivered Pavan Davuluri, Aidan Marcuss, Navjot Virk and David Weston and can be viewed here on demand from Microsoft.

Windows 11 – The Most Secure Windows Ever

Windows 10 is end of life in October 2025, but Windows 11 has been mainstream now since 2021. Windows has always been the platform for innovation, meeting the needs of over a billion customers across enterprise, public sector, education, creators, developers and engineers. With this comes Microsoft’s responsibility to deliver the most reliable and secure platform.



The “CrowdStrike incident” back in July 2024, which impacted 8.5 million devices, was a stark reminder of the need for vigilance and innovation and the need to have better controls in place to protect the core of the Windows OS. “EU policy prevents Microsoft restricting access to its kernel”, but Microsoft have, following the global incident, announced the Windows Resiliency Initiative. This initiative aims at making Windows more reliable and secure for all customers, including those with mission-critical workloads but introducing changes to how both Microsoft and third-parties manage critical workloads and updates within Windows 11.

Changes After the Crowdstrike Incident

In the key note, David Weston shared insights from conversations with hundreds of customers, including CISOs, CIOs, and incident responders. The feedback highlighted the need for easier recovery, stronger resilience of critical security tools, and overall platform security. Microsoft is addressing these needs through the Windows Resilient Security Platform, which allows security product developers to build products outside of kernel mode, reducing complexity and improving recovery.

“In addition to the work we are doing with CISA as part of Microsoft’s Secure Future Initiative, we are heavily investing in safe languages to enhance the safety of our code. This commitment also aligns with CISA’s secure by design pledge. We’re applying this new approach to our security platform and other key areas like Microsoft Surface’s firmware and the Pluton security processor firmware. Part of becoming resilient is also increasing the prevention of attacks, so more security has been built into the operating system and not bolted on later. This reduces complexity and ensures you deploy less software that could become the next failure point. This is why we are targeting the most critical elements of Windows 11.”

David Weston | VP Enterprise and OS Security | Microsoft

Changes in Windows coming…

  • Improving Windows Reliability – with new capabilities to enable security product developers to build their products outside of kernel mode. This is known as the Windows Resilient Security Platform, which provides a flexible security API set and data collection points that can be used to build endpoint security products like detection and response or antivirus outside of the kernel. This change will help end-user protection and antivirus products provide a high level of security and easier recovery, with less impact on Windows in the event of a crash or mistake
  • Quick Machine Recovery – This solution can execute targeted fixes from Windows Update on machines, even when Windows is unable to boot. This will allow for quick deployment of fixes that address files, drivers, or any other operation needed to recover a non-bootable machine.
  • Strengthening Security Tools and Drivers – Microsoft are working with industry-leading security partners and the US Cybersecurity and Infrastructure Security Agency (CISA) to define new ways to increase resilience across the ecosystem. This includes adopting safe deployment practices, conducting additional security and compatibility testing for components like security kernel drivers, and developing strengthened incident response processes for streamlined coordination.
  • Enhancing Identity Protection – To combat the increasing risk and success in cases of sophisticated phishing attacks, Microsoft has hardened Windows Hello, the built-in industry leading multi-factor authentication (MFA) solution. Windows Hello now supports passkeys, which means much of the web can be protected with MFA seamlessly. This enhancement ensures that users no longer need to choose between a simple sign-in and a safe one. This is one step further to help customers remove passwords from their environment.
  • Local Administrator Protection – Microsoft is introducing administrator protection to address the challenge of over-privileged users and applications. With admin protection, everyone (even admins) will have standard user permissions by default and can make Windows system changes, including app installation, only when necessary and after authorising the change using Windows Hello. This reduces the risk of attacks by ensuring that employees, not malware, remain in control of Windows.
  • Deep Collaboration with CISA – Microsoft and the CISA are providing a framework for the IT industry as a whole to ensure that all partners, customers, and organisations can stay ahead of evolving security threats. This collaboration aims to deliver software that is safe, secure, and resilient through secure by design, secure by default, and secure through delivery practices.

These changes and improvements are part of Microsoft’s commitment to making Windows reliable and secure for all customers, including mission-critical workloads. The Windows Resiliency Initiative represents a significant step forward in ensuring that Windows remains the most secure and reliable platform on earth.

Windows 11 – Ease of Migration, Management and Updates

Windows 11 builds on Windows 10 technologies and further simplifies the management and migration process to Windows 11. Windows 11 can be managed with the same tools and processes used for Windows 10, ensuring minimal disruption to the workforce. The compatibility with App Assure guarantees that all apps will work seamlessly on Windows 11.

In contrast, Windows 11 updates are 40% smaller in size, making it easier to stay up to date and reducing impact on users/employees as well as on network bandwidth, disk-space and time.

Windows 10 to Windows 11 – Compatibility with App Assure

App Assure is a key component of the Windows 11 upgrade experience as it was in the Windows 7 to Windows 10 experience. App Assure ensures that all apps are compatible with the new operating system through millions of real life feedback, crash reports and user feedback. This application compatibility is backed by Microsoft’s promise to address any app issues that may arise, providing peace of mind for businesses transitioning to Windows 11. The App Assure portal provides guidance, assurance and clarity of application and application version compatibility.

Updates, Hotfixes, and Autopatch

Windows 11 is introducing several new features to streamline updates and hotfixes.

  • Quick Machine Recovery allows targeted fixes from Windows Update on machines that are unable to boot, ensuring quick recovery during incidents.
  • Windows Hotpatch, available through Autopatch settings in Intune, delivers Patch Tuesday security updates directly to employees seamlessly in the background without requiring a restart, reducing interruptions and speeding up the deployment of security updates.

Windows Hotpatch is one that is super important. By using Windows Hotpatch through Autopatch settings in Intune, Microsoft say that 65% of Patch Tuesday security updates are delivered directly without requiring a restart. This significantly reduces restarts and interruptions, allowing security updates to be deployed 60% faster.

According to Forrester research, moving to Windows 11 delivers an impressive 250% return on investment over three years compared to Windows 10.

Windows Backup for Entra ID

Another exciting new feature announced at Microsoft Ignite is Windows Backup for Entra ID. This feature, available in public preview in early 2025, will help organisations ensure a seamless transition of use settings and preferences when setting up a new PC or performing a traditional reinstall which is typical with OS upgrades in larger enterprises.

With Windows Backup, employees can easily transfer their desktop background, icon size, and other preferences to a new device, ensuring a consistent and familiar experience. This reduces the time spent on setup, allowing employees to be productive faster and significantly reducing IT overhead and help desk calls.

Windows 11 – New devices and un-paralleled performance

Speed and Performance

Windows 11 is designed to deliver superior speed and performance. Bear in mind WIndows 10 is 10 years old and was designed for a pre-pandemic world and a world where AI didn’t touch the end-point.

Newer Windows 11 devices offer double the battery life and more than three times the performance of older Windows 10 devices.

Microsoft’s introduction of Copilot+ PCs and AI-PCs, built for AI workloads, is setting a new new standard for productivity, combining advanced AI inferencing capabilities with top-notch security and performance. Satya said in his key note that all applications will be rebuilt as AI apps and Windows is no different. Microsoft are re-writing their apps and OS for the AI era and simple examples include simple in-box tools like Notepad and Paint that have advanced AI capability.

Leading vendors like Adobe are adding new capabilities in their applications that leverage local NPUs found in new Windows 11 Copillot+ and AI PCs

The New Generation of Devices in Copilot+ PCs

The new generation of devices in Copilot+ PCs is designed to harness the full potential of AI. These devices (again bvery centre stateg at Ignite) come equipped with advanced AI inferencing capabilities, enabling them to handle complex workloads with ease. Their Neural Processors (NPUs) can operate at more than 45 Trillion Operations a Second (TOPS) providing the fastes edge AI processing in the world. The integration of AI into these devices not only enhances productivity but also ensures that security measures are robust and effective.

With features like real-time threat detection and automated responses, Copilot+ PCs provide a secure and efficient environment for businesses and consumers.

The day after Ignite, Microsoft also released Recall and Click-To-Do into public preview for users enrolled on the Windows Insider Programme.

Windows 11 – Sustainability and Windows 365

Modernising isn’t just about cost savings; it’s about the collective responsibility and impact on the global economy, our business and the environment. Microsoft has committed to advancing sustainability, and adopting Windows 11 helps in achieving your company’s sustainability goals.

Microsoft boldly shared that Windows 11 reduces energy use as the “world’s first carbon-aware OS” and offers Energy Saver, increasing energy efficiency by up to 22%.

Microsoft talked about their own devices, Surface which are manufactured using recycled materials and more renewable energy. As an example, Surface enclosures use 100% recycled aluminum alloy and 100% recycled rare earth materials. They also used this time to share existing and new programs to help organisations reduce e-waste with the recycling and refurbishment opportunities available across our ecosystem partners such as Cisilion. There’s a dedicated sustainability site for Surface -> here <-

Microsoft also shared several examples of how organisations can extend the life of (and even breath new life into) older hardware with Windows 365 without sacrificing security protection or experience.

Windows 365 and Windows 365 Link

Microsoft shared how Windows 365 plays can not only play a crucial role in this sustainability effort but also used the opportunity to announce their new dedicated “thin client” device called Windows 365 Link.

Priced at $349 and available from Spring 2025, these dedicated low power, sustainability built devices can provide local compute power but with no IT footprint to securely streams employees full personal Windows 11 desktop with all their apps, content, and settings directly from the Microsoft Cloud.

Windows 365 can run on any device include Web, dedicated devices like Windows 365 Link, and even mobile devices on iOS and Android as well of course as legacy Windows 10 devices and even Windows 11.

The flexibility of Windows 365 allows businesses in any sector and any size to reduce their IT infrastructure and management complexity while providing a consistent and secure experience for employees. Windows 365 is designed to complement your Windows 11 end user computing estate, enabling more endpoints and form factors, and unlocking more value and options for businesses.

Windows 365 is also great for contractors, testing migrations to Windows 11 and also for running secure workloads as well as for education and front line workers.

What have I missed?

There were lots of announcement around Windows and Devices at Ignite. The Windows Security Initiative clearly represents a significant step forward in ensuring that Windows remains the most secure and reliable platform.

With new enhanced security measures, simplified management and migration, seamless compatibility with App Assure, and innovative update mechanisms, Windows 11 is promising to deliver unparalleled speed, performance, security, agility and management.

Links:

Posted on

Facilitator agent: Live AI notes in Teams meetings & chat

Microsoft announced at Ignite, the new Facilitator agent – an update to the AI notes in Teams that works inside your meetings and chat and is designed to enhance collaboration and streamline the way teams work. It works similar to the AI generated notes after a meeting, but this works live alongside you and all participants can see it working live in the meeting.

How Facilitator works in Teams Meetings

Facilitator will take real-time notes during Teams meetings (not currently adhoc meetings or Meet Now), enabling everyone to co-author and collaborate seamlessly. This allows meeting participants to focus and engage more deeply in meetings, while ensuring alignment before the meeting concludes.

To enable this feature and use it a meeting, organisers can toggle AI-generated notes setting on or off when setting up a meeting in the Teams calendar or enable it during the meeting via the Notes section in the meeting.

Once enabled, a notification appears in the meeting chat to inform all participants. This also activates meeting transcription, with a notification to users… During the meeting, participants can click on Notes to open a pane where the AI generated live notes are created every few minutes, organised by topics and follow-up tasks.

What is nice about this is that participants can edit the notes inline or assign tasks to users, with attributions indicating whether the content is AI-generated or user-edited making these Co authored notes by humans and AI!

After the meeting ends, notes continue to be accessible in the Recap tab and are stored in the OneDrive of the user who enabled real-time notes. These notes are contextual to the meeting transcript, ensuring relevance and accuracy.

Future Capabilities in Meetings

As the Facilitator agent gets developed futrther, Microsoft say that it will be able to take on more tasks to enhance meeting effectiveness. Soon, it will also manage meetings from end-to-end, including managing agendas, moderating discussions, and handling action items automatically or semi-automatically

In early 2025, the real-time note-taking experience will also expand to Microsoft Teams Rooms. Employees will be able to invite a Teams Room to a meeting, allowing all participants to see real-time notes however, they have joined the meeting. This feature will also be available for ad-hoc meetings, enabling in-office discussions to be captured seamlessly.

How Facilitator works in Teams Chats

As of now (November 2024), the Facilitator Agent creates and maintains up-to-date summaries of what it considers valuable information within Teams chats. This includes key decisions, action items, and open questions, helping groups stay focused, align faster, and resolve issues efficiently.

AI-generated notes are automatically enabled when creating a new chat. For existing chats, users can toggle it on via the Notes icon which is shown at the top right of the chat window as shown below.

When notes are enabled, a notification appears in the group chat to inform everyone that notes are being taken in real time.

To access the notes users simply click on the Notes icon in the top right corner of the chat to show a summary of the chat thread, organised by topics with corresponding decisions, action items, and unanswered questions.

These are continuously updated as the chat conversation progresses.

Availability and access

Facilitator is already in public preview now for desktop (Windows/Mac), web, and iOS/Android. To access the public preview of the new Facilitator agent, meeting hosts need a Microsoft 365 Copilot license.

Facilitator will only be available to users that have app permission policy for Microsoft apps set to “Allow all apps”. The Facilitator App will become available soon for Admins to see and manage in Teams admin center. For more information about app permission policies, see Manage app permission policies in Microsoft Teams – Microsoft Teams | Microsoft Learn

External users cannot access AI-generated notes

Let me know if you find this helpful

Posted on

Enhanced Data Protection and Governance coming SharePoint and Purview to remove AI adoption blockers.

This week at Microsoft Ignite 2024, Microsoft unveiled new features and controls for SharePoint and Purview, aimed at empowering IT teams and ensuring robust data protection and governance. These enhancements are part of Microsoft’s ongoing commitment to providing intelligent solutions that respect an organisations controls while driving productivity and efficiency. Oversharing of data is one of the most common causes of rogue data and poor data governance and one of the biggest blockers to wider AI adoption.

Microsoft offers two powerful tools to address this concern of oversharing: SharePoint Advanced Management for site management and content governance capabilities, and Microsoft Purview for security, compliance, and governance across data and files. Both have new capabilities and availability following announcements at Ignite in Chicago.

Advanced Management for SharePoint for Copilot.

To give IT teams even more control, Microsoft have said that SharePoint Advanced Management will be included at no additional charge for Copilot customers. There’s also need and updated features coming.

  • Restricted Content Discovery (RCD) to help identify and manage content that is restricted or sensitive, ensuring that such content is not overshared within the organisation. This works by allowing SharePoint Administrators to restrict specific SharePoint sites from participating in organisation wide search and Microsoft 365 Chat. Once configured, all content from the site will be hidden from tenant-wide search and Microsoft 365 Chat by default for all users in the tenant, even if a user has site access permissions. While child content will be hidden by default, users will still be able to search for content they have recently interacted with. This includes recently accessed and modified files, even if RCD is applied to the parent site. Searches originating from a site context will not be impacted.This will be available in Public Preview in December 2024 and Generally Available from March 2025
  • Restricted Access Control (RAC) feature allows administrators to control and restrict access to specific sites or content within SharePoint to helps in preventing unauthorised access and oversharing of sensitive information. New AI content governance controls and insights will be available in early 2025.
  • Deployment Blueprint is a new feature that will offers a structured approach to deploying Microsoft 365 Copilot while addressing the risks of information oversharing. It will include best practices, guidelines, and tools to ensure that sensitive information is protected during the deployment process.

SharePoint Advanced Management will be Generally available in Q1 2025 and will allow IT to better govern access and usage of Copilot and agents, including controls over which users can use Copilot and agents, along with visibility into agent status and life cycle.

SharePoint Advanced Management will be included as standard for organisations with Microsoft 365 Copilot licenses.

Purview

  • Data Loss Prevention – To provide addition protection, Microsoft Purview Data Loss Prevention (DLP) will soon be extended to support Microsoft 365 Copilot. DLP policies will be able to identify sensitive documents based on sensitivity labels and exclude processing for Copilot interactions in Microsoft 365 Copilot Business Chat. In preview from December.
  • Data Security Posture Management (DSPM) provides insights into the security posture of data within the organisation. It helps in identifying potential risks and vulnerabilities related to data oversharing and provides recommendations to mitigate these risks.
  • Risky AI Usage Detection is a new feature which can detect and alert admins about potentially risky usage of AI within the organization. It helps in preventing data leakage and unauthorised access by monitoring AI activities. This is now in public preview.
  • GenAI Risk Detections is another feature which focuses on detecting risks associated with the use of generative AI. It ensures that AI-generated content does not lead to oversharing of sensitive information or unauthorised access.

Measurement and Reporting with Copilot Analytics

To help IT and business leaders track adoption patterns and return on investment from the use of Copilot and agents, Microsoft is introducing Copilot Analytics.

This new feature includes out-of-the-box experiences to measure Copilot adoption and business impact, customisable reporting for deeper analysis.

The new Copilot Analytics. Microsoft Viva Insights will be included in Copilot at no additional charge as part of this new analytics suite.

How Microsoft partners can help

Cisilion, as your Copilot Jumpstart partner, will be incorporating these new features and controls into our guidance and briefing and expect Microsoft will rapidly be updating their official documentation and guidance.

The Copilot Pilot programme, entwines technical readiness with business guidance and comprehensive adoption and change management to ensures that your organisation receives the most up-to-date and comprehensive support in leveraging these advancements for optimal data protection and governance whilst putting these into practice for a smooth and measurable pilot.

Conclusion

These new controls and features are designed to provide IT teams with the tools they need to govern access, usage, and reporting while ensuring data protection and governance. Microsoft is committed to helping organisations leverage the power of AI to drive productivity, efficiency, and security.

You can read the official Microsoft Blogs here.

Posted on

Microsoft’s Copilot AI Agents enter Public Preview

TL;DR

Microsoft has introduced autonomous Copilot AI agents in public preview. These agents can learn, adapt, and make decisions, aiming to assist employees with various tasks and improve productivity. While AI has the potential to displace some jobs, it also creates new opportunities and enhances productivity.

Microsoft’s wave of Autonomous agents are here

Microsoft has unveiled new tools designed to help businesses create software agents powered by foundation models, referred to as autonomous Copilot AI agents. These agents are currently available in public preview.

Copilot is Microsoft’s generic term for all their AI-driven productivity workloads. Copilot is built upon the advanced GPT-4 series of large language models by OpenAI and offers a chatbot interface where users can input text, images, or audio prompts to receive responses tailored to their needs. Microsoft 365 Copilot also seamlessly integrates with Microsoft Office applications like Word, Teams, and Excel. It can generate documents, analyse extensive Excel spreadsheets, summarise meetings content, rewrite documents, create entire PowerPoint presentations and even reason over your inbox and company information you have access too….., and much, much more.

The next step in Microsoft 365 Copilot’s advancement is through what are termed AI-Agents, which are chat bots that can not only respond but can also perform a series of linked tasks (actions) based on user instructions. This new wave went into public preview this week at Microsoft Ignite in Chicago.

What are Microsoft 365 Copilot Agents?

This first stage of the next phase of evolution comes with Microsoft introducing a set of Microsoft 365 Copilot agents with predefined roles. These include:

  • Agents in SharePoint. These can be customers with a personalised name and certain behaviours, and can be shared across emails, meetings and chats, with users being able to ask the agents questions and getting real-time responses. These are grounded just on the SharePoint sites and files you specify. One created, employees can ask the agents questions about data across your files. These agents can even be shared or published in Teams for simple access.
  • The Employee Self-Service Agent in Microsoft 365 Copilot Business Chat (this currently in private preview), will be able to respond to specific HR and IT questions. It can retrieve employee benefits and even things like payroll info and holiday information, or request help from IT such as a new mouse, password reset etc.
  • The Facilitator agent (in public preview), works like a assistant in meetings and goes beyond the current AI notes that Teams Premium offers. It can take notes, curate actions and even pull up information or execute instructions such as “see if Bob is free and invite him to the meeting”. It will also be able to summarise the conversations based on the role of the participants.
  • The Interpreter agent (due in preview in early  2025) promises real-time interpretation in Teams meetings in up to nine languages. It will also be able to sample and then simulate their personal voice for a more inclusive experience as part of the translation, essentially using the sound of your voice in the language of the other participants. It was great to see this in action at ignite in a live demo!
  • The Project Manager agent, will be able to act and work like a PM with the ability to automate project management, from planning to execution using Microsoft (and later other) project tools like Planner.

For organisations that need more control or different templates to build on and use, Microsoft Copilot Studio provides a way to customise or create your own AI agent behaviour.

Agents in Copilot Studio

Agents built in Copilot Studio can operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention,These autonomous agents can be triggered by data changes, events, and other background tasks – and not just through chat.

Copilot Studio bundles many templates for common agent scenarios that can serve as the basis for a customised version. It will also shortly support voice-enabled agents, image uploading (for analysis by GPT-4o), and knowledge tuning with the added ability automatically add new sources of knowledge to help agents respond to questions.

Devs can use the Agent SDK to access services from Azure AI, Semantic Kernel, and Copilot Studio. There’s also an Azure AI Foundry (also launched at Ignite) integration that links Copilot Studio to facilitate connection to services like Azure AI Search and the Azure AI model catalog.

Finally, a public preview of agent builder in Power Apps was also announced at Ignite.

What about Responsible AI?

Sarah Bird, chief product officer for Responsible AI, wrote in a blog post this week that extra safety considerations arise with autonomous agents and that Microsoft is focused on ensuring that they behave and hand over to human before taking unexpected actions which can have big impacts and that extra guard rails and protections will be put in place.

The blog post talks about examples of such measures including the vital need for a human-in-the-loop check to make sure autonomous decision-making doesn’t do things it’s not expected too. Nothing demonstrates confidence in automation more than a human approval process.

Microsoft also suggest that anyone looking to get a sense of AI agents in a real role, can try out the  Linked In Hiring Assistant which is designed to help HR hiring teams speed up the process of dealing with the Admin involved in reviewing  job applications.

Key Benefits

The key Benefits these new adaptions to Copilot. Agents should bring to users and organisations includes:

  • Learning and Adaptation: The Copilot AI agents can learn from their environment and adapt to new information and tasks.
  • Decision-Making: These agents are capable of making decisions to assist users in their daily work.
  • Productivity Enhancement: The primary goal is to empower employees by reducing workload and improving efficiency in tasks such as managing meetings, emails, and creating presentations.
  • Automation of some tasks connected to regular and recurring inquiries or asks.

Human Impact – what about jobs!

The introduction of AI and automation, including Microsoft’s Copilot AI agents, has the potential to impact the roles of people in jobs.

  • Job Displacement: People naturally worry that AI has the potential to replace certain jobs, particularly those involving repetitive and manual tasks. According to a report by Goldman Sachs, AI could replace the equivalent of 300 million full-time jobs….. But.
  • Job Creation: On the other hand, AI also creates new job opportunities. It can lead to the emergence of new roles that require advanced technical skills and the ability to work with AI systems
  • Economic Impact: AI is expected to contribute significantly to global economic growth. McKinsey Global Institute estimates that AI could deliver additional global economic activity of around $13 trillion by 2030
  • Skill Demand: The demand for skills will shift towards more advanced and technical capabilities. Employees will need to upskill and reskill to stay relevant in the evolving job market. AI skills will be similar requirement to the “Internet skills” we saw on CVs in the 1990s!

Conclusion

Microsoft’s autonomous Copilot AI agents represent a significant step towards integrating advanced AI into everyday business operations. By enhancing productivity and reducing routine workload, these agents have the potential to transform how employees manage their tasks.

These will be in public preview very soon as these often take a few weeks to rollout across the globe.

Source: Conversation with Copilot, 22/11/2024
(1) How Will Artificial Intelligence Affect Jobs 2024-2030. https://www.nexford.edu/insights/how-will-ai-affect-jobs.

(3) The impact of AI on jobs – GOV.UK. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1023590/impact-of-ai-on-jobs.pdf.

Posted on

What is Windows 365 Link?

At Microsoft Ignite 2024, Microsoft announced Windows 365 Link to address the need to provide zero touch, secure, lightweight “thin client” device capable of running critical Windows workloads in the Cloud while enhancing security and flexibility,

Windows 365 Link represents the first move by Microsoft into the hardware space with a dedicated new class of devices purpose-built to connect securely to Windows 365 in seconds.

Yes, essentially a Thin Client device yes, Windows 365 Link, offers a simple, secure, purpose-built device for Windows 365, which will instantly book (using Windows 365 on a dedicated Windows 11 (light) device which boots instantly to the Windows 365 desktop.

The device is tuned and built to to provide responsive, high-fidelity experiences and will be available from April 2025 for around $349 RRP.

Windows 365 Link device is a compact, fanless and lightweight device. When powered up it boots in seconds, and provides modern power management including instant wake and localised processing for high-fidelity experiences, such as Microsoft Teams meetings and Webex by Cisco, helping users make the most of productive time.

Design and Build.

The device is built with 90% post-consumer recycled aluminum alloy in its top shield, 100% pre-consumer recycled aluminum alloy in its bottom plate, and its motherboard contains 100% recycled copper and 96% recycled tin solder. It also has 100% paper-based packaging, is ENERGY STAR®-certified device, with super low energy consumption.

Windows 365 Link has a fanless design, with the ability to boot quickly and wake instantly from sleep, according to the company.

There’s no local data storage, and no admin privileges for users. The device supports dual 4K monitors, with four USB ports, an audio port, an Ethernet port, Wi-Fi 6E, and Bluetooth 5.3.and supports any Windows certified wired and wireless peripherals including webcams.,

Windows 365 Link

Windows 365 Link is designed to be long-lasting with no moving parts, not even a fan—hence reducing the need for frequent replacements.

Secure By Design

Windows 365 Link is secure by design. The device stores no local, runs no local apps and has no local admin access. All corporate data will stay protected within the Microsoft Cloud under the Windows Cloud PC environment. The devices also ship with security baseline policies enabled by default and security features cannot be turned off or disabled.

Firmware and device updates are managed by Microsoft and the devices cannot be side-loaded or bypassed since they leverage the same secure by design principlans protecting Microsoft first devices like Surface.

Windows 365 Link supports DCFI, password less authentication using Microsoft Entra ID and the Microsoft Authenticator app or USB security keys.

Windows 365 Link Management

The device is managed via Intune ensuring a coherent and consistent management for IT. Windows 365 Link is designed to be long-lasting and can be remotely deployed and factory reset remotely in minutes, making it easy to reuse, secure and scalable.

The devices default to having a name starting with WCPC (for Windows CPC), and you can easily find them by looking for devices where the SKU family is WCPC. Windows 365 Link also automatically stays up to date: it downloads updates in the background and will apply them overnight when the device is not in use.

Posted on

AI agents are transforming Customer interactions.

AI and human Agent

In our recent fireside chat, we delved into the transformative potential of AI agents across multiple industries. These business areas include customer service, IT support, and internal business support. The discussion, titled “Rise of the AI Agents,” brought together industry experts across several fields. These included transportation, public sector, legal, media, and executive search. The panel explored how AI is reshaping customer and consumer interactions and discussed enhancing efficiency and driving more inclusive interactions.

Introduction to AI Agents

We kicked off the session our fireside chat by setting the scene. We highlighted the traditional challenges faced in contact centers. These include long hold times and inefficient call transfers between chat bots and human agents. Here we agreed on these and but also the importance of not just jumping on “injecting ChatGPT” into workflows, but instead discussed the advent and value of generative AI and human-like conversation across chat and AI-Voice and how these rapid technology advancements have the potential to revolutionise these experiences.

AI agents, leveraging large language models like, are now capable of understanding context, handling a wide range of queries, and providing personalized responses and we are seeing Contact Center solutions such as Cisco Webex, starting to infuse this technology to assist end-to-end in the Human-to AI, Human-to-AI-to-Human, and Human-to-Human conversation.

AI agents leverage advanced technologies like large language models (LLMs) and machine learning to provide more dynamic and context-aware interactions. AI agents can understand and generate natural language. This ability allows them to handle a wider range of queries. They also provide more personalised responses. They can learn from data and feedback, improving their performance over time without needing manual updates.

AI agents can also integrate with various data sources and systems, enabling them to provide more comprehensive and accurate information.

  • Autonomous Agents can operate entirely independently, without human intervention. They can handle multi-step tasks, make decisions based on pre-programmed logic, and adapt to new situations using advanced AI techniques like reinforcement learning. These agents are ideal for environments where human input is minimal or impractical.
  • Semi-Autonomous Agents on the other hand, still involve a “human in the loop.” While they can perform many tasks independently, they require human input for certain decisions or actions. This hybrid approach combines the efficiency of automation with the oversight of human expertise, ensuring accuracy and reliability.

The example below is a recent marketing video from Cisco introducing their new AI agent in Webex Contact Centre.

AI Agent example in Cisco Webex Contact Centre

AI Agent – Use Cases

Through the discussion, the panel agreed on several key areas in which AI assisted agents could add value.

  • Customer Support: Investing (or extending existing platform) in AI agents can help multiple lines of business better and more efficiently handle routine customer inquiries, such as changing addresses, booking or changing appointments, and freeing up human agents to work on less trivial customer requests or more complex issues. 
  • Sales Assistance: Another area discussed, was where AI can assist human agents (for example in sales or customer service), by providing real-time information and suggestions during human customer interactions, improving the chances of successful sales conversations, such as overcoming objections or asking for more technical information about a product or service.
  • Customer Service and Complaints: helping agents improve their interaction with their customers, such as making agents aware of similar problems, outages or similar calls that led to successful outcomes or helping explain something better or in a different way to their customer.
  • Training and Development: AI can be used to train new agents by simulating customer interactions and providing feedback, helping them improve their skills more quickly. This can be used for onboarding fresh staff, running different customer scenarios or reviewing previous calls for improvement
  • Sentiment Analysis: Using AI to analyse customer sentiment during interactions, allowing agents to adjust their approach and improve customer satisfaction as well as flagging to supervisors early where interaction or training may be needed.

AI Agent Value and Applications

Driving efficiency and improving satisfaction

Darren Everden (London Borough of Hillingdon) shared his insights on how local authorities are looking at utilising AI to improve resident interactions. David emphasised the importance of channel shift and transformation in the public sector, driven by funding reductions and the need for more cost-effective solutions that also improve the resident experience and resolution rate. Darren highlighted the evolution of chatbots, which can now use natural language processing to understand and respond to resident queries more effectively. He also discussed the potential of integrating AI into voice channels, enhancing accessibility and providing a more natural interaction experience making it almost impossible to differentiate from human voice. Interactions are far more natural than ever, and this continues to evolve and improve with models such as ChatGPT-4o.

Inclusivity and Accessibility

Ken Dickie from Leathwaite Executive Search, discussed the role of AI in promoting and improving inclusivity and accessibility. He pointed out that AI agents are far better at being able to adapt to the needs of users with disabilities, such as dyslexia, by adjusting text spacing or providing audio responses something human only operated agents simply cannot easily do This real-time adaptability empowers individuals to engage with systems more effectively. Ken also mentioned the global reach of AI, enabling organisations to provide support in multiple languages, thus breaking down communication barriers.

Enhancing Agent Efficiency

Aidan Shanahan from Govia Thameslink Railway discussed the benefits of AI in assisting human agents. He discussed his view on where AI can provide real-time guidance and sentiment analysis, helping agents handle customer interactions more effectively. The panel here discussed the role AI as an human assistant (An Agent to the Agent) being particularly valuable in high-stress situations, such as handling complaints, where AI can suggest appropriate responses based on the customer’s tone. Aidan also highlighted the potential for AI to improve internal processes, such as IT support, by automating routine tasks and reducing response times, replacing laboreous processes with natural language requests.

Jas Bassi from Gately highlighted the potential applications of AI in the legal sector. While acknowledging the generational differences in adopting new technologies, Jas emphasized the need for a multi-channel approach that includes both human and AI interactions. He pointed out that AI can deliver efficiency gains in transactional activities, ensuring faster and more consistent service delivery. However, he also raised concerns about biases in AI training and the risk of deep fakes, underscoring the importance of maintaining a balance between automation and human oversight.

Low cost of entry and ease of Proof of Concept

Alex Taylor from Awin shared his experience with implementing AI agents internally at Awin. He mentioned that this is no longer about one off business cases and specific dictated expensive systems. He shared that he is seeing huge interest in the use of AI agents across various departments, such as InfoSec and marketing, in leveraging AI to not only automate and ease customer interactions but also going beyond this and automating processes and improving efficiency. He emphasised the importance of extending this value by connecting backend systems (which also involved in many cases minimising diserpate vendrs) and ensuring they are “compatible” to maximize their effectiveness with automation and semi-automatic interactions. He realised examples, of automatically logging tickets, providing simple answers to issues and even liaising with other systems or processes.

Finally Alex and Ken agreed that the bar to entry is much lower, with a similar approach,. bring able to serve multiple departments, handle thousands of enquiries and not only reduce the cost, but truely delivery faster, more inclusive and international support even for organisations that don’t have global offices.

Conclusion: The Value and Opportunities of AI Agents

Our fireside chat concluded that there were several key value points when it comes to the use and exploration of AI agents across customer and employee focused formal contact centers but also across more adhoc and internal communications within and across business, from website chat to internal IT support.

  • Enhanced Customer Interaction: AI agents can provide more efficient and personalized customer service, reducing wait times and improving satisfaction
  • Cost-Effective Solutions: The low cost of entry and easy of deployment (compared to the previous laborious process of programming conversational paths), enables organisations to handle a higher volume of interactions without significantly increasing costs, making it a viable option for sectors with budget constraints and most importantly without a huge development and support burden.
  • Inclusivity and Accessibility: AI agents can adapt to the needs of diverse user groups, promoting inclusivity and breaking down language barriers both with end customers and with human-agents.
  • Supporting the Human Agents: AI assists can act as a huge support for human agents by providing real-time guidance, sentiment analysis, and automating routine tasks, enhancing overall efficiency and can even help handle delicate situations, detect agent stress and suggest rest-bites and training to supervisors based on AI assisted analysis.
  • Internal Process Optimisation: Used effectively, this can extend way beyond the conversation, streamlining internal workflows, reducing response times and improving productivity across various departments.

Missed the fireside chat? Catch up on demand here

Posted on

Creating a Copilot Agent from a SharePoint Library

The new Agent Builder in SharePoint is designed to help people use and share Copilot Agents to query sibsets of data within your organistion using a simple click, point, create and tweak approach. Out of the box every SharePoint site (assuming you have a Copilot license) brings a Copilot sidebar allowing you to ask questions about the content, but you can also replace this with a custom Copilot Agent which we will walk through here.

The goal is to enable business users to easily empower their employees use Copilot to reason over specific information sources or across discrete repositories. Microsoft provide a handful of “use cases” as why a Copilot agent might be useful and what’s great is that “anyone” can create one!

Image – Microsoft Copilot Adoption Hub

Once created and tested, these custom Copilot Agents can be easily shared via a simple hyperlink that can be embedded in SharePoint pages or used in Teams.

In this how to blog, I walk you through the setup and customisation of a Copilot Agent using Agent Builder in SharePoint, customising of the agent, and sharing of the agent. Free to follow along and create your own agent.

Copilot agents are specialised AI assistants designed to enhance the capabilities of Microsoft 365 Copilot by connecting to your organisation’s knowledge and data sources. They are custom tools embedded in Copilot Extensions, providing additional functionalities tailored to specific needs. In SharePoint, Copilot agents are natural language AI assistants that give trusted, precise answers and insights. Agents are expert systems that operate autonomously on behalf of a process or company.

Building your First Copilot Agent

Step 1 – Choose your starting point.

First, you need to navigate to a SharePoint site, library or document library you want to create an “agent” from. You will of couse need to have access to that Library and also need a Microsoft 365 Copilot license to create the agent.

From here, you can select the three dots and choose “Create a Copilot agent“

Step 2 – Click and you are done!

Done (well – you will probably want to customise it and test it), but once you do this, your Copilot Agent is created for you. Click “Edit” to make changes, such as change the name, and then of course test it out.

Step 3 – Edit and Customise

Here I have clicked “Edit” to take me to the customisation pages. From here you can toggle across different options to customise your Copilot agent.

The customisation pages are split into three sections – Idenitity, Sources and Bebaviour – each of these allow you to tweak the way the agent works. There’s also the ability to edit for advanced customisation through Copilot Studio but this feature is not available at time of writing…

In the Identity Section – you can change the name, icon and description (who the agent introduces itself to the user)

In the Sources Section – you can modify the sources that the Copilot Agent uses. You can add additonal SharePoint sites, individual files or extenal sources such as websites.

In most cases, I suspect you will want to use a single library or a discrete set of files, but you can add up to 20 different information sources. These 20 information sources can be mean sites, libraries, folders, or documents. What’s more, you can have a combination of these as long as the total is 20 sources – for example, you could add 20 sites or 20 documents, or 3 sites, 5 document libraries, 2 libraries and 10 descrete files as long the total sources totals 20.

Note: You of course need to ensure that the intended users of the agent have access to the sources your specify as agents run under the security context of the user using the agent.

In the Behaviour Section, you can customise the welcome message which will help your users to understand the purpose of this Copilot agent and can also edit or change the starter prompts to help users get some tips on some of the things the agent can do for them. You can also give the agent specific instructions on how it should respond and behave based on the user input.

As you update the behviour, you will see the changes in real-time.

Testing your Copilot Agent

Once you are ready, you can test your agent, simply writing a prompt in the chat dialog as you would with any other Copilot – feel free to try one of the templates or create your own.

Be sure to test a few things, you might find you need to update the user instructions and review the sources before you share it with other people to test further.

Once you are happy with your agent, click save. The agent is saved a “file” with a .copilot extension in the root of the SharePoint folder you started creating your agent in.

Using your Copilot agent

Once saved, your new Copilot Agent launches automatically for any user accessing the SharePoint library that has a Microsoft 365 Copilot license. This replaces the default copilot interface that opens when you visit a SharePoint library.

Sharing your Copilot agent

Since the Agent is encapsulated as a manifest “.copilot” file, you can simply share the file like you would any other file, or click the three dots and select share.

Once shared, they click on the file and open it and it displays like a standalone app or can of course access it from the SharePoint library directly.

[Current] Limitations

  1. Currently Custom agents do not appear on the main Copilot Business Chat pages, though this is coming I beleive. On the FAQ on Microsoft’s support page it clearly states that “You can access a Copilot agent from a SharePoint site, page, or document library. You can also use it in Teams if added. We plan to make it available across Microsoft 365, including Microsoft Copilot.” https://support.microsoft.com/en-us/office/get-started-with-copilot-agents-in-sharepoint-69e2faf9-2c1e-4baa-8305-23e625021bcf.
  2. Advanced editing with Copilot Studio is not currently available, but is also coming soon.
  3. It’s not possible to “hide” the .copilot file (that I can see anyway), so make sure to change permissions on the file.

Let me know how you get on….

Posted on

Copilot Vision: A New Era of AI Assistance or a step too far?

Microsoft is about to add more capabilities to the consumber version of Copilot including a new way we interact with it Copilot through its latest feature, Copilot Vision.

Is this a privacy step to far? or is this simply leveraging the power of vision to bring new experience and assistance to users.

Designed to enhance the capabilities of Microsoft’s Copilot AI assistant by allowing it to see and understand the same content as the the user is seeing on scene is said to bring a new dimension to how we work with AI tools.

Copilot Vision – image (c) Microsoft

What is Copilot Vision?

Copilot Vision is an extension of Microsoft’s Copilot AI assistant that enables it to visually perceive the content on your screen. Whether you’re browsing websites, reading documents, or viewing images, Copilot Vision can interpret and respond to the visual data, making it a more intuitive and helpful assistant.

Examples of Copilot Vision in Action

  • Travel Planning: Instead of manually searching for travel options, Copilot Vision can provide recommendations and answer questions based on the travel websites you’re viewing.
  • Recipe Adjustments: If you’re looking at a recipe online and want to make substitutions, Copilot Vision can suggest alternatives and cooking tips without needing to switch tabs or open a new search.
  • Document Assistance: While working on a document, Copilot Vision can offer suggestions, corrections, and additional information relevant to the content you’re editing.

All this happens without you having to copy and paste stuff to the Copilot chat interface so it’s really like having eyes on what you are doing (once turned on of course). It’s like having your assistant working and viewing with you so it can see exactly what you see on your screen, whether it’s a website or a document.

Copilot Vision.

That’s what Copilot Vision does. It can read both typed and handwritten text displayed on your screen, and it responds to what it sees, offering answers to your questions and suggesting next steps.

Privacy Consideration

Microsoft has emphased that privacy is a top priority with Copilot Vision. The data processed by Copilot Vision is not saved or used beyond the current session (like clearing the cache). Microsoft Copilot Vision will initially also be limited to certain popular websites that meet Microsoft’s security standards, ensuring a safe and secure user experience. It also won’t work on sites that contain sensitive data such as banking sites.

Remember, this is something you can choose to use or not, so you can turn it off!

Rollout Timeline

Microsoft say that after a successful trial period with a select group of users in the Copilot Labs experiment hub, Copilot Vision is “now ready” for a broader rollout.

The feature will soon be integrated into the Microsoft Edge browser, accessible via a screen-like icon. This phased rollout will allow Microsoft to gather more feedback and ensure a smooth user experience.

Posted on

Recall “Recalled” Again: Microsoft’s Copilot+PC Flagship Feature Faces Further Delays

Recall Recalled again feature image

In a move that has surprised few, Microsoft has once again delayed the rollout of its controversial Recall feature for Copilot AI PCs. Initially planned for a June release to coincide with the new Copilot+PCs launch, Recall was then postponed to October while Microsoft addressed initial concerns around privacy and security.

This week however, Microsoft has yet again delayed this again with testing for Windows Insiders coming (so we are told) in December, which unfortunately falls after Ignite.

Microsoft Recall….

Security Concerns and Refinements

Recall’s primary value is to create a timeline of screenshots that users can scroll through and search. However, early testing revealed by security researchers discovered that the core database storing these screenshots and tagging was not encrypted, posing a massive security risk.

Microsoft have since addressed this by fully encrypting the database and requiring Windows Hello authentication for access.

Microsoft have also confirmed that Recall will now be an opt-in feature, allowing users to completely uninstall it if they choose.

Microsoft’s Cautious Approach

Brandon LeBlanc, senior product manager of Windows, enforced Microsoft’s commitment to delivering a secure and trusted experience with Recall.

Microsoft need to get this right in order to maintain trust with its customer base. He stated that the additional time is necessary to refine the feature before previewing it with Windows Insiders. Despite these assurances, social media shows huge skepticism about whether Microsoft will meet the new December deadline and even if they might scrap the feature all together. This will be a shame, as the value around it looks. Promising and is really ( currently) the one killer reason consumers were looking at when looking at investing in Copilot+ PCs outside of the huge battery life that these Qualcomm Snapdragon Powered devices deliver.

The verge covered this in an exclusive interview

Wider AI privacy concerns

The repeated delays and security issues surrounding Recall highlight broader concerns within the AI industry.

There is a growing perception that companies are rushing to release new features without fully considering the potential consequences.

Microsoft’s cautious approach with Recall is a step in the right direction, but it also underscores the need for more rigorous testing and security measures in AI development.

Will Recall still be exclusive to Copilot+ PCs?

That’s a good question.

When Microsoft announced the Copilot+PC back in June, Recall was the flagship feature and it was unique to the device’s (and kinda stole the show).

Since then AMD and Intel have released their new AI PC chipsets offering similar NPU performance to the Snapdragon chips in Copilot+ PCs like Surface Pro 11 and Surface Laptop 7.

We now have NPU turbocharged PCs with Snapdragon® X Series, AMD Ryzen™ AI 300 Series and Intel® Core™ Ultra 200V Series devices after all.

We don’t know if this will remain an exclusive (I don’t see why it would) and if all the “exclusive AI features” that are part of Windows 11 24H2 will soon be lit up in any decide with a dedicated NPU.

From what I can… It will be supported… But some features are limited to Snapdragon, so we will have to wait and see….

Coming soon then… Or will it?

While the future of Recall still remains uncertain, Microsoft’s efforts to address security concerns and refine the feature are commendable, I just hope they haven’t missed the boat. We’ve already seen Apple quietly move forward with Apple Intelligence (clever) and it’s now embedded in MacOS. Microsoft need to move quick and innovate here to regain confidence and innovative is their mission to empower every person on the planet to achieve more (with their technology)!

Consumers, IT professionals, industry experts and social media will be keenly observing whether the Recall gets the release and value reputation it received back in June, with  a secure and functional version of Recall to define what AI can really do in Windows.

I hope succeeds and brings life to the new AI PCs and Copilot+PCs or of it quietly gets canceled as skeptics seem to think…

Posted on

Windows Hello is getting a much welcomed face-lift

Microsoft is taking a significant step forward in enhancing the Windows Hello experience on Windows 11. This overhaul, now in beta testing for Windows Insiders will bring a more intuitive and visually appealing interface for both facial, passkeys and fingerprint recognition.

New Windows Hello experience on Windows 11

Cleaner, More Intuitive UI

The revamped Windows Hello UI is designed to streamline the authentication process. Users will notice new iconography and visual changes that make switching between authentication options more intuitive. Whether you’re logging into your device or using passkeys for websites and apps, the experience is now more seamless and user-friendly.

Enhanced Passkey Integration

One of the standout features of this update is the improved passkey integration.

New passkey process in testing on Windows 11

Previously, using passkeys from a mobile device involved scanning QR codes and navigating an outdated UI. The new system simplifies this process, allowing for quicker and more secure authentication. Additionally, Microsoft has also introduced a new API for third-party password and passkey managers, enabling developers to integrate directly with the Windows Hello experience.

Future-Proofing Authentication

This update is not just about aesthetics; it’s about future-proofing authentication on Windows 11.

By supporting passkeys from mobile devices and enabling synchronization with third-party apps, Microsoft is ensuring that users have a secure and efficient way to manage their credentials and also allows them to be seemlessly and securely added to your Microsoft Account.

We redesigned Windows security credential user experiences for passkey creating a cleaner experience that supports secured and quick authentication.. Users will now be able to switch between authentication options and select passkey / devices more intuitively.

Microsoft Windows Team

Microsoft Windows team talk more about in their recent Windows Insider Blog.

Availability and Rollout

Currently available to Windows Insiders in the beta channel, and will hopefully hit testers on the other Insider channels soon. This new Windows Hello experience is expected to roll out to all Windows 11 users in the coming months.

Are you looking forward to seeing new Windows Hello UI?

Posted on

The Cost of Not Migrating to Windows 11

As Microsoft prepares to end support for Windows 10 on October 14, 2025, users have a critical decision to make. They must either migrate to Windows 11 or pay for extended security updates (ESU). Microsoft will offer distinct options for consumer (home) customers. They will also offer options for commercial customers who want or need to continue using Windows 10 after this date.

Consumer Pricing for ESU

We know that commercial enterprises were going to have the “cost” option of paying for extended updates while they “complete” they migration / move to Windows 11, but in the first time in history, Microsoft have also announced that consumers can will also have the option to purchase a single year of Extended Security Updates (ESU) for a one off $30 (£25) cost.

Commercial Pricing for ESU

Pricing to commercial customers will be based on tiered pricing options with pricing set-out at

  • $61 per device per year for the first year
  • $122 per device for the second year, and
  • $244 per device for the third year.

Organisations needed or wishing to pay for ESU for their devices for 3 years will therefore incur costs of $427 per device.

Extended Security Updates: A Temporary Solution

Microsoft’s ESU program will provide a lifeline in helping any organisation or consumer unable or unwilling to upgrade to Windows 11 before October 14th, 2025, (when Windows 10 enters end of support).

Bear in mind though that these ESU updates are just security and zero-day updates. There will be no new features, bug fixes, or technical support included.

These are, of course, optional, but there are huge risks for continuing to use Windows 10 devices without protection from security exploits or newly discovered vulnerabilities.

This is especially true for commercial organisations. They lack protection from security and vulnerability updates.

The Risks of Running an Unsupported OS

Running an operating system without security updates poses significant risks, both for consumers and businesses including:

  • Increased Vulnerability to Cyber Attacks: Without regular security patches, systems become prime targets for hackers. Vulnerabilities that are discovered post-support will remain unpatched, leaving systems exposed to malware, ransomware, and other cyber threats.
  • Compliance Issues: For businesses, using unsupported software can lead to non-compliance with industry regulations. It can also lead to non-compliance with standards. This may result in hefty fines and legal repercussions. This can also affect security certifications. These include Cyber Security and Cyber Security Plus. It also impacts trust from customers and business partners.
  • Operational Disruptions: Security breaches can cause significant downtime, disrupting business operations and leading to financial losses. For consumers, this could mean losing access to important personal data and services.
  • Higher Long-Term Costs: While the initial cost of ESU might seem manageable, the long-term financial impact of a security breach can be devastating.

The best approach is to start planning the move to Windows 11 now. There are just over eleven months to do this. For consumers, this could mean upgrading. It could also mean replacing their devices with ones capable of running Windows 11. Windows 11 was released and started shipping on new devices in 2021.

Will my device run Windows 11?

Microsoft have a useful website which show the minimum system specifications for Windows 11 which you can access –> here <-

In reality any device newer that 4-5 years old should have no problem running Windows 11, , but in short, you need a device with at least:

  • Processor: 1 GHz or faster and min of 2 core.
  • RAM: 4 GB or more.
  • Storage: 64 GB or larger storage device / HDD / SDRAM – you’ll much more in reality.
  • System Firmware: UEFI, Secure Boot capable.
  • TPM: Trusted Platform Module (TPM) version 2.0. (this is important)
  • Graphics Card: Compatible with DirectX 12 or later with WDDM 2.0 driver.
  • Display: High definition (720p) – must be greater than 9” diagonally.

Tools to check compatibility

Another really easy way to check your device (if you are a consumer of want to check a couple of devices) is to the use the PC HealthCheck App. This can be downloaded from https://aka.ms/GetPCHealthCheckApp if it’s not already installed on your Windows 10 device.

When you run the tool, you get one of three outcomes. If you device passes, you’ll see a “meets requirements” message, and if it fails, you’ll receive a “doesn’t currently meet”. Coprate devices may see a message stating that “your organisation manages updates” and as such check with IT department (though I suspect they are already on it!)

Commercial Customers IT departments can easily check Windows 11 eligibility using Microsoft Intune or System Centre.

Conclusion

The decision to stick with Windows 10 and not migrate to Windows 11 should not be taken lightly. While ESU provides a temporary solution, the risks associated with running an unsupported OS far outweigh the benefits.

The risks of not updating (or paying for extended security updates) are too high. It is only acceptable if your device is never connected to the internet. Additionally, you should avoid using external sources such as USB devices.

Upgrading to Windows 11 ensures continued security. It also provides access to the latest features and support. This makes it a wise investment for both consumers and businesses.

Q&A

  1. What about my anti-virus applications? In reality these will still work as will any application you are running on your machine. You will need to check with the antivirus provider to check that they will still support Windows 10, but as long as they do and you pay the subscription to them, it shouldn’t impact these anti-virus signature updates.
  2. What about other software like Office Apps? Well Office 2016 and Office 2019 also go end of support in October 2025. You’ll need to upgrade these too if you want to get feature updates and security updates and fixes. You will likely find other software vendors like Adobe will also stop supporting Windows 10 (as many did with Windows 7). You’ll need to check with the software provider.
  3. Can I upgrade the hardware in my device to get compliant? That is also an option. After running the compatibility checker, you may find that upgrading your hard drive, adding more memory or swapping other components may “get your device compliant”. In most cases this isn’t cost effective.

Posted on

Why Microsoft is updating Chat and Channels Experience in Teams

Microsoft Teams has long been a cornerstone for collaboration, and now, with its new chat and channels experience, it’s set to transform how we connect and collaborate even further, makimg it easier to stay in the flow and work with multiple chats and teams channels.

Video (c) Microsoft

Streamlined Communication for Enhanced Productivity

The redesigned interface prioritises ease of use, allowing users to effortlessly triage conversations and stay on top of their most important communications. Whether managing projects, coordinating with teams, or engaging in spontaneous brainstorming sessions, the new experience (which has been in testing for some time) has been designed to ensure that every interaction is seamless and impactful.

Key Features and Enhancements

Intuitive Design: The new layout is simple by default, yet powerful on demand. It’s designed to help users quickly find and respond to messages, reducing the time spent navigating through conversations.

New chat design interface in Teams

The @Mention View: This view in chat gathers all messages directed at you into a single interactive list, making it easier to prioritise and respond to important communications.

The new @ mention view in Teams Chat

Why these changes Matter

These updates are not just about aesthetics; they are about creating a more dynamic and intuitive user experience. By simplifying the interface and enhancing key functionalities, Microsoft Teams aims to boost productivity and ensure that users can collaborate more efficiently and effectively.

New Drag and drop chat and channels in Teams desktop and mobile apps.

User education and readiness

To support users and support staff on the adoption of these new features, Microsoft has provided a wealth of resources, including detailed blogs, instructional videos, and a dedicated microsite on the Microsoft Adoption Center.

These resources are designed to help IT leaders, IT pros, and end users understand and leverage the new capabilities to their fullest potential.


Microsoft is also hosting a live Ask Microsoft Anything (AMA) session on November 12, 2024, where users can see the new features in action and get their questions answered by Teams product experts.

Jeff Tepers’ blog goes into more detail, highlighting the new experience and how it will improve user experience and efficiency Jeff calls it “simple by default, powerful on demand.”

https://www.microsoft.com/en-us/microsoft-365/blog/2024/10/28/streamline-collaboration-with-the-new-chat-and-channels-experience-in-microsoft-teams/



Posted on

AI-PCs vs Copilot+ PCs: Understanding the Difference

As technology advances, the distinction between AI-PCs and Copilot+ PCs becomes increasingly important. Both types of devices leverage dedicated AI chip sets to enhance the user experience. They support new and upcoming software features. These devices prepare us for the continual wave of AI innovation. Under the name, what are the differences between the specifications and ability of these two types of “next generation” devices?

This blog aims to summarize the similarities and differences between the AI-PC, as dubbed by Intel. It also discusses the Copilot + range of PCs powered by Snapdragon ARM based chip sets.

The AI-PC

AI-PCs, like the Microsoft Surface Laptop 6, are powered by Intel chipsets and are the first of their next generation of personal computers designed to handle complex AI tasks efficiently. These PCs are equipped with Intel Core Ultra processors which also include a dedicated Neural Processing Unit (NPU), which accelerates AI and machine learning workloads directly on the device, providing up to 10 TOPS (Trillion Operations Per Second) of AI performance.

This means faster performance for tasks like real-time language translation, image creation, and enhanced multimedia experiences such as object removal, blur and audio isolation without relying heavily on cloud services or throttling the PCs CPU.

For the average user, this translates to a smoother, more responsive computing experience with smarter features. For IT professionals, it means robust performance for data-intensive applications and improved security through local processing and devices which will perform in a more unified way without “subtle” tasks like back-ground blur in video calls, hammering the CPU or consuming more internet bandwidth.

The Copilot + PC

Copilot+ PCs represent the pinnacle of AI-enhanced computing, designed to deliver unparalleled performance and support for AI-infused applications and extensions. These PCs are powered by Qualcomm’s Snapdragon X Series processors. They feature a turbocharged Neural Processing Uni (NPU). This NPU is capable of performing over 40 trillion operations per second (TOPS). This advanced hardware allows real-time AI functionalities. These include language translation, image generation, and intelligent task management directly on the device. For the average user, this means a seamless, responsive experience with smarter, more intuitive features. For IT pro’s Copilot+ PCs provide more robust performance for data-intensive and AI applications. They enhance security through local processing.

This can also reduce reliance on cloud services with the ability run “some” AI workloads locally depending on what has been coded of course by the software vendor. Examples of this might be background blur which as trivial as it may sound it network and compute intensive and can be performed on an NPU far better and with far less compute power.. This combination of powerful hardware and specialized software makes Copilot+ PCs a significant change in both personal and professional settings.

Copilot+ PCs, on the other hand, take this AI integration a step further. Some examples are the recently released Surface Laptop 7 and Surface Pro 11 devices from Microsoft. There are also devices from all other major manufacturers. These devices feature powerful and dedicated NPUs. They also come with Windows 11 – Copilot “exclusive” software and services enabled. These devices need Copilot+PCs to use them.

Interactions like “click-to-do” and Microsoft’s Recall leverage the advanced NPU’s capabilities. They provide enhanced AI features directly on the device. These interactions reduce CPU and GPU workloads. They allow local AI compute, which will in the long term support local language models.

These devices are powered by Qualcomm’s Snapdragon X series chips, which offer at least 45 TOPS of AI performance. This provides advanced functionalities such as real-time language translation and intelligent task management. It also enables more efficient multitasking. All of these features are included in the Windows 11 24H2 update.

Despite the differences, both AI-PCs and Copilot+ PCs bring enhanced performance for handling AI workloads. These devices provide a more integrated and advanced AI experience, thanks to the combination of powerful hardware and specialised software. At the time of writing the Copilot+ PC range deliver more AI-grunt than AI-PCs. However, the Intel-based AI-PCs will likely be more adopted by large enterprise organisations. These organisations still need to run older legacy applications. These applications have not yet been compiled to run on Windows on Arm (WoA). WoA is needed for Copilot+ PCs which are built on ARM chipsets and not Intel.

Spotting the Difference

The subtle differences between AI PCs and Copilot+ PCs. As endpoint technology continues to evolve, the gaps will most likely close. The 2025 edition of these technologies will continue to evolve. There is also new AI “optimised” PCs from AMD but I have not reviewed these here.

The main way to spot a Copilot+ PC or AI-PC vs an older generation device is the presence of a dedicated “Copilot key”.

The list below highlights the key things found on Copilot + PCs

  • AI Integration: Copilot+ PCs (currently) offer a more integrated AI experience. They include specialised software and features designed to enhance productivity. On the other hand, AI-PCs provide general AI capabilities without the specialized software. Copilot+ PCs are needed to run new Windows features like recall and Click-To-Do.
  • Dedicated AI Key: Copilot+ PCs include a dedicated Copilot key for quick access to AI-powered assistance. This key is not available in “some” AI-PCs. Older generation PCs also lack this feature.
  • Connectivity: Some Copilot+ PCs feature advanced connectivity options. These options include 5G, which is not typically found in AI-PCs or older generation devices.
  • Exclusive Software Features: Copilot+ PCs come with enhanced productivity tools like Recall and Click-To-Do. They also include other third-party features from Adobe, for example.

Conclusion

These new generation of AI-PCs and Copilot+ PCs bring more than just an annual chip set refresh. They are the ennoblement for the current and next wave of creativity. They drive productivity and innovation with the increasing number of AI-powered or AI-enhanced applications.

As always, Surface sets the standard – with their innovative anti reflective and HDR display technology, elegant and sleek design, sustainable and repairable design and unique features like the versatile kickstand along with fluidity of the Slim Pen 2 on Surface Pro, they empower users to achieve more and create without limits.

Proudly powered by WordPress