Category: Collaboration and Productivity

Posted on

Microsoft 365 Copilot Adoption: Practice Makes Perfect

As we all get back into the flow of work following the Christmas and New Year break, Microsoft continue to announce new features for Microsoft 365 Copilot.

Microsoft 365 Copilot has been available to “everyone” to buy and use now for a year now and it’ actually hard to conceive that it only actually ben 12 months! That said, I know hundreds of organisations that are using it every day and getting a great experience from it. I also know others (and people in my own organisation that have a bit more of a “hmmmmm and it’s ok” mindset to Copilot.

As I head back into my first full week at work with Copilot at my side, it’s worth looking at just how far it has come. From taking notes and summarising content, helping me catch up things I have missed (or forgotten) and evening being my companion to help me thrash out ideas, explain things, get a different opinion – Copilot is by my side.

Copilot is like that tireless colleague who’s always ready to lend a hand, doesn’t get tired, doesn’t take a lunch a break and doesn’t need to pop out for a coffee when I need it! I often describe Copilot as a drunk intern, in that it adds huge amounts of value to my day, but it doesn’t solve every work problem, nor can it assist with every task. It can’t make decisions for me, do my executive reports, remember to do things for me (there’s other tools for that) and can’t actually do my job for me. Microsoft 365 Copilot is a tool, a powerful tool, but like any tool, its effectiveness hinges on how you use it and more importantly how you don’t!

Having helped many customers and seen the results it can have, as well as my own experience of integrating Copilot into my daily work (and personal online life) routine, it takes time. It not as simple as allocating a licensing and clicking the Copilot button. Good adoption and useful results require practice (lots), sharing what works, and an understanding of its capabilities and limitations. In this blog. I share a few little tips we have learned on the way, coupled with some tips to see value every day.

1. Results may not be instant – Practice makes perfect

You may hear people say “it is rubbish” or “it didn’t do what I thought”, or “Copilot can’t help me in my job”.

This is sometimes true, but nearly all of the time, it is simply not! Copilot can certainly help you brainstorm ideas, answer questions, explain content and even get a third person review on something you have created, but it it is not going to transform you into a master mathematician, coder, web designer or salesman overnight.

Like learning a new musical instrument (my son is learning the trumpet at the moment) or a language, it takes time (and patience) to get the hand of pretty much any tool.

Success comes (and I see it every day) by embrace the learning curve, trying new things and giving yourself room to grow alongside this technology which is constantly evolving and improving. Working with Generative AI is a totally different way of working with technology so give yourself time to work with it. There is no AI Natives (yet!).

2. Don’t get fired – Copilot for everyone but not for everything!

Think of Copilot as your co-pilot, not as the captain of your work. Copilot is there to assist you in what you do but not to take over. While it might draft a great email or executive summary, help you expand on a point or explain something, only you (as the Pilot) can ensure it aligns with your objectives and ask and that what it produces resonates with your audience.

Remember you are accountable for what Copilot produces for you – Copilot is the co-pilot. You are always in command. Copilot will remind of this, but do. Check the content, is it what you needed and asked for. Does it seem correct, read well and has it used the right content and context. If Copilot get’s it wrong, its your block on the line not Copilot’s.

Your expertise and personal touch are irreplaceable, and you are still responsible for what it produces. Don’t look silly buy not checking what it produces!

3. Remember you are human – It is not!

The Human Touch is everything. For example, when using Copilot to write or reply to a sensitive email, or when writing a personal response to something, Copilot can absolutely provide you with a solid starting point or provide guidance on how to write it.

We have all read those emails comms that are so obviously written by AI. It’s easy to spot an email from someone you know that has clearly left AI to write for them!

Empathy, nuance, and authenticity and the way in which you communicate is what makes you. It’s important to use what Copilot (or an AI) creates as a draft or a guide and ensure you inject your personality and insights to make your communication truly impactful and truly you.

4. Copilot is not a mind reader – be clear in your asks

Copilot doesn’t inherently understand the nuances of your specific situation, so back to my drunk intern analogy, you need to give it context around what you want your assistant to do.

Copilot can “summarise a report” but won’t know how you would like this summarised, the tone you woudl like, who you are summarising it for and how long you want it unless you tell it. Be explicit about the how you want the output (the goal), the context of what you need, and your expectations for how you want the output to be presented.

Remember the formula for Copilot promoting is G.C.S.E – Goal, Context, Expectations and Source.

5. Don’t leave sensitivity to chance

Microsoft 365 Copilot will adhere to your company identity and access management, respect DLP policies and even understand sensitivity labels if they are used.

Many organisations however do not use these (though are starting too), but regardless, make sure you check that you are not feeding Copilot confidential customer information when creating responses for other customers or sharing internal information that is not supposed to be shared.

People get scared that Copilot may share sensitive information. Since Copilot is the assistant and not the author, you are responsible for checking that the data you have fed it (or referenced) can be used and shared externally.

There are new tools coming to help users better protect privacy and for IT / Sec to control what Copilot accesses, but it’s still “on you”. Remember Copilot can’t get the sack – you can!

6. Copilot will not replace learning but it can help you learn.

Some like to portray that they are an expert over night with AI tools like Copilot. Sure Copilot is great at simplify complex concepts or helping you know how to do something in say Excel or Word. Copilot is also really great at helping you understand seomthing, can explain something complex “as if i am a 10 year old” and so on, but it’s not a substitute for your own learning journey.

That said, I find Copilot is great for helping you to learn something. It can help you “learn” the basics about a topic, put things into different perspectives, and even help map learning paths and helps you find resources. At the end of the day, it is still you that will learn what you are learning, but Copilot is really great at helping you learn in your way…

7. Copilot has an appauling memory

One fo the things Copilot is really bad at (by design currently) uis remembering things. This mean that not only will it not ask you how that report went, or if your customer replied to the email it helped you write.

In fact Copilot cannot (currently) evcen remeber past convrsations or preferences so once you “start a new conversation”, all history of that task you were working are forgotten.

As a tip – I tend to have a couple of chats running in parallel so I can switch between contexts as I need to. ChatGPT now has this capability to imagine* it is only time before this comes to Microsoft 365 Copilot

8. The Roadmap is every changing

The last time I looked, there was 112 new features in development and 18 that are currently “rolling out”. This AI technology is evolving rapidly and Copilot is no exception.

New features and improvements roll out regularly. It’s worth checking on the Microsoft 365 Roadmap from time to time to ensure you stay informed about what is coming. There are also a plethor of blogs like this one, user communities, webinars and formal training to help you stay abreast of the latest innovations and tips.

Knowledge is power – the more you know, the more you can leverage Copilot to your advantage.

9. Integrate Copilot into your daily routine

Consistency is key. Copilot really adds avlue when you use it little and often and when it’s seamlessly woven into your daily workflow. Here are some reaaly simple habits to form:

  • Start your week with a recap: Use Copilot to remind you of any emails you did not repond to last week from your peers or boss, to prepare you for your upcoming meetings, or to sugegst a date your team (rememeber it knows who works for you) are available for an afternoon off-site.
  • Start Your Day with Copilot: Use Copilot in the morning to outline your your day, important tasks or get you up-to-date on something. You will soon be able to schedule Copilot to do certain tasks for you.
  • Catch on and control your meetings: One of Copilot’s hero capabilities is to help ypou catch up on a meeting you missed, take notes for you in a meeting and even help keep the meeting flowing.
  • Remeber your GCSEs: Before engaging with Copilot, know what the Goal is you are trying to achieve. Give Copilot context on how you wnat it done and ensure it knows what you expect. Clear questions yield better answers.
  • Share and Collaborate: Encourage your team to adopt Copilot and share tips. Collective learning amplifies benefits.

The true power of Copilot lies in how you incorporate it into your daily routine:

10. Don’t Give up

You may not always get the instant results, don’t give up. Ttry again, ask others what works for them and check out help and guidance. There’s loads.

  • Stay Curious and ensure you experiment with different prompts and functions. You might discover new ways Copilot can assist you.
  • Reflect Regularly by taking time to assess how Copilot is impacting your work. Adjust your approach as needed to maximise benefits.
  • Share your success so other can benefit from what you have learned and what works best for you.

Final Tips

Microsoft 365 Copilot is a remarkable assistant that can amplify your productivity, spark innovation, and even make mundane tasks more manageable. But remember, it’s a tool designed to enhance your capabilities – not replace them. By using it thoughtfully, staying informed about its features, and integrating it into good work habits, you can unlock its full potential.

Technology is a force multiplier, but it’s the human element that truly makes the difference. Copilot offers incredible capabilities, but it’s up to you to wield them effectively. Use it wisely, continue to learn, and keep pushing the boundaries of what’s possible. Your proactive engagement and thoughtful application are what turn a powerful tool into transformative results. So take charge, embrace the technology, and watch how it elevates the work you do every daym, little my little, bit my bit can make a huge difference in a week.

Oh and don’t forget to share your successes with others.

Posted on

The Future of AI Agents and shift to Agentic AI

Image of Satya Nadella

In a recent podcast episode with Bill Gurley and Brad Gerstner, Satya Nadella – CEO of Microsoft, discussed a wide range of topics related to his role at Microsoft, the state of the technology, business growth and capitalism in this new “AI Era”.

The podcast which you can watch on YouTube here covered some interesting topics including the Future of AI Agents and their potential to transform how we interact with technology. In this blog (worth a listen), Satya gives his predications/insights into the future of AI Agents and emphasises that AI agents will fundamentally change the landscape of software-as-a-service (SaaS) solutions, predicting that the traditional notion of business applications will collapse in the era of agentic AI.

What is Agentic AI?

Agentic AI refers to artificial intelligence systems that can make decisions and take actions autonomously, without direct human intervention. These systems are designed to perceive their environment, reason about the best course of action, and execute tasks independently. In short these agents are designed to function as workplace teammates, capable of handling various tasks across different applications.

As example, in e-commerce platforms, instead of static, rule based chatbots, agentic AI-driven systems can track a customer’s journey, personalised recommendations, and assist with returns seamlessly without user / supervisor input. These agents will be able to actively learn from interactions, optimising the customer journey in real time and learning about user preferences.

Agentic AI typically inhibits the following features:

  • Autonomy: Agentic AI systems can operate independently, making decisions based on input data and predefined goals.
  • Adaptability: These systems can adapt to changing circumstances and inputs, adjusting their actions to achieve their objectives.
  • Proactivity: Agentic AI can anticipate user needs and take actions without explicit instructions, making them more proactive in their behavior.
  • Collaboration: In the future, agentic AI systems will be able to work together in multi-agent networks, collaborating to handle complex tasks that a single agent cannot manage alone.

Changes Ahead for AI Agents

The video / podcast is an hour and a half (but an enjoyable and informative listen). Reading between the sections, Satya talks extensively about where he sees AI Agents evolving massively through 2025. I have summarised this below.

Increasing Sophistication and Capabilities

AI agents will become increasingly sophisticated and capable, eventually replacing traditional software applications. These agents will be able to understand and anticipate user needs, providing personalised and proactive assistance. They will leverage advanced natural language processing (NLP) and machine learning algorithms to interact with users in a more human-like manner.

Autonomous AI Agents

Through 2025. we will see autonomous AI agents handle more and more complex tasks with minimal human oversight, optimising workflows and enhancing efficiency across industries. These agents will streamline workflows, manage intricate operations, and simplify everyday activities. For example, OpenAI’s “Operator Agents” will autonomously execute multi-step processes, such as scheduling meetings or managing projects.

Multi-Agent Networks

Sayta talks abiut the “future” being a place that is not about singular agents but more about networks or systems of agents where agents can discover and collaborate with other agents. These multi-agent networks will enable agents to handle tasks that they can’t do themselves by invoking other agents (agents talking to other agents). This collaborative approach will enhance the overall capabilities and efficiency of AI agents.

Vertical AI Agents

Vertical AI agents, which are specialised for specific industries, are expected to have their moment in 2025. These agents will dominate their respective fields by offering tailored solutions that address industry-specific challenges. For example, retail AI agents will act as personal shoppers, offering personalised recommendations and optimising inventory management.

Persistent Memory and Personalisation

AI systems with persistent memory will enable highly personalized interactions, transforming AI into long-term companions that adapt to user preferences and habits. This capability will allow AI agents to provide more relevant and context-aware assistance, enhancing user experiences.

Emotional Intelligence

Future AI agents are expected to possess emotional intelligence, allowing them to understand and respond to human emotions. This will enable more empathetic and effective interactions, particularly in customer service and healthcare settings.

Integration with IoT and Personal Devices

AI agents will increasingly integrate with the Internet of Things (IoT) and personal devices. This integration will enable seamless interactions across various platforms and devices, creating a more connected and efficient ecosystem. For example, AI agents in smart homes will manage household tasks, monitor energy usage, and provide personalized recommendations.

Ethical AI and Transparency

As AI agents become more prevalent, there will be a greater emphasis on ethical AI and transparency in decision-making. Ensuring that AI agents operate responsibly and transparently will be crucial for gaining user trust and acceptance. This includes addressing issues related to data privacy, bias, and accountability.

Proactive AI Agents

Proactive AI agents will anticipate user needs and take actions without explicit instructions. For example, an AI assistant might reorganize your day based on traffic updates and weather, reschedule missed appointments, and even draft personalized messages. This proactive approach will make AI agents more valuable and indispensable in daily life.

Enhanced Communication and Collaboration Tools

AI agents will enhance communication and collaboration tools, making it easier for teams to work together. These agents will facilitate real-time collaboration, manage project timelines, and provide insights to improve productivity. They will also assist in content creation, research, and workflow automation.

Shift and the of SaaS apps?

Another interesting section to listen too is at around 31 minutes, where Satya talks about his vision of how AI agents could potentially replace traditional SaaS (Software as a Service) applications. Whilst something that will not happen over night, he talked about the shift from business apps with connectors into other apps, but in an agent to agent and agent to back-end system.

We can already have connectors into applications like SAP, Dynamics etc. A great quote he used was “when was the last time any of us really went to a business application” In the AI age, we access the data in these systems from a mesh of data sources which over time, these back-end SaaS systems would eventually become obsolete as AI agents take over multi-repository CRUD (Create, Read, Update, Delete) operations. This shift would lead to the collapse of conventional business applications, with AI agents handling the core logic.

The idea will be that you simply pull information from systems through AI Agents such as looking up customer details, updating inventories, changing a contact in NetSuite CRM for example or checking delivery status for an order.

Other examples, Sayta talked about with regards AI Agents included:

Infinite Memory: He explained that infinite memory refers to the ability of AI agents to retain and recall information over extended periods, much like a human’s long-term memory. This capability will allows AI agents to build on past interactions and experiences, making them more effective and personalized in their responses and actions.

Proactive Task Management: AI agents are envisioned to operate autonomously, handling complex tasks such as processing customer returns, managing shipping invoices, and optimizing supply chain operations. This proactive approach reduces the reliance on user-initiated interactions, further diminishing the need for traditional SaaS applications.

Automation of Business Logic: Satya explained that AI agents would be able to automate many backend business processes, creating a new tier of multi-agent orchestration. This means that business logic, which is currently hardcoded into individual applications, will be managed by AI agents across multiple apps or databases and will adapt based on useage and need.

Integration with Existing Tools: Nadella highlighted the integration of Python with Excel as an example. AI agents can use Excel’s visualisation capabilities for advanced tasks, transforming it into a more intelligent and autonomous tool. This integration demonstrates how AI agents can enhance existing applications, making them more efficient and reducing the need for traditional SaaS apps.

Posted on

My 2024 year in Blogs Recap

This blog takes a stroll back down the 2024 memory lane and looks at some of the highlights I have seen through 2024 from a technology (I fo.cus here mainly on Cisco and Microsoft) and what we achived at Cisilion – where I’m the CTO. We are sarting with January and working thriugh to December 2024.

January 2024

February 2024

  • Cisilion opened our new corporate brand and also opened our new Client Experience Centre. Technological Innovation and Personalised Engagement in the Era of Digital Collaboration – News & Blog – Cisilion. This included new logo, new corporate values and a new website https://www.cisilion.com. We reimaged our values of Trust, Excellence and Agility and are embedding these across all we do.
  • Cisilion were also crowned one of 17 partners in the UK as Microsoft Cyber Security Investment Partner due to our exemplar work in helping organisations leverage the best of Microsoft Threat Protection, Identity and Access Control and Data Protection.
  • Cisco Live 2024 saw over 16,000 people – the largest in person attendance in more than 6 years. The theme was very much aligned with the industry buzz and innovation around AI with Cisco emphatic statement “there is no AI without a network”. This was very much the theme and focussed on Cisco’s innovations and vision around the network and Data Centre fabric for the AI era that is among us. 

Mar 2024

  • Cisco completed the acquisition of Splunk which they acquired in November 2023 for $28billion.Cisco say that the combination of Cisco and Splunk will provide truly comprehensive visibility and insights across an organization’s entire digital footprint, delivering an unprecedented level of resilience through the most extensive and powerful security and observability product portfolio on the market.
  • Microsoft Security Copilot goes Generally Available: and is priced on PAYG basis. Microsoft’s Copilot for Security available April 1st – Modern Work and AI Blog
Cisco and Splunk

April 2024

  • Cloud Security: Cisco Announces Cisco Hypershield . Not planned for release until sometime in 2025, Hypershield is different to traditional security products and is integrated directly into the network’s fabric, offering a revolutionary approach to protecting digital infrastructure services in data centres, protecting applications, devices, and data across public and private data centers, clouds, and physical locations.Cisco Hypershield: New Era of Distributed, AI-Native Security

May 2024

  • The AI Powered PC: Microsoft announce the next generation of Computing with the Copilot+ PC, built in partnership with Qualcomm. At the heart of the Copilot+ PCs lies groundbreaking ARM CPU and NPU technology, capable of over 45 trillion operations per second, powering a new era of AI experiences on Windows PCs. They are designed to run AI workloads with unprecedented efficiency and speed, outperforming competitors and enabling features like Recall, Cocreator, and Live Captions. These will power the next wave of edge AI. https://robquickenden.blog/2024/05/sufacepro11-laptop7/
Copilot+ PC

June 2024

July 2024

News: Global Outage

  • CrowdStrike update bug causes global IT outages as update bricks Windows devices and costs the economy big time with flights grounded and huge disruption everywhere.

How did CrowdStrike causes Windows Screen Recovery loop on millions of Windows devices

Cyber Security

Fun and creativity

August 2024

September 2024

News: Cyber Security

Security:

Customer Success:

October 2024

Work

November 2024

December 2024

Accreditations:

Happy and prosperous 2025

I’d finally like to thank all my followers and subscribers a very happy new year!

Posted on

Windows 11: Using your camera in multiple apps simultaneously

Windows 11 is set to make a huge change to how we use cameras and webcams on Windows 11 PCs with the introduction of advanced camera features. These new functionalities, currently available in the Windows 11 Insider Preview Build in the Dev Channel, promise to enhance accessibility and usability for a wide range of users.

Previously, Windows allowed camera access to only one application at a time, which caused conflicts and limited multitasking capabilities. With this new feature, multiple applications can now access and utilise the camera feed simultaneously.

Key Features and Benefits

  • Multi-App Camera Support: One of the standout features is the ability for multiple applications to be able to access your devices camera/webcam at the same time. This is particularly beneficial for people who need to stream video to different platforms at the same time. For instance, remote workers can now participate in multiple virtual meetings without needing to switch between applications (and turn off their cameras), and in the consumer space, gamers can stream their gameplay on various platforms concurrently.
  • Basic Camera Function: Designed to improve stability of “older” webcams and deices and to help with debugging, Microsoft are introducing a feature limiting the webcam’s features to the essentials. This ensures that the camera can operate at its most basic level, which is useful if other features are causing issues.
  • Enhanced Accessibility: Developed in conjunction with accessibility and hard-of-hearing community, the multi-app support feature also enables video streaming to both a sign language interpreter and the end audience simultaneously. This could be a significant step forward in making technology more inclusive and accessible.

Use Cases

  • Remote Work and Collaboration: With the multi-app camera support, professionals working from home can join multiple video conferences at once, making it easier to manage different meetings and collaborations without the hassle of switching between apps.
  • Content Creation and Streaming: Gamers and content creators will find the new features particularly useful. They can now stream their content on multiple platforms simultaneously, reaching a broader audience and enhancing their streaming capabilities.
  • Educational Purposes: Teachers and educators can leverage these features to conduct virtual classes more effectively. For example, they can stream their lessons to different platforms or groups of students at the same time, ensuring that everyone has access to the content.

Enabling and using the Feature

You need to be running Windows Insider Build 26120.2702 or later.

To activate the feature, users need to head over to settings and enable the “Multi-App Camera” setting by toggling it on as shown in the screenshot below.

Advanced Camera Controls in Windows 11

Once enabled you’ll be able to use your camera(s) in multiple apps. The shot below shows the camera app and a Teams video call using the same camera simultenuously.

Still more to come

Microsoft has also said that more options are coming in the advanced camera settings, including the ability to choose and customise things like resolution and frame rate for the webcam/Camera(s).

These enhancements (also fed by user feedback from the Windows Feedback Hub), will provide users with greater control over their camera settings, allowing for a more customised and optimised experience.

Posted on

Streamlining Copilot Adoption: Reducing Data Oversharing in Microsoft 365

One of the concerns I often talk to organisations about, is the fear that Copilot might surface sensitive information that it should not have access to due to IT/Compliance teams not really knowing who has access to what. The phrase “Security through obscurity” is often what we heard being used.

The primary cause of this is the over-permissioning and sharing of files, which is a growing concern for organisations and one of the “blockers” often cited in Copilot Adoption.

The over-sharing problem

The ability to reason over employee data and shared organisational data is one of Microsoft 365 Copilot’s strengths over other Gen AI tools (that need feeding). These responses Copilot gives and the content it creates rely on access to data that the user already has access to across their organisation’s Microsoft 365 environment. And here often lies the problem. If an organisation has low levels of data governance, no data classification and labelling, combined with high levels of over-sharing can create real concerns for IT and Data Compliance teams.

One of the reasons that Copilot often has access to data that it “perhaps” shouldn’t have is not due to security flaw or issue across Copilot or Microsoft 365, but because files or sites have been shared too widely and have no (or the wrong) privacy and sensitivity set. Addressing this is no small task since many organisations will have million of files and tens of thousands of SharePoint and Teams sites.

Organisations and even teams within organisations often operate at various levels of maturity in governing SharePoint data. While some orgaanisations strictly monitor permissions and oversharing of content, others do not. The situation is further complicated because many people, teams and organisations have “legitimate” reasons to share “some” data widely within the organisation. This can mean users in your organisation may make choices that result in the oversharing of SharePoint content. As an example

  • Users may save critical files in locations accessible to a wider audience than intended.
  • Users may prefer sharing content with large groups rather than specific individuals.
  • Users might not pay close attention to permissions when uploading files.
  • Users may not understand how to use sensitivity labelling (if enabled) to control access.

Services such as Microsoft SharePoint and Microsoft Copilot for Microsoft 365 utilise all data to which individual users have at least View permissions, which might include broadly shared files that the user is unaware of. As a result, users might see these applications as exposing content that was overshared. Oversharing can lead to sensitive information being exposed to unintended recipients. Users, while well intentioned, might not always grasp the implications of their sharing choices. They might overlook permissions or opt for convenience over security.

As a result, it’s important to use the permission models in SharePoint to ensure the right users or groups have the right access to the right content within your organisation. The following sections describe the key steps that administrators can implement to configure their SharePoint permissions model to help prevent data oversharing.

Dealing with Oversharing

The good news is that Microsoft is adding new features to SharePoint and Purview to make it easier to see, understand and control over sharing across Microsoft 365 with a hope to help adoption efforts and wider roll out of Microsoft 365 Copilot. This includes new Data Security Posture Management (DSPM) and enhancements for Data Loss Prevention policies in Microsoft 365 Copilot, and SharePoint Advanced Management. These can help automate site access reviews at scale and add controls to restrict access to sites if they contain highly sensitive information.

Microsoft have also released a blueprint guide for organisations planning to or deploying Copilot. These are nicely tailored to adjust to those with mainly Microsoft 365 E3 and E5 licenses respectively.

These new tools IMO are going to be vital to help organisation understand and address oversharing so they feel more feel confident in their employees adopting AI tools like Microsoft 365 Copilot.

AI is really good at finding information, and it can surface more information than you would have expected. This is why it’s really important to address oversharing. Typically, these issues are a by-product of good collaboration, particularly across Teams, SharePoint sites and OneDrive.

Alex Pozin | Director of Product Marketing | Microsoft

From early 2025, Microsoft will make access to SharePoint Advanced Management (SAM) available at no extra cost to Microsoft 365 Copilot subscriptions. Outside of this, SharePoint premium (which includes SAM ) will be available at a cost of around $3 per user each month.)

New Capabilities in SharePoint Advanced Management

There are also new features for SAM that Microsoft says will provide greater control over access to SharePoint files. 

  • New permission state reports (available now) can identify “overshared” SharePoint sites. The site access review feature can then provide a easy way to ask site owners to review and address permissions.
  • Restricted Content Discovery – which should start to roll out this month in public preview (December 2024), will allow IT admins to prevent Copilot from searching and processing data in specific sites for content and result generation. This does not prevent direct access to the site meaning that users can access the content directly as normal. This feature builds on the SharePoint Restricted Access Control, which was released last year, and lets IT admins restrict site access to specific sites to just “site owners” only, while also preventing Copilot from indexing and summarising files in these sites.

One of the use cases for this, are for where there are data locations containing information that needs to be contained to a set of people – such as financial reports, M&A planning, amnd other secret stuff. IT need to be confident that these locations and files will not show up in SharePoint searches and will be well out the reach of Copilot or other AI tools, essentially making sure that nobody can accidently or unintentionally be aware of, see or access the content. This is where Restricted Content Discovery comes in – locking down and hiding this information from plain site and from Copilot’s retrieval augmentation and indexing.

New Capabilities in Microsoft Purview

Microsoft are also adding new capabilities in Purview too. Purview is available as standalone or is part of Microsoft 365 E5.

/

Microsoft Purview is a centralised hub within Microsoft 365 that helps organisations meet regulatory and compliance requirements. It helps organisations manage their compliance obligations, protect sensitive data, and mitigate risks within their Microsoft 365 environment.

Here, there are new tools to help identify “overshared files” that can be accessed by Copilot. These includes oversharing assessments for Microsoft 365 Copilot in the Data Security Posture Management (DPSM) tool which is now in Public Preview (from December 2024) and can be accessed via the newly revamped Purview portal.

DSPM Portal in Microsoft Purview

The oversharing assessments are designed to highlight data that may present exposure risk by scanning files for sensitive data and identifying data repositories such as SharePoint and Teams sites where access permissions appear to be too wide and broad. The tool will also provide recommendations to admins and site owners for ways to mitigate oversharing risk, such as adding sensitivity labels or restricting access from SharePoint.

For example, DSPM can detect and help you deal with controlling ethical behaviour in AI (example demo environment below). For all the recommendation, Microsoft provides a simple step by step “wizard” to help IT and Compliance add policies.


Microsoft Purview Data Loss Prevention for Microsoft 365 Copilot, also in public preview, enables IT and security admins to create data loss prevention (DLP) policies to exclude certain documents from being processed by Copilot based on a the file or sites sensitivity label. This applies to files held in SharePoint and OneDrive, but can be configured at other levels, such as group, site, and user, to provide more flexibility around who can access what.

Insider Risk Management has also been updated to detect “risky AI usage.” This even includes user prompts that contain sensitive information and attempts by users to access unauthorised sensitive information. What’s key to note here is that this feature is not just limited to Microsoft 365 Copilot and also also covers Copilot Studio, and ChatGPT Enterprise.

Oversharing Blue Prints

I really like this. Microsoft’s new blueprint resource pages on Microsoft Learn provide recommended approaches and guidance for organisations to help them understand, mitigate and manage oversharing during what they define as the three main stages of Microsoft 365 Copilot deployment.

  • Pilot [Pilot]
  • Wider Deployment [Deploy at Scale]
  • Organisational Rollout [Operate]

Microsoft provide two blueprint designs. A “foundational path” and what they call an “optimised path” that uses some of the more Microsoft 365 advanced data security and governance tools found in Microsoft 365 E5 subscriptions.

Is there funding available to help?

It depends – but most likely!

Microsoft have a Cyber Security Investment Program open to select/specialist partners like Cisilion. These provide funded workshops, assessments and proof of value deployments across key Security workloads including Microsoft Purview as well as structured Copilot pilot deployments, vision and value

Organisations should speak to their Microsoft Solutions Partner for more information. You can contact Cisilion here should you need to.

Conclusion

In many of the discussions I and my team at Cisilion have with customers, we see that almost all of the organisations we work still have concerns over data governance in the realm of AI access. Of these most expect Microsoft to help them address these whilst some have already invested in third party tools to help them get a “grip” on their data and sharing.

We have seen a plethora of customers invest/upgrade to high-tier Microsoft 365 plans (including E5 Security and Compliance) or full Microsoft 365 E5 in order to gain access to Microsoft Purview. Some argue these tools should be provided as part of their Copilot investment, so it is great to see Microsoft meeting customers in the middle and at least providing some of these tools as part of this license investment.

The issue is not Copilot per-say, but it is that Copilot with it’s ability to access compnay data is causing more organisations to double down and look at the existing issues they have of too many SharePoint Sites, too much over sharing, orphaned data (data with no owner) inadequate data classification and labeling.

By addressing security and data governance and levering the new tools available, this at least should solve one of the blockers to AI adoption.

The second is Adoption and Change Management – more on that in the next blog post!

Useful links.

Posted on

Facilitator agent: Live AI notes in Teams meetings & chat

Microsoft announced at Ignite, the new Facilitator agent – an update to the AI notes in Teams that works inside your meetings and chat and is designed to enhance collaboration and streamline the way teams work. It works similar to the AI generated notes after a meeting, but this works live alongside you and all participants can see it working live in the meeting.

How Facilitator works in Teams Meetings

Facilitator will take real-time notes during Teams meetings (not currently adhoc meetings or Meet Now), enabling everyone to co-author and collaborate seamlessly. This allows meeting participants to focus and engage more deeply in meetings, while ensuring alignment before the meeting concludes.

To enable this feature and use it a meeting, organisers can toggle AI-generated notes setting on or off when setting up a meeting in the Teams calendar or enable it during the meeting via the Notes section in the meeting.

Once enabled, a notification appears in the meeting chat to inform all participants. This also activates meeting transcription, with a notification to users… During the meeting, participants can click on Notes to open a pane where the AI generated live notes are created every few minutes, organised by topics and follow-up tasks.

What is nice about this is that participants can edit the notes inline or assign tasks to users, with attributions indicating whether the content is AI-generated or user-edited making these Co authored notes by humans and AI!

After the meeting ends, notes continue to be accessible in the Recap tab and are stored in the OneDrive of the user who enabled real-time notes. These notes are contextual to the meeting transcript, ensuring relevance and accuracy.

Future Capabilities in Meetings

As the Facilitator agent gets developed futrther, Microsoft say that it will be able to take on more tasks to enhance meeting effectiveness. Soon, it will also manage meetings from end-to-end, including managing agendas, moderating discussions, and handling action items automatically or semi-automatically

In early 2025, the real-time note-taking experience will also expand to Microsoft Teams Rooms. Employees will be able to invite a Teams Room to a meeting, allowing all participants to see real-time notes however, they have joined the meeting. This feature will also be available for ad-hoc meetings, enabling in-office discussions to be captured seamlessly.

How Facilitator works in Teams Chats

As of now (November 2024), the Facilitator Agent creates and maintains up-to-date summaries of what it considers valuable information within Teams chats. This includes key decisions, action items, and open questions, helping groups stay focused, align faster, and resolve issues efficiently.

AI-generated notes are automatically enabled when creating a new chat. For existing chats, users can toggle it on via the Notes icon which is shown at the top right of the chat window as shown below.

When notes are enabled, a notification appears in the group chat to inform everyone that notes are being taken in real time.

To access the notes users simply click on the Notes icon in the top right corner of the chat to show a summary of the chat thread, organised by topics with corresponding decisions, action items, and unanswered questions.

These are continuously updated as the chat conversation progresses.

Availability and access

Facilitator is already in public preview now for desktop (Windows/Mac), web, and iOS/Android. To access the public preview of the new Facilitator agent, meeting hosts need a Microsoft 365 Copilot license.

Facilitator will only be available to users that have app permission policy for Microsoft apps set to “Allow all apps”. The Facilitator App will become available soon for Admins to see and manage in Teams admin center. For more information about app permission policies, see Manage app permission policies in Microsoft Teams – Microsoft Teams | Microsoft Learn

External users cannot access AI-generated notes

Let me know if you find this helpful

Posted on

Microsoft’s Copilot AI Agents enter Public Preview

TL;DR

Microsoft has introduced autonomous Copilot AI agents in public preview. These agents can learn, adapt, and make decisions, aiming to assist employees with various tasks and improve productivity. While AI has the potential to displace some jobs, it also creates new opportunities and enhances productivity.

Microsoft’s wave of Autonomous agents are here

Microsoft has unveiled new tools designed to help businesses create software agents powered by foundation models, referred to as autonomous Copilot AI agents. These agents are currently available in public preview.

Copilot is Microsoft’s generic term for all their AI-driven productivity workloads. Copilot is built upon the advanced GPT-4 series of large language models by OpenAI and offers a chatbot interface where users can input text, images, or audio prompts to receive responses tailored to their needs. Microsoft 365 Copilot also seamlessly integrates with Microsoft Office applications like Word, Teams, and Excel. It can generate documents, analyse extensive Excel spreadsheets, summarise meetings content, rewrite documents, create entire PowerPoint presentations and even reason over your inbox and company information you have access too….., and much, much more.

The next step in Microsoft 365 Copilot’s advancement is through what are termed AI-Agents, which are chat bots that can not only respond but can also perform a series of linked tasks (actions) based on user instructions. This new wave went into public preview this week at Microsoft Ignite in Chicago.

What are Microsoft 365 Copilot Agents?

This first stage of the next phase of evolution comes with Microsoft introducing a set of Microsoft 365 Copilot agents with predefined roles. These include:

  • Agents in SharePoint. These can be customers with a personalised name and certain behaviours, and can be shared across emails, meetings and chats, with users being able to ask the agents questions and getting real-time responses. These are grounded just on the SharePoint sites and files you specify. One created, employees can ask the agents questions about data across your files. These agents can even be shared or published in Teams for simple access.
  • The Employee Self-Service Agent in Microsoft 365 Copilot Business Chat (this currently in private preview), will be able to respond to specific HR and IT questions. It can retrieve employee benefits and even things like payroll info and holiday information, or request help from IT such as a new mouse, password reset etc.
  • The Facilitator agent (in public preview), works like a assistant in meetings and goes beyond the current AI notes that Teams Premium offers. It can take notes, curate actions and even pull up information or execute instructions such as “see if Bob is free and invite him to the meeting”. It will also be able to summarise the conversations based on the role of the participants.
  • The Interpreter agent (due in preview in early  2025) promises real-time interpretation in Teams meetings in up to nine languages. It will also be able to sample and then simulate their personal voice for a more inclusive experience as part of the translation, essentially using the sound of your voice in the language of the other participants. It was great to see this in action at ignite in a live demo!
  • The Project Manager agent, will be able to act and work like a PM with the ability to automate project management, from planning to execution using Microsoft (and later other) project tools like Planner.

For organisations that need more control or different templates to build on and use, Microsoft Copilot Studio provides a way to customise or create your own AI agent behaviour.

Agents in Copilot Studio

Agents built in Copilot Studio can operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention,These autonomous agents can be triggered by data changes, events, and other background tasks – and not just through chat.

Copilot Studio bundles many templates for common agent scenarios that can serve as the basis for a customised version. It will also shortly support voice-enabled agents, image uploading (for analysis by GPT-4o), and knowledge tuning with the added ability automatically add new sources of knowledge to help agents respond to questions.

Devs can use the Agent SDK to access services from Azure AI, Semantic Kernel, and Copilot Studio. There’s also an Azure AI Foundry (also launched at Ignite) integration that links Copilot Studio to facilitate connection to services like Azure AI Search and the Azure AI model catalog.

Finally, a public preview of agent builder in Power Apps was also announced at Ignite.

What about Responsible AI?

Sarah Bird, chief product officer for Responsible AI, wrote in a blog post this week that extra safety considerations arise with autonomous agents and that Microsoft is focused on ensuring that they behave and hand over to human before taking unexpected actions which can have big impacts and that extra guard rails and protections will be put in place.

The blog post talks about examples of such measures including the vital need for a human-in-the-loop check to make sure autonomous decision-making doesn’t do things it’s not expected too. Nothing demonstrates confidence in automation more than a human approval process.

Microsoft also suggest that anyone looking to get a sense of AI agents in a real role, can try out the  Linked In Hiring Assistant which is designed to help HR hiring teams speed up the process of dealing with the Admin involved in reviewing  job applications.

Key Benefits

The key Benefits these new adaptions to Copilot. Agents should bring to users and organisations includes:

  • Learning and Adaptation: The Copilot AI agents can learn from their environment and adapt to new information and tasks.
  • Decision-Making: These agents are capable of making decisions to assist users in their daily work.
  • Productivity Enhancement: The primary goal is to empower employees by reducing workload and improving efficiency in tasks such as managing meetings, emails, and creating presentations.
  • Automation of some tasks connected to regular and recurring inquiries or asks.

Human Impact – what about jobs!

The introduction of AI and automation, including Microsoft’s Copilot AI agents, has the potential to impact the roles of people in jobs.

  • Job Displacement: People naturally worry that AI has the potential to replace certain jobs, particularly those involving repetitive and manual tasks. According to a report by Goldman Sachs, AI could replace the equivalent of 300 million full-time jobs….. But.
  • Job Creation: On the other hand, AI also creates new job opportunities. It can lead to the emergence of new roles that require advanced technical skills and the ability to work with AI systems
  • Economic Impact: AI is expected to contribute significantly to global economic growth. McKinsey Global Institute estimates that AI could deliver additional global economic activity of around $13 trillion by 2030
  • Skill Demand: The demand for skills will shift towards more advanced and technical capabilities. Employees will need to upskill and reskill to stay relevant in the evolving job market. AI skills will be similar requirement to the “Internet skills” we saw on CVs in the 1990s!

Conclusion

Microsoft’s autonomous Copilot AI agents represent a significant step towards integrating advanced AI into everyday business operations. By enhancing productivity and reducing routine workload, these agents have the potential to transform how employees manage their tasks.

These will be in public preview very soon as these often take a few weeks to rollout across the globe.

Source: Conversation with Copilot, 22/11/2024
(1) How Will Artificial Intelligence Affect Jobs 2024-2030. https://www.nexford.edu/insights/how-will-ai-affect-jobs.

(3) The impact of AI on jobs – GOV.UK. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1023590/impact-of-ai-on-jobs.pdf.

Posted on

What is Windows 365 Link?

At Microsoft Ignite 2024, Microsoft announced Windows 365 Link to address the need to provide zero touch, secure, lightweight “thin client” device capable of running critical Windows workloads in the Cloud while enhancing security and flexibility,

Windows 365 Link represents the first move by Microsoft into the hardware space with a dedicated new class of devices purpose-built to connect securely to Windows 365 in seconds.

Yes, essentially a Thin Client device yes, Windows 365 Link, offers a simple, secure, purpose-built device for Windows 365, which will instantly book (using Windows 365 on a dedicated Windows 11 (light) device which boots instantly to the Windows 365 desktop.

The device is tuned and built to to provide responsive, high-fidelity experiences and will be available from April 2025 for around $349 RRP.

Windows 365 Link device is a compact, fanless and lightweight device. When powered up it boots in seconds, and provides modern power management including instant wake and localised processing for high-fidelity experiences, such as Microsoft Teams meetings and Webex by Cisco, helping users make the most of productive time.

Design and Build.

The device is built with 90% post-consumer recycled aluminum alloy in its top shield, 100% pre-consumer recycled aluminum alloy in its bottom plate, and its motherboard contains 100% recycled copper and 96% recycled tin solder. It also has 100% paper-based packaging, is ENERGY STAR®-certified device, with super low energy consumption.

Windows 365 Link has a fanless design, with the ability to boot quickly and wake instantly from sleep, according to the company.

There’s no local data storage, and no admin privileges for users. The device supports dual 4K monitors, with four USB ports, an audio port, an Ethernet port, Wi-Fi 6E, and Bluetooth 5.3.and supports any Windows certified wired and wireless peripherals including webcams.,

Windows 365 Link

Windows 365 Link is designed to be long-lasting with no moving parts, not even a fan—hence reducing the need for frequent replacements.

Secure By Design

Windows 365 Link is secure by design. The device stores no local, runs no local apps and has no local admin access. All corporate data will stay protected within the Microsoft Cloud under the Windows Cloud PC environment. The devices also ship with security baseline policies enabled by default and security features cannot be turned off or disabled.

Firmware and device updates are managed by Microsoft and the devices cannot be side-loaded or bypassed since they leverage the same secure by design principlans protecting Microsoft first devices like Surface.

Windows 365 Link supports DCFI, password less authentication using Microsoft Entra ID and the Microsoft Authenticator app or USB security keys.

Windows 365 Link Management

The device is managed via Intune ensuring a coherent and consistent management for IT. Windows 365 Link is designed to be long-lasting and can be remotely deployed and factory reset remotely in minutes, making it easy to reuse, secure and scalable.

The devices default to having a name starting with WCPC (for Windows CPC), and you can easily find them by looking for devices where the SKU family is WCPC. Windows 365 Link also automatically stays up to date: it downloads updates in the background and will apply them overnight when the device is not in use.

Posted on

Creating a Copilot Agent from a SharePoint Library

The new Agent Builder in SharePoint is designed to help people use and share Copilot Agents to query sibsets of data within your organistion using a simple click, point, create and tweak approach. Out of the box every SharePoint site (assuming you have a Copilot license) brings a Copilot sidebar allowing you to ask questions about the content, but you can also replace this with a custom Copilot Agent which we will walk through here.

The goal is to enable business users to easily empower their employees use Copilot to reason over specific information sources or across discrete repositories. Microsoft provide a handful of “use cases” as why a Copilot agent might be useful and what’s great is that “anyone” can create one!

Image – Microsoft Copilot Adoption Hub

Once created and tested, these custom Copilot Agents can be easily shared via a simple hyperlink that can be embedded in SharePoint pages or used in Teams.

In this how to blog, I walk you through the setup and customisation of a Copilot Agent using Agent Builder in SharePoint, customising of the agent, and sharing of the agent. Free to follow along and create your own agent.

Copilot agents are specialised AI assistants designed to enhance the capabilities of Microsoft 365 Copilot by connecting to your organisation’s knowledge and data sources. They are custom tools embedded in Copilot Extensions, providing additional functionalities tailored to specific needs. In SharePoint, Copilot agents are natural language AI assistants that give trusted, precise answers and insights. Agents are expert systems that operate autonomously on behalf of a process or company.

Building your First Copilot Agent

Step 1 – Choose your starting point.

First, you need to navigate to a SharePoint site, library or document library you want to create an “agent” from. You will of couse need to have access to that Library and also need a Microsoft 365 Copilot license to create the agent.

From here, you can select the three dots and choose “Create a Copilot agent“

Step 2 – Click and you are done!

Done (well – you will probably want to customise it and test it), but once you do this, your Copilot Agent is created for you. Click “Edit” to make changes, such as change the name, and then of course test it out.

Step 3 – Edit and Customise

Here I have clicked “Edit” to take me to the customisation pages. From here you can toggle across different options to customise your Copilot agent.

The customisation pages are split into three sections – Idenitity, Sources and Bebaviour – each of these allow you to tweak the way the agent works. There’s also the ability to edit for advanced customisation through Copilot Studio but this feature is not available at time of writing…

In the Identity Section – you can change the name, icon and description (who the agent introduces itself to the user)

In the Sources Section – you can modify the sources that the Copilot Agent uses. You can add additonal SharePoint sites, individual files or extenal sources such as websites.

In most cases, I suspect you will want to use a single library or a discrete set of files, but you can add up to 20 different information sources. These 20 information sources can be mean sites, libraries, folders, or documents. What’s more, you can have a combination of these as long as the total is 20 sources – for example, you could add 20 sites or 20 documents, or 3 sites, 5 document libraries, 2 libraries and 10 descrete files as long the total sources totals 20.

Note: You of course need to ensure that the intended users of the agent have access to the sources your specify as agents run under the security context of the user using the agent.

In the Behaviour Section, you can customise the welcome message which will help your users to understand the purpose of this Copilot agent and can also edit or change the starter prompts to help users get some tips on some of the things the agent can do for them. You can also give the agent specific instructions on how it should respond and behave based on the user input.

As you update the behviour, you will see the changes in real-time.

Testing your Copilot Agent

Once you are ready, you can test your agent, simply writing a prompt in the chat dialog as you would with any other Copilot – feel free to try one of the templates or create your own.

Be sure to test a few things, you might find you need to update the user instructions and review the sources before you share it with other people to test further.

Once you are happy with your agent, click save. The agent is saved a “file” with a .copilot extension in the root of the SharePoint folder you started creating your agent in.

Using your Copilot agent

Once saved, your new Copilot Agent launches automatically for any user accessing the SharePoint library that has a Microsoft 365 Copilot license. This replaces the default copilot interface that opens when you visit a SharePoint library.

Sharing your Copilot agent

Since the Agent is encapsulated as a manifest “.copilot” file, you can simply share the file like you would any other file, or click the three dots and select share.

Once shared, they click on the file and open it and it displays like a standalone app or can of course access it from the SharePoint library directly.

[Current] Limitations

  1. Currently Custom agents do not appear on the main Copilot Business Chat pages, though this is coming I beleive. On the FAQ on Microsoft’s support page it clearly states that “You can access a Copilot agent from a SharePoint site, page, or document library. You can also use it in Teams if added. We plan to make it available across Microsoft 365, including Microsoft Copilot.” https://support.microsoft.com/en-us/office/get-started-with-copilot-agents-in-sharepoint-69e2faf9-2c1e-4baa-8305-23e625021bcf.
  2. Advanced editing with Copilot Studio is not currently available, but is also coming soon.
  3. It’s not possible to “hide” the .copilot file (that I can see anyway), so make sure to change permissions on the file.

Let me know how you get on….

Posted on

Copilot Vision: A New Era of AI Assistance or a step too far?

Microsoft is about to add more capabilities to the consumber version of Copilot including a new way we interact with it Copilot through its latest feature, Copilot Vision.

Is this a privacy step to far? or is this simply leveraging the power of vision to bring new experience and assistance to users.

Designed to enhance the capabilities of Microsoft’s Copilot AI assistant by allowing it to see and understand the same content as the the user is seeing on scene is said to bring a new dimension to how we work with AI tools.

Copilot Vision – image (c) Microsoft

What is Copilot Vision?

Copilot Vision is an extension of Microsoft’s Copilot AI assistant that enables it to visually perceive the content on your screen. Whether you’re browsing websites, reading documents, or viewing images, Copilot Vision can interpret and respond to the visual data, making it a more intuitive and helpful assistant.

Examples of Copilot Vision in Action

  • Travel Planning: Instead of manually searching for travel options, Copilot Vision can provide recommendations and answer questions based on the travel websites you’re viewing.
  • Recipe Adjustments: If you’re looking at a recipe online and want to make substitutions, Copilot Vision can suggest alternatives and cooking tips without needing to switch tabs or open a new search.
  • Document Assistance: While working on a document, Copilot Vision can offer suggestions, corrections, and additional information relevant to the content you’re editing.

All this happens without you having to copy and paste stuff to the Copilot chat interface so it’s really like having eyes on what you are doing (once turned on of course). It’s like having your assistant working and viewing with you so it can see exactly what you see on your screen, whether it’s a website or a document.

Copilot Vision.

That’s what Copilot Vision does. It can read both typed and handwritten text displayed on your screen, and it responds to what it sees, offering answers to your questions and suggesting next steps.

Privacy Consideration

Microsoft has emphased that privacy is a top priority with Copilot Vision. The data processed by Copilot Vision is not saved or used beyond the current session (like clearing the cache). Microsoft Copilot Vision will initially also be limited to certain popular websites that meet Microsoft’s security standards, ensuring a safe and secure user experience. It also won’t work on sites that contain sensitive data such as banking sites.

Remember, this is something you can choose to use or not, so you can turn it off!

Rollout Timeline

Microsoft say that after a successful trial period with a select group of users in the Copilot Labs experiment hub, Copilot Vision is “now ready” for a broader rollout.

The feature will soon be integrated into the Microsoft Edge browser, accessible via a screen-like icon. This phased rollout will allow Microsoft to gather more feedback and ensure a smooth user experience.

Posted on

Why Microsoft is updating Chat and Channels Experience in Teams

Microsoft Teams has long been a cornerstone for collaboration, and now, with its new chat and channels experience, it’s set to transform how we connect and collaborate even further, makimg it easier to stay in the flow and work with multiple chats and teams channels.

Video (c) Microsoft

Streamlined Communication for Enhanced Productivity

The redesigned interface prioritises ease of use, allowing users to effortlessly triage conversations and stay on top of their most important communications. Whether managing projects, coordinating with teams, or engaging in spontaneous brainstorming sessions, the new experience (which has been in testing for some time) has been designed to ensure that every interaction is seamless and impactful.

Key Features and Enhancements

Intuitive Design: The new layout is simple by default, yet powerful on demand. It’s designed to help users quickly find and respond to messages, reducing the time spent navigating through conversations.

New chat design interface in Teams

The @Mention View: This view in chat gathers all messages directed at you into a single interactive list, making it easier to prioritise and respond to important communications.

The new @ mention view in Teams Chat

Why these changes Matter

These updates are not just about aesthetics; they are about creating a more dynamic and intuitive user experience. By simplifying the interface and enhancing key functionalities, Microsoft Teams aims to boost productivity and ensure that users can collaborate more efficiently and effectively.

New Drag and drop chat and channels in Teams desktop and mobile apps.

User education and readiness

To support users and support staff on the adoption of these new features, Microsoft has provided a wealth of resources, including detailed blogs, instructional videos, and a dedicated microsite on the Microsoft Adoption Center.

These resources are designed to help IT leaders, IT pros, and end users understand and leverage the new capabilities to their fullest potential.


Microsoft is also hosting a live Ask Microsoft Anything (AMA) session on November 12, 2024, where users can see the new features in action and get their questions answered by Teams product experts.

Jeff Tepers’ blog goes into more detail, highlighting the new experience and how it will improve user experience and efficiency Jeff calls it “simple by default, powerful on demand.”

https://www.microsoft.com/en-us/microsoft-365/blog/2024/10/28/streamline-collaboration-with-the-new-chat-and-channels-experience-in-microsoft-teams/



Posted on

Why Windows 11 24H2 could have been called Windows 12

Most of the time, security and annual and semi annual feature updates in Windows are built on the same core OS platform. This means that the changes and new features in these updates are / updated on top of that particular OS build. 

This is not the case with the latest Windows 11 24H2 Update which is starting to roll out now.

Why is the Windows 11 24H2 update different?

Unlike previous updates to Windows 11, Windows 11 24H2 is delivered as an update to existing devices with Windows 11 installed. This update is essentially a whole new version of Windows and yes, some have dubbed it Windows 12 – because it is, in all purposes a new OS version that is installed over (OS Swap) on the top of the existing OS – making it a new version.

This approach is the same as when Windows 11 was released back in 2021 and was (of course) an OS upgrade on-top of Windows 10. Many saw Windows 11 as “just a UI refresh.” But it was actually a totally new build of Windows. It had major architectural and security changes throughout the OS. Updates like Windows 11 version 22H2 and version 23H2 introduced many new features, but these updates were fundamentally built on the same underlying Windows 11 OS platform.

Windows 24H2 is a new OS

Windows 11 24H2 update is built on a totally new platform (codenamed Germanium) which brings fundamental under-the-hood changes to the core of the Windows 11 Operating System. Many of these updates and changes will not be obvious or event visible to a typical user, but many of them are fundamental changes. For example, one significant improvement with this release is much better optimisation for ARM based devices such as the new Snapdragon Powered Copilot+ PC devices like the Surface Laptop 7.

This is also why this update launched preinstalled on Snapdragon X series PCs. The feature set wasn’t completely finished when they launched, but the code base was needed to take advantage of the new features which are now rolling out.

The question asked by many is – “Is Windows 11 24H2 really Windows 12 then“?

So why isn’t it called Windows 12?

Good question. Well, whilst this is a major update under the hood the UI does look the same as before, and in terms of new features for existing PCs, many of the new things are subtle and reflective of the ongoing tweaks and changes such as finally moving those legacy “Control Panel” updates to Settings. As such there is nothing in 24H2 that really says “hey – this is a brand-new operating system” – and that’s a good thing I think (right now anyway).

In the past, we typically received a “new version” of Windows release every three or so years, and as such it was possible to “upgrade” from one to the next if you were willing to buy a new Windows license (or a new device with a new license).

Of course, most people did not want to do that, which meant that most of us (consumers anyway), only got a new OS update when they bought a new PC/Laptop – which included the latest license you needed. for the “current OS”. That’s how Windows upgrades worked for most people anyway!

Windows 11 version 24H2, it is basically the same thing. Whilst this update is available for existing PCs (it’s also free) there’s very little that is new and shiny for existing devices.

All the big news and new features are part of the new generation of devices – the Copilot+ PCs and AI PCs – and most of those new AI features will only work (be activated) on these new devices – since they need a PC with a chipset that includes an NPU with over 40TOPS of performance – this is basically new devices launched after June 18, 2024 (or even later, if you want to get an AI PC based on the AMD or Intel PC).

So back to the point, yes Copilot+ and AI PCs are essentially Windows 12 with all the features it introduces but still under then branding (as the UI has not changed) as Windows 11.

What does a Copilot+ PC and Windows 11 24H2 Bring then?

Right now, what Copilot+ devices do add some cool new AI features which I would say currently appeal to tech enthusiasts and those that run AI workloads (or plan too). You do get live captions with real-time translation in any app, have the ability to use new AI features in apps like Paint using a “cached” LLM on the device and new you’ll soon get features like Recall, Click-To-Do, and generative fill which are also huge new features that are all exclusive to those new Copilot+ and AI PCs devices.

Will there be a Windows 12?

We don’t know to be honest – not yet anyway. It is clear to me that Microsoft are working to ensure they don’t abandon or upset their existing users and create confusion.

With Windows 10 going end of support in October 2025 (that’s a year from now), creating a Windows 12 brand will likely up-set many businesses that are in a transition from Windows 10 to Windows 11.

This version of Windows 11, will include a whole load of features that will be exclusive to the newer AI PC hardware such as the Surface Laptop 7 and Surface Pro 11. This still creates an incentive for people to buy new PC with shiny features (that makes PC companies like Dell, HP, Lenovo, and Microsoft happy) whilst still ensuring the Windows 11 OS is modern and fresh. Existing devices can still upgrade to Windows 24H2, but they won’t get these new AI features (you need that NPU remember).

Will Microsoft ever unveil plans to release a formal Windows 12? I really don’t know at the moment. I think a new “branded” version will come at some point in the next couple of years. They may just call it Windows – something we thought Microsoft were going to do when Windows 10 was released.

What do you think – should Windows just be called Windows 25H1 for example, or do we prefer a version number. I’m a Windows / Surface MVP and I don’t know any more than you right now (of course if I did, I couldn’t tell you – but I honestly do not know!)

There are lots of rumours on social about Windows 12 – tell me your thoughts?

Posted on

Cisco Webex One 2024 Keynote: “Experiences Amplified”

Webex One 24 Logo

The Webex One 24 opening keynote was a showcase of Cisco’s commitment to revolutionising the way organisations collaborate and connect. It highlighted several new announcements, renewed partnerships and AI innovation across their portfolio which will continue to innovate the “future of work”.

This blog summarises my key highlights from Cisco’s fifth annual Webex One event. This year’s theme focussed on the transformative power of AI and human connection. Senior Cisco execs, including Aruna Ravichandran and Jeetu Patel, opened by discussing the latest AI innovations and their impact on customer and employee experiences and of course used the event to showcase new technologies and products from Cisco as well as new and extended partnerships with key vendors including Apple and Microsoft.

Cisco emphasised the integration of AI into (all) their products, the importance of secure and smart workplaces, and the future of seamless collaboration. They also introduced new technologies like the autonomous Webex AI agent and Cisco spatial meetings for Apple Vision Pro, showcasing their commitment to enhancing productivity and connectivity.

“Don’t worry about AI taking away your jobs, but worry about people who use AI effectively” | Jitu Patel

Aruna Ravichandran, Cisco’s Senior Vice President emphasised the importance of human connection and creativity in the transformative world of AI, highlighting the event’s focus on groundbreaking AI innovations and customer experience.

Jeetu Patel, Cisco’s Executive Vice President, talked about the “seismic shift in AI“, noting that while AI has brought significant momentum and pockets of impactful change, for the most, our lives have not yet materially changed. He said that he sees a dramatic change in the next decade, emphasizing the potential of agent-based technologies to redefine and reshape jobs and workflows fundamentally.

Let’s look at a few of these in more detail.

Cisco’s AI Strategy

Cisco’s AI strategy is focussed on integrating AI natively into their products, providing AI infrastructure, and ensuring AI security. Jeetu Patel talked passionately about the importance of AI-ready data centers, modern networks and AI aware security as well as what he called “future-proof workplaces”, and resilience in operations, driven by AI and data. Cisco unveiled new AI-driven features across their Webex collaboration suite, designed to make virtual meetings more intuitive and productive. These enhancements included real-time language translation, advanced noise cancellation, and AI-powered meeting summaries, ensuring that every participant can stay engaged and informed as well as work with Apple and Microsoft integration and connectivity.

Building Future Proofed Workspaces

Cisco talked about the importance of seamless integration across various platforms. They said they are introducing new APIs and partnerships that will better enable Webex and their meeting spaces technologies to integrate more effortlessly with other tools and applications, providing a unified and streamlined user experience, including with Microsoft Teams. Cisco aims to continue to raise the standard of what the workplace with secure campus and branch networking, smart building technology, workplace security, and seamless collaboration should look like something they see themselves having a unique industry advantage of.

“Our goal is to make every meeting as productive and engaging as possible, no matter where you are in the world.” | Jeetu Patel | Cisco VP

Cisco said the focus is on creating productive, automated, and secure environments for employees to work from anywhere. Cisco also showcases its advancements in spatial meetings, emphasizing the importance of human connection in AI-driven interactions – with a differentiated focus on creating immersive and engaging meeting experiences that feel as intimate and effective as in-person interactions.

Autonomous Agents in Webex Contact Centre

Cisco also introduced their upcoming autonomous Webex AI agent, designed to enhance self-service in contact centers. This AI agent combines conversational intelligence with generative AI and integrates with back-office systems to deliver personalized outcomes, reducing the need for human agents. The demo showed some advanced autonomous (AI Agents) enhancing customer self-service – combining conversational AI with generative AI along with integrates with back-office systems and processes like HR and Finance.

Extended Partnerships

Cisco discussed extended partnerships with both Apple and Microsoft, emphasizing their collaborative efforts to enhance technology and user experience and to meet customers where they are. These partnerships emphasize Cisco’s commitment to interoperability and enhancing user experiences across different (in some cases, competitive) platforms.

Cisco said that their Cisco Room devices for Microsoft Teams have become the fastest-growing Microsoft Teams Room solution in the world with over 3,000 customers now leveraging Cisco technology to power their Microsoft Teams investment.

Cisco’s long-term relationship with Apple was discussed and references made to Cisco technology being integral to Apple’s product development. The keynote highlighted the collaboration between the two including the development of the Apple Vision Pro, which integrates Cisco’s Webex for immersive 3D meetings

An AI powered Sustainable Future

High on the agenda was Cisco’s commitment to sustainability which was a key theme through the keynote. Cisco introduced new features aimed at reducing the environmental impact of virtual meetings, such as energy-efficient data centres and tools to measure and offset carbon footprints.

Did you attend Webex One or watch it remotely, what did you find of interest and what did you hope you’d see but didn’t?

Posted on

Surface Pro can help improve memory and cognitive functions.

Writing by hand (on paper or digitally), remains a crucial skill even in the world of speech to text, AI, the keyboard and the smart phone. It is a proven scientific fact that writing provides significant cognitive benefits when compared to typing. In this blog, I combine valuable insights from a research post on the cognitive benefits of handwriting and its vitality in education and learning in later years. I’ll also share my personal experiences on the use of Microsoft Surface Pro and “digital ink” which again summarises in my opinion, the importance of of writing (outside shopping lists!)

Proven Cognitive Benefits of Handwriting.

Handwriting, as opposed to typing, activates multiple brain regions. This leads to improved memory retention and cognitive function. Here are some key points:

Memory Retention

Writing by hand engages the brain in a way that typing does not, leading to better memory retention. This is because handwriting activates multiple brain regions, including those involved in thinking, language, and working memory.

Holding a pen with our fingers, pressing it on a surface, and moving our hands to create letters and words is a complex cognitive-motor skill that requires a lot of our attention… This deeper level of processing, which involves mapping sounds to letter formations, has been shown to support retention, reading, spelling and comprehension in children.

Mellissa Prunty | Occupational Therapy | Brunel University London

Enhanced Learning

Handwriting supports reading and spelling, especially in children and those with delayed learning conditions. It engages multiple senses, which helps in the learning process. When people write by hand, they are more likely to remember the information and understand it better. This is also one of the reasons hand-written flash cards work so well in revision or when preparing for a speech or presentation.

Brain Activation

Studies have shown that handwriting activates more areas of the brain compared to typing. This increased brain activity leads to better learning and memorization.

Cited from the article (reference link below) Researchers analysed brain scans of university students while they completed writing tasks. The study used electroencephalogram (EEG) techniques. It compared brain activity when students wrote Pictionary words with a digital pen on a touchscreen. This was contrasted with typing them on a keyboard.

“The most surprising thing was that the whole brain was active when they were writing by hand, [while] much smaller areas were active when they were typewriting. This suggests that when you are writing by hand you are using most of your brain to get the job done.”

The study further revealed that the brain regions engaged in handwriting communicated through brain waves linked with learning. Van der Meer adds, “There is a whole body of research that talks about alfa and theta oscillations in the brain that are beneficial for learning and remembering. We found those oscillations were active during handwriting but not during typewriting.”

Consequently, researchers are advocating for the preservation of handwriting skills (even writing with a digital pen) for modern note taking

Link: https://www.nationalgeographic.com/science/article/benefits-of-handwriting

Typing vs paper vs Digitial Ink

Researchers advocate for maintaining handwriting in school due to its benefits for brain development. They argue that despite the rise of digital technology, handwriting should not be neglected in education – Digital ink on devices like Microsoft Surface devices (popular in education) make a huge difference.

It’s not just education either – using pen and ink, in interviews, meeting notes and idea generation also improves cognitive ability, improves memory and is said to increase imagination. Digital notes can also be stored and shared securely (unlike meeting notes in books or scraps of paper) and can even be converted to text or even read by your favourite AI tool 🙂

Surface Pro to the rescue?

I have covered this before in a previous blog post – link at the end. I firmly believe that organisations can leverage these findings and research. They can do this by deploying and using Microsoft Surface for their employees. Ok, so Microsoft are not the only manufacturer to offer pen support, but Microsoft Surface does it better than most. Ink support is built right into the Windows operating system and Surface Pen (the later generations) make inking natural and powerful with Surface Slim Pen 2 even providing haptic feedback when you write.

The use of digital inking with Windows 11 and Surface revolutionised the way we can take and share notes and collaborate in meetings.

Here are some key points from my previous blog post on this topic which I think are directly relevant here.

  1. Efficiency and Flexibility: Digital ink allows for quick and efficient note-taking. Users can easily edit, organize, and share their notes. This flexibility is particularly useful in meetings where information needs to be captured and disseminated quickly.
  2. Enhanced Collaboration: Using digital ink enables real-time collaboration (think digital whiteboards in meetings) and are more inclusive, since multiple users can contribute to a document or canvass at the same time, making it easier to brainstorm and share ideas. This collaborative approach enhances productivity and fosters creativity. The canvas is also shared in the meeting and doesn’t result in organisers taking photos of paper whiteboard and sharing in Teams Chats!
  3. Integration with Other Tools: By investing and using Surface Pro devices with Surface Slim Pen 2 for digital ink, employees and students can integrate ink seamlessly with their other digital tools and platforms like Office apps like OneNote, Whiteboard and many many more. This integration allows users to incorporate multimedia elements into their notes, such as images, videos, and hyperlinks, making the notes more comprehensive and engaging.
  4. Accessibility and Portability: Digital notes are easily accessible and can be stored in the cloud, allowing users to access them from any device, anywhere. This portability ensures that important information is always at hand, whether in the office or on the go.
  5. Security: Writing customer notes, revision notes or research in paper books is fine – until you lose then, spill coffee (or beer) over them, or leave them on a train. Not only do you lose them, risk them getting in to the wrong hands or worse, you have no access to them. Using OneNote and Surface (with Pen and Ink) means your notes are always available to you in any app and any device – security and always!
  6. Meeting Experience: Taking typed notes in meetings, often appears that we are “doing our emails” or not paying attention even if we are taking notes and actions. On the flip side, when we use a Surface Pro to take notes with digital ink, it’s less intrusive and it’s obvious we are taking notes. With the Surface in “mode”, other meeting participants don’t get a view of the back of our laptops and can see we are paying attention and just jotting down notes.
  7. Copilot can help: Assuming your notes are eligible and can be read, Copilot can help summarise your notes, identify actions and even draft your follow up email using the notes your took in the meeting – try doing that when you write in a notebook!



### Conclusion
Both handwriting and digital ink offer unique benefits that are essential in different contexts. Handwriting enhances cognitive function and learning, making it a valuable skill that should be preserved in education. On the other hand, digital ink provides efficiency, flexibility, and enhanced collaboration, making it an indispensable tool in modern meetings and professional settings. By combining the strengths of both methods, individuals can maximize their productivity and cognitive abilities.

“Statistically most studies on the relationship between handwriting and memory [including ones conducted in Japan, Norway, UK and US show that people are better at remembering things that they have written down, manually than typing on a keyboard.”

Naomi Susan Baron | Professor of linguistics| American University in Washington DC

Credits: https://www.nationalgeographic.com/science/article/benefits-of-handwriting

Posted on

Hands-on with Copilot Voice: An almost human conversation

Copilot Voice Cover


The recent Copilot update is a Game-Changer in AI Voice Technology. In the recent announcements, Microsoft unveiled a new version of its Copilot app for iPhone and Android. The update brings a fresh look and new features. It also includes an impressive voice mode that rivals OpenAI’s ChatGPT Advanced Voice – especially since Microsoft make this available for free – yes free

I have tested both recently. I can confidently say that the new Copilot is a significant upgrade. What’s more, it is totally free to use. This is best read while/after you have watched my hands-on video below.

Hands on with Copilot Voice

User-Friendly Interface and Enhanced Voice Mode

The updated Copilot app boasts a more “consumer-friendly” interface. I do wish they would bring some of the advanced customisations back. The standout feature in this update is most definitely the new voice mode, which on first look (a few app updates before it worked), I thought would be a bit of a fad – but it is absolutely brilliant.

Voice mode offers speech-to-speech functionality, allowing for more natural and engaging conversations. While it may not interrupt as fluidly as OpenAI’s offering (though it’s still in early stages), it feels more casual and less stilted, making interactions feel more like chatting with a friend.

A Conversation That Feels Real

During my testing, I found myself deeply starting to actually forget that I was talking to an AI as the conversation felt natural and real (there was the odd delay. In my hands-on example (see the video below), I participated in a discussion. We talked about “if and when AI could ever become self-aware”. We also considered what the implications might be. Unlike a text-based discussion, this level of engagement goes to show just how fast and how rapid the advancement of natural conversation is becoming.

Copilot appears to adapt its vocal tones and pace during conversations. It emphasizes certain words as we speak.

Perhaps the biggest (pleasant) surprise I found was how Copilot adapted to use slang terms the more I used them too. If I swore or spoke more loudly, it also seemed to detect the change in my tone and adjust its output. I’ll be testing this more to see just how far it can go.

Spoiler: I did find the occasional limitation as the conversation continued, such as occasional delays when I interrupted it and seconds of silence.

Customisation and Accessibility

Copilot offers four voice options: Grove, Canyon, Wave, and Meadow. Unlike ChatGPT, you can modify the speed and tone of these voices, making them sound more natural and suited to your preferences. This feature, combined with the app’s inclination to use slang and short-hand words, makes it easy to forget you’re interacting with a machine. I’m not a fan of all the voices though and they are not currently that localised – with most very American (which is fine for now).

Gemini Live (yes, all the chat bots are discovering their voice) currently gives users a choice of 10, but Microsoft say more voice options will be coming “soon”.

What I also like is that you can customise the speed at which each of the voices speaks. Personally, I find the standard setting is too slow and find that a speed of 1.1x sounds most natural. I also discovered that you can also ask Copilot to speak differently by explaining how you want it to sound – for example, applying a slightly different accent, changing its tone of voice or to be more empathetic but I’d like to think eventually Copilot will do this natively without me asking (after all it’s unlikely you’d ask a human to speak in a different tone!).

Copilot Voice is free

One of the most significant advantages of Copilot is that it’s free to use. Today, OpenAI’s ChatGPT Advanced Voice feature currently requires a $20 monthly subscription, whilst Microsoft makes this feature available to all Copilot users, regardless of their subscription status.

Conclusion

Copilot is now under the leadership of Mustafa Suleyman [Microsoft CEO for AI]. It seems poised to make a significant impact in the AI voice technology market. It builds on its partner OpenAI. Its user-friendly design, natural voice interactions, and accessibility make it a strong competitor against other AI voice models.

The best thing – this is totally free

Try this out. Let me know how in depth you feel during a conversation is and can be with Copilot. How “close” do you think this is in becoming a natural, almost human conversation.

Posted on

Expanded Controls for Managing Transcription and Copilot in Teams Meetings

Microsoft is rolling out new controls to better manage the availability of Copilot in Teams meetings. These expanded controls offer greater flexibility and customisation for managing Copilot and transcription settings in meetings. This ensures it aligns with the specific needs and policies of organisations and meeting organisers.

IT admins can find the new setting in the Teams Admin Center and have a few options when it comes to the control Scope with options to set  Copilot in meetings to be ‘Off’ at different levels including “per Tenant” Per User” and “Both”

Meeting Organisers also get controls which are accessible in the meeting options under “Allow Copilot“. From here there are three choices around how Copilot can be used in “their” meetings:

  •   Only during the meeting: Copilot is available only while the meeting is in progress.
  •   During and after the meeting: Copilot is available during and post-meeting.
  •   Off: Completely disables Copilot for the meeting.

Meeting organisers can choose who has access to the recording. They can also decide who can see the meeting transcript after a meeting. This adds a huge amount of control and privacy.

Image (c) Microsoft

Auto meeting Summaries

After a meeting ends, users can open the meeting event in Microsoft Outlook. This allows them to view a summary of everything that happened in the meeting. Here you will see a summary. It includes a link to the recap page, transcript, recording, notes, shared files, whiteboard, and meeting details.

Auto meeting Summarisation in Outlook.

Users with a Copilot License or Teams Premium license will also see highlights. These include the number of speakers. They will see the number of times you were mentioned. Additionally, they will see the number of AI-generated tasks.

Rollout Timeline

Both features are being rolled out this month (October 2024).

Posted on

Click-to-Do and new “AI Search” coming to Copilot+ PCs

Microsoft (off the back of Windows 11 24H2 release this week) have unveiled a series of updates to their AI infused Copilot+ PCs, aimed at enhancing the user experience with innovative features.

Copilot+PCs are a new category of PCs released this year by leading OEMs including and debuted by Microsoft and are equipped with NPUs. These devices come in Intel, AMD, and Qualcomm-powered Windows on Arm configurations. Microsoft introduced several new features for both types of these advanced PCs. The newly launched Windows 11 2024 Update (version 24H2) brings new functionalities for all Windows 11 users, with some exclusive enhancements specifically for Copilot+ PC owners.

These updates further demonstrates Microsoft’s commitment to baking AI assistance into more and more manual or semi manual tasks, and are designed to make everyday tasks more intuitive and efficient, leveraging the power of AI to transform how we interact with our new shiny devices.

New AI experiences in Copilot Plus PCs

These new features are summarised in an extensive Copilot / Windows Blog but the key ones I have summarised below.

Enhanced Search: Find stuff faster and easier.

One of the standout features in this update is the new Enhanced Search. Here, Microsoft has integrated AI-driven improvements deep into Windows search, making it significantly more powerful and user-friendly.

With these enhancements, users can now find files, images, and emails with ease, even if they don’t remember the exact names. Better than a simple search index (you know, that thing that used to grind your PC to a halt), this AI search understands context and can retrieve relevant results based on partial information or related keywords.

Image (c) Microsoft.

For instance, if you’re looking for a presentation you worked on last month but can’t recall the title, simply typing in related terms like “presentation” and “last month” will bring up the correct file. This feature is huge change for how we find and retrieve information and is more human connected in terms of how we think and ask. Plus, if you are anything like me, it should reduce the time spent searching for documents and allowing users to focus on their work.

“AI-powered search makes it dramatically easier to find virtually anything,” says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft. “You no longer need to remember file names and document locations, nor even specific names of words. Windows will better understand your intent and match the right document, image, file, or email”.

Yusuf Mehdi |Executive VP and CMO | Microsoft.

For images this will work extremely well as you won’t need to know the file name and can search for pictures using words, even if the search word isn’t part of the file name!

The improved Windows search will first show up in File Explorer on Copilot Plus PCs from November.

This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “duplicate my screen” into the Settings search box and it will help you find the right settings.

Click to Do: Interacting directly with your screen.

This feature really caught my attention and is definitely one I think I will use.

Click to Do will allows users to interact directly with images and text on their screen to perform quick actions. As an example you might be viewing a webpage or a pdf and see a phone number. You’ll be able to click on it to initiate a call, or clicking on an address to open it in your maps application. This feature streamlines workflows by reducing the number of steps needed to complete tasks.

Image (c) Microsoft

Click to Do works by understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items… It works on any windows, document, image, or even video”

Yusuf Mehdi |Executive VP and CMO | Microsoft.

As an example, you could use Click to Do to perform a visual search on an item that appears in a YouTube video you’re watching or a page you are viewing in a browser. Click to Do is also context-aware, assisting with text-related actions like rewriting, summarising documents, explaining text, and sending emails.

Microsoft have said Click to Do will begin testing with Windows Insiders on Copilot Plus PCs in October, with a gradual rollout planned for November.

The previously announced Recall feature will also be available to Windows Insiders in October on Qualcomm-powered devices, before being rolled out to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November.

I think this could be a real time saver for me and for anyone who does a lot of research, works with high volumes of information and has lots of open windows on their screen(s). By enabling direct interaction with on-screen content, it should help minimise interruptions and keeps the focus on what your are doing without having to open other tools.

Generative AI in Paint: Bringing modern tech to a staple app.

Microsoft Paint is also getting another significant upgrade (which has been in testing with Windows Insiders for a few months) with the introduction of new generative AI tools. These new tools ncluding generative fill, image generation (using Designer) and generative erase, that bring capabilities similar to those found in advanced photo editing software like Photoshop. Layers was also introduced to Paint earlier this year.

Copilot UI : The human touch.

Finally, Microsoft are revamping the general Copilot experience. This is not just about adding new features (though there are some) but are more about a total overhaul and part of their vision to make AI a more human-centric experience.

Their goal is to differentiate Copilot from other AI tools like ChatGPT and Gemin, by focusing on usability and user satisfaction. This approach ensures that the technology adapts to the user’s needs, rather than the other way around.

I covered this in more detail in another blog post below.

Posted on

Microsoft release huge Copilot (consumer) update…

In a blog post yesterday, Microsoft unveiled a huge overhaul. They also introduced new features which are rolling out “now” to the consumer version of Microsoft Copilot. These updates set out to help them differentiate Copilot from ChatGPT. They aim to bring a more human-centric approach to the user experience.

These experiences are coming to Apple iOS, Android, the Copilot web experience at copilot.microsoft.com and in Copilot in Windows. Microsoft have also announced that Copilot is coming to WhatsApp. It will “help users there experience natural and engaging interactions with Copilot”. Interesting.

This is not available for me yet (I have a Copilot Pro license). Microsoft says that until this rolls out, users will see a message like below. This message pre-advertises the new Copilot experience that is coming “soon”.

In this blog, I’ll cover the key changes, the reasons for change and some of the coolest new features. I’ll also share my take on this and what they mean for users.

New Microsoft Copilot Video

Oh yes, there’s also a Microsoft “sizzle” video below if you don’t want to read my ramblings:

The Human Side of Gen AI?

At the heart of Microsoft’s vision is the belief that technology should enhance human well-being and support our unique qualities. Microsoft say that the revamped Copilot has been designed with this philosophy in mind. It ensures that every interaction is intuitive, personalised, and ultimately beneficial to the user.

Now, this is kind of the part of Copilot that was missing in my view. Other Gen AI tools now do this. They are essentially giving Copilot (for consumer – not Microsoft 365 Copilot) to “get to know you” – this is how they describe it:

“Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests. It understands the context of your life, while safeguarding your privacy, data and security, remembering the details that are most helpful in any situation. It gives you access to a universe of knowledge, simplifying and decluttering the daily barrage of information, and offering support and encouragement when you want it. …..Over time it’ll adapt to your mannerisms and develop capabilities built around your preferences and needs. We are not creating a static tool so much as establishing a dynamic, emergent and evolving interaction. It will provide you with unwavering support to help you show up the way you really want in your everyday life, a new means of facilitating human connections and accomplishments alike.”
Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI

New Copilot Features

The new Copilot experience will be far more than an UI facelift when it arrives. (I don’t have it yet.) It will come with brand new features that promise to re-innovate the ways in which we can use Copilot in our daily lives. The new features include:

  • Copilot Voice: This allows users to interact with their devices using natural language, making technology more accessible and user-friendly. This means you will be able ro engage in natural conversations with Copilot. The current method is more just speech to text and doesn’t really feel like a conversation. This is rolling out “now” for initially available in English in Australia, Canada, New Zealand, the United Kingdom and the US with more regions and languages coming soon.
  • Copilot Daily: Delivered as “cards”, this will provide personalised insights and recommendations to help users manage their day-to-day tasks more efficiently. Microsoft say this content will only be served by trusted news sources – the cite: Reuters, Axel Springer, Hearst Magazines, USA TODAY Network and Financial Times, with more “local sources” coming soon. As Copilot gets to know you, it will bring personalsed feeds and also allow users to have controls over what is served up. This starts rolling out now in the US and UK with other countries following soon.
  • Copilot Vision: which looks so cool, will leverage Microsoft’s vision and seeing AI tools to offer enhanced visual recognition capabilities, making it easier to organise and find information. Microsoft say that this work on all websites and documents. They have taken steps to put “boundaries” on the types of websites Copilot Vision can engage. It also won’t work on pay-walled content initially. It won’t work on sensitive content initially either. This is to protect “users’ and creators’ interests” and copyright. This will be a Copilot Pro Feature and will roll out to US customers first…
  • Think Deeper: This is similar to Deep Search in Bing, whereby Copilot will be able to reason through more complex questions. As such it will take longer to respond and may ask for clarifications before responding. This is really designed to allow Copilot to go beyond basic responses. It will help with more in-depth discussions. It will also aid in challenging questions and research. This is in experimental phase and will more details will come.

Wrap up

The new and enhanced Copilot user experience is all about making Copilot easier to use. It feels more natural (less techy). It brings some new capabilities and personalisation. This makes the experience far more “personal”. It’s great to see more work being done to create a more seamless and up-to-date experience. This allows them to compete better with Google, Meta and Apple in this fast paced Gen AI development.

This is great to see and needed as update and adoption of Copilot for consumers is nowhere near the adoption of Chat GPT. Part of Microsoft’s “problem” is they are not great at consumer marketing. Copilot (IMO) offers far more value than ChatGPT and includes many features (as standard) that you need to pay for in ChatGPT.

Will this make you revisit and retry Copilot? Let me know your thoughts?


Posted on

Windows Recall: Enhanced Security& Privacy ahead of October Launch

As Windows 11 24H2 gets ready to release, Microsoft has announced major security and privacy upgrades to its (yet to be released) Windows Recall feature which was the flagship new AI powered feature announced on the back of the Copilot Plus PC announcements back in May.

Recall, which was initially met with scepticism and concerns around security and privacy, has now be significantly updated with stronger and more granular protections for privacy, encryption and identity access to make it ready for its “delayed” release next month.

What is Recall?

Recall takes screenshots of active windows on your PC every few seconds, analyses them on-device using a Neural Processing Unit (NPU) and an AI model, and adds the information to an SQLite database. You can later search for this data using natural language to prompt Windows Recall to retrieve relevant screenshots.

I covered Recall in more detail in an earlier blog

Responding to Customer Feedback


Microsoft’s decision to enhance Windows Recall comes after considerable feedback from customers and privacy advocates. The company initially delayed the public release of Recall, opting to make it available for preview with Windows Insiders. This cautious approach allowed Microsoft to refine the feature based on real-world usage and analysis of how it was used whilst they review ways to address the concerns and enhance security and privacy controls.

Putting Users in control of Recall

One of the most significant changes is that Windows Recall is now strictly opt-in. Users must proactively activate the feature, ensuring that no screenshots are taken or saved without explicit consent. This addresses a major concern about privacy and data security. Additionally, users can remove Recall entirely through the optional features settings in Windows, providing total control over its usage.

Advanced Security and Privacy Measures

Windows Recall now includes several advanced security measures designed to protect sensitive information after feedback, development and testing since it was announced in May this year.

Firstly – Recall is an optional feature and can also be removed entirely from the Windows Installation. If a user doesn’t proactively choose to turn it on, recall is off by default, meaning snapshots will not be taken or saved.

If Recall is enabled, all snapshots and associated data are encrypted, with encryption keys protected by the device’s Trusted Platform Module (TPM). This module is tied to the user’s Windows Hello login information and biometric identity, ensuring that no data leaves the computer without the user’s explicit request. Recall snapshots are also only accessible after users authenticate using Windows Hello credentials. This enhanced sign-in security ensures privacy and actively authenticates users before allowing access to their data

Recall also comes with a sensitive information filter designed to protect confidential data, like passwords, credit card numbers, and personal identification details, by automatically applying filters over this content. This uses AI and pattern matching to look for such information adding another level of privacy protection.

Additionally, Recall includes malware protection features like rate-limiting and anti-hammering measures, which prevent unauthorized access attempts.

Recall: Four Principles of Operation

Microsoft has redesigned Recall to function on four core principles:

  1. User control
  2. Encryption of sensitive data
  3. Isolation of services, and
  4. Intentional use.

Recall is always opt-in. Snapshots are not saved unless you choose to use Recall, and everything is stored locally……Recall does not share snapshots or data with Microsoft or third parties, nor between different Windows users on the same device. Windows will ask for permission before saving any snapshots.

David Weston – VP Enterprise and OS Security, Microsoft.

These principles will ensure that users can keep complete control over their data, with the ability to remove snapshots, pause them, or turn them off at any time. Any future choice to share data will need fully informed and explicit action by the user.

    Image (c) Microsoft.

    Conclusion

    In short, the enhanced Windows Recall feature represents a significant step forward in balancing functionality with security and privacy which show Microsoft are licensing to their users and take privacy and security seriously. By addressing key concerns and implementing robust protections, I believe Microsoft has demonstrated its commitment to user trust and data security. As Recall rolls out to Insiders with Copilot+ PCs in October, it will be interesting to see how these enhancements are received and what further innovations Microsoft will bring to the table. What do you think? Will you be trying this out or uninstalling it?

    When will Windows Recall be released?

    Microsoft announced last month that Recall will start rolling out to Insiders with Copilot+ PCs in October as part of the 24H2 release of Windows 11.

    Posted on

    The “Windows App” now has mobile app support

    Microsoft has given the Windows App “GA” status and released to the masses along with long awaited mobile app support which will open more doors and use cases for Windows Cloud PCs and Virtual Desktops. This will allow businesses to bring the power of Windows to virtually any device. Whether you’re using macOS, iOS, iPadOS, Android, or even another Windows PC, you can now stream a copy of Windows seamlessly.

    You can read the full Microsoft Blog on this > here <

    What’s so good about the Windows App?

    Havig been in preview for some time (previously there were multiple apps to use for different virtualised experiences on Windows such as Remote Desktop app, different websites and third-party apps etc) but now we have a new single experience 🙂 This provides:

    • Unified Experience: The Windows App serves as a single place to streaming all your corporate and development Windows desktops including Windows 365, Azure Virtual Desktop, and Remote Desktop services.
    • Customisable Home screen: Which allows users to tailor the app to suit their needs by pinning specific desktops, configuring the join experience and even simple configuration of things like multi-tasking and app switching with Windows 11 (known as Windows 365 Switch).
    • Multi-Screen Support: The Windows App lets users customise and extend their experience (just like a traditional / physical desktop) with multiple display support.
    • USB Redirection: Windows App allows full support of local USB devices including speakers, mics, webcams, storage devices, and printers as if they are directly connected to your Cloud PC.
    • Single Sign On – The Windows App supports single sign on with Windows 365 and AVD with Entra ID.

    Who can use the Windows App?

    Presently, the app is limited to Microsoft work and school accounts, making it ideal for professionals and students who need to access their work PCs remotely. It’s not available for consumers, but it does make Windows 365 and AVD simple to use on personal BYOD devices that need to access work devices. Something I do often.

    Downloading the Windows App

    The Windows app is available for download from the Microsoft Store and the Apple App Store. It is also available on the Google Play store but is now in public preview.

    User Experience

    The user experience is fantastic and shows the attention to detail, listening to user feedback and alignment with the core Windows Development team. Microsoft have said that the Windows App will start shipping as standard out of box app on Coporate Devices running Windows 11 too.

    Windows 365 Desktop on Samsung S24 via TV

    Windows App on Samsung S24 through TV

    The image above (which is pretty cool) is Windows 365 Running on my Samsung S24 displayed through a TV (using Samsung Dex) – and yes, I am using Copilot on PowerPoint.

    Windows 11 Experience below

    The Future

    I’d love to see Windows App come to more devices like high-end TVs and tablets in the future just like Microsoft have done with Xbox Game Streaming.

    Proudly powered by WordPress