As Windows 11 24H2 gets ready to release, Microsoft has announced major security and privacy upgrades to its (yet to be released) Windows Recall feature which was the flagship new AI powered feature announced on the back of the Copilot Plus PC announcements back in May.
Recall, which was initially met with scepticism and concerns around security and privacy, has now be significantly updated with stronger and more granular protections for privacy, encryption and identity access to make it ready for its “delayed” release next month.
What is Recall?
Recall takes screenshots of active windows on your PC every few seconds, analyses them on-device using a Neural Processing Unit (NPU) and an AI model, and adds the information to an SQLite database. You can later search for this data using natural language to prompt Windows Recall to retrieve relevant screenshots.
I covered Recall in more detail in an earlier blog
Responding to Customer Feedback
Microsoft’s decision to enhance Windows Recall comes after considerable feedback from customers and privacy advocates. The company initially delayed the public release of Recall, opting to make it available for preview with Windows Insiders. This cautious approach allowed Microsoft to refine the feature based on real-world usage and analysis of how it was used whilst they review ways to address the concerns and enhance security and privacy controls.
Putting Users in control of Recall
One of the most significant changes is that Windows Recall is now strictly opt-in. Users must proactively activate the feature, ensuring that no screenshots are taken or saved without explicit consent. This addresses a major concern about privacy and data security. Additionally, users can remove Recall entirely through the optional features settings in Windows, providing total control over its usage.
Advanced Security and Privacy Measures
Windows Recall now includes several advanced security measures designed to protect sensitive information after feedback, development and testing since it was announced in May this year.
Firstly – Recall is an optional feature and can also be removed entirely from the Windows Installation. If a user doesn’t proactively choose to turn it on, recall is off by default, meaning snapshots will not be taken or saved.
If Recall is enabled, all snapshots and associated data are encrypted, with encryption keys protected by the device’s Trusted Platform Module (TPM). This module is tied to the user’s Windows Hello login information and biometric identity, ensuring that no data leaves the computer without the user’s explicit request. Recall snapshots are also only accessible after users authenticate using Windows Hello credentials. This enhanced sign-in security ensures privacy and actively authenticates users before allowing access to their data
Recall also comes with a sensitive information filter designed to protect confidential data, like passwords, credit card numbers, and personal identification details, by automatically applying filters over this content. This uses AI and pattern matching to look for such information adding another level of privacy protection.
Additionally, Recall includes malware protection features like rate-limiting and anti-hammering measures, which prevent unauthorized access attempts.
Recall: Four Principles of Operation
Microsoft has redesigned Recall to function on four core principles:
User control
Encryption of sensitive data
Isolation of services, and
Intentional use.
Recall is always opt-in. Snapshots are not saved unless you choose to use Recall, and everything is stored locally……Recall does not share snapshots or data with Microsoft or third parties, nor between different Windows users on the same device. Windows will ask for permission before saving any snapshots.
David Weston – VP Enterprise and OS Security, Microsoft.
These principles will ensure that users can keep complete control over their data, with the ability to remove snapshots, pause them, or turn them off at any time. Any future choice to share data will need fully informed and explicit action by the user.
Image (c) Microsoft.
Conclusion
In short, the enhanced Windows Recall feature represents a significant step forward in balancing functionality with security and privacy which show Microsoft are licensing to their users and take privacy and security seriously. By addressing key concerns and implementing robust protections, I believe Microsoft has demonstrated its commitment to user trust and data security. As Recall rolls out to Insiders with Copilot+ PCs in October, it will be interesting to see how these enhancements are received and what further innovations Microsoft will bring to the table. What do you think? Will you be trying this out or uninstalling it?
When will Windows Recall be released?
Microsoft announced last month that Recall will start rolling out to Insiders with Copilot+ PCs in October as part of the 24H2 release of Windows 11.
Microsoft yesterday, announced the next stage of the evolution of Microsoft 365 Copilot with Wave 2. Amongst the many new features was the launch of Copilot Pages. This innovative feature is the first step into the new evolution of Copilot which is set transforming how employees interact with Microsoft AI in a new collaborative environment.
What are Copilot Pages?
Copilot Pages is a dynamic, persistent canvas integrated into Copilot chat, designed to facilitate what Microsoft call “multiplayer AI collaboration”. It allows users to turn insightful Copilot responses into durable, editable content that can be shared with teams for further collaboration.
“This is an entirely new work pattern – multiplayer, human to AI to human collaboration”. | Jared Spataro | VP of AI at Work | Microsoft.
Copilot Pages -Key Features
Dynamic Collaboration: With Copilot Pages, employees can work directly with Copilot on a shared page, prompting and refining responses together as a team rather than individually in silos.
Persistent Canvas: The pages are persistent, meaning collaborative efforts are saved and can be revisited and edited at any time by anyone.
Team Learning: This feature encourages learning from each other’s prompts, enhancing the overall quality and depth of the information gathered.
Getting Started with Copilot Pages in 5 Steps
Access Copilot Pages: Open your Copilot chat and look for the new “Pages” tab. Click on it to create a new page or access existing ones.
Create a New Page: Click on “New Page” to start a fresh canvas. You can name your page to keep your projects organized.
Collaborate with Your Team: Invite team members to your page by sharing the link. Everyone can contribute by adding prompts, refining responses, and editing content.
Save and Revisit: Your pages are automatically saved. You can revisit and edit them anytime, ensuring your collaborative efforts are always up-to-date.
Share and Export: Once your page is finished, you can share it with others outside your team or export it for presentations, reports, or further analysis.
Check out the Microsoft Video for more.
Where are Copilot Pages Stored?
Copilot Pages are .loop files stored in a new user-owned SharePoint Embedded container. IT Admins can manage these files using Loop admin switches and other governance tools. The feature supports various compliance and manageability capabilities, including GDPR compliance, Intune device management, and data loss prevention. IT admins manage these .loop files just like any other files (.docx, .pptx, .xlsx, etc.). They support all the features of the SharePoint file system, including everything detailed here.
Additional capabilities, such as programmatic API access for third-party tools, are expected in Q4 CY2024.
Copilot Pages is rolling out “later this month” for Microsoft 365 Copilot subscribers and will soon be available to all Microsoft 365 subscribers. Loop must be enabled in your environment.
This afternoon (16th September 2024), Microsoft passionately announced (almost 9 months after Copilot was officially available to any organisation) the latest updates coming to Microsoft 365 Copilot as part of what they are calling “Wave 2”. The 30-minute-long session, hosted by Microsoft CEO Satya Nadella and Jared- Spataro, unveiled a heap of new features, capabilities and performance enhancements were announced across the entire experience.
Microsoft 365 Copilot (THIS IS NOW IT’S NEW OFFICIAL NAME) provides enterprise data protection, ensuring the same level of security and compliance protection as other services like files, SharePoint, and emails. Microsoft said that significant improvements have also been made to PowerPoint and Excel based on feedback, including the introduction of Python integration in Excel.
Some of these things are “generally available” from today and others are coming in the next few weeks and months. – See the end.
Evolving the purpose and role of Microsoft 365 Copilot
Microsoft told today, how Copilot is evolving from an individual productivity assistant to a collaborative partner at work. Copilot can utilise various content sources such as files, chats, calendar invites, and emails to generate rich outputs based on the needs of the user and teams of people. You will have seen in the various demos how the product demos now showcase how Copilot facilitates collaboration and achieves outcomes, making both personal and teamwork more efficient and effective.
They have also focussed lots on performance and stability enhancements with huge investments in their Azure Data Centres.
Microsoft also wanted to ensure organisations know just how much they focus on providing the same level of enterprise data protection to Copilot as they have with files, email, SharePoint etc.
So, here’s my pick of what’s new and most cool!
1. Copilot Agents
Microsoft is also broadening the definition of “agents“, ranging from personal AI assistants to fully autonomous agents. These agents span across a spectrum, from human-in-the-loop to fully autonomous.
This is the top announcement for me, I think. Agents (aka Custom GPTs,) have been a very popular discussion with my customers. When Microsoft talks about agents, they use it in its broadest term with an agent being anything from an AI assistant helping you retrieve information right (a foundational agent capability), all the way to autonomous support agent, meaning the agent does not need a human to intervene for it or for it to be able to do its work. Wow Right!
You will see Microsoft focusing on agents across the entire spectrum – giving organisations the ability to create agents using natural language to “support whatever custom business process you are trying to automate“. This will be going into public preview later this month Copilot Agent Builder will be part of Copilot Studio as I understand it.
As an example, say an issue out in the field required further research and follow-up and the team keeps all their customer records from deployment info to maintenance reports on a SharePoint site. Like many organisations, there’s loads of valuable information stored here, but it takes ages to sift through it and find what is needed. Now with Copilot Agents, an agent can be built from any SharePoint site library or folder. It’s possible to create an agent with a single clip and in just a few seconds, your agent is ready to be used and shared with your team and it can be simply added to the department’s team’s chat.
Once created, created agents can be customised and things like topics and knowledge can be enhanced as well as the actions it can take. These can be connected to third party apps such as Dynamics 365 Supply Chain Management.
2. Copilot Pages – Powered by Loop
This is the second biggest announcement and combines two of my favourite parts of Microsoft 365 – Copilot and Loop.
Accessed through BizChat, Copilot Pages, allows users to create side-by-side pages for real-time collaboration. Built on Loop components, these pages enable multiple users to work together and update data simultaneously, enhancing teamwork and productivity.
This can be used when you are working in BizChat – pulling Copilot’s response into a sharable canvas (Loop spaces) built for real-time multiplayer collaboration with Al. Copilot can then be used to improve and expand upon subject matter, build visualizations, and bring in additional content.
Biz Chat will be the place where you can start and finish most of your work before you transition it to your format of choice. Within Biz Chat, you’ll also soon see a button to move the output to the final experience – says move to Outlook, move to Word, move to PowerPoint etc., but you can do all of the pre-work in Bizchat which Microsoft’s customers say is where they spend “most” of their time.
3. Biz Chat Enhancements
Copilot Biz Chat, will, as I discussed above have the ability to send output to the final app for you to finish your work. You’ll see a send to button making workflow faster and just feel smoother and more integrated.
4. Utilising Email and Bizchat for Business Insights
Copilot can now use email and Bizchat to identify patterns and information, recall similar situations, and access relevant content from various sources. This feature is designed to help discover strategies such as price reduction, promotional offers, and ad campaigns as example by reasoning over email and chat threads to help solve business challenges.
5. Copilot in PowerPoint Improvements
Copilot democratizes advanced features in Excel by allowing users to use natural language to access them. PowerPoint improvements include the ability to easily build custom narratives, sections, and flow within presentations. Branding options ensure consistency with company logos, fonts, colours, and styles. PowerPoint’s new narrative builder, with creative control over the flow, reordering topics, deleting unwanted ones, and adding new ones.
Copilot helps create presentation outlines quickly, offering image suggestions from approved sources or AI-generated options. It designs slides in company branding with various layout choices.
PowerPoint’s new features include adding picture notes to slides, built-in slide transitions, and animated text. These features help users create professional-looking presentations quickly and easily, using their own corporate-branded content.
Leveraging corporate templates requires that marketing teams integrate their organisations branded assets into a SharePoint OAL (Organization Asset Library) in order to be able to create presentations with organisational images. This is scheduled for release in Q4 2024.
6. Copilot in Word
Copilot in Word has new features including (finally) allowing it to reason over more document sources including emails, chat, meeting content and files etc making this much easier to get documents created while referencing multiple sources of information.
7. Copilot Enhancements in Teams
Improvements are coming to Teams based on user feedback. Copilot can now reason over chat in addition to meeting transcriptions. This entered public preview today.
8. Copilot in Outlook Improvements
Outlook’s new Copilot feature, ‘Prioritise my inbox’, organises emails based on topics, keywords, and important people. It identifies important contacts like your boss and their boss, enhancing email organisation and efficiency.
Since Copilot can reference emails, meetings and attachments as well as knowing who your colleagues are when you are drafting it can save a huge amount of time as it understands the context in which you are working. This new feature is rolling out now, with early access for some insider rings.
Summary
As I am sure you are, I am excited about these new features (and there’s still more to come) and improvements and look forward to your feedback on the announcements.
In summary, here’s what was announced again and when it will be available (according to Microsoft).
Image/Table – (C) Microsoft.
Are there things you were expecting to hear about but didn’t? Oh and if I missed anything, let me know!!!
What’s one of the biggest stumbling blocks to incorporating AI tools like ChatGPT and of course MicrosoftCopilot into daily work? Well, I can tell you that from first-hand experience is it not knowing how or when to use it. In this blog I’ll explore a few scenarios where I believe anyone with a Copilot License can start seeing real tangible value from GenAI today.
What is Copilot in Microsoft 365?
I’m hoping by now that I don’t actually need to answer that one, but… In short Copilot for Microsoft 365 is Microsoft’s Generative AI chat bot, that is grounded (meaning it has access to) your Microsoft email, chat, documents and more and is also integrated (natively) into all your Microsoft 365 apps and services like Word, Excel, Teams, Outlook, Loop etc.
The goal of Microsoft 365 Copilot is to make us all more productive and creative what ever job we do and results from many of the customers we have been working with this past 12 months is impressive.
Overcoming the adoption hurdle
The biggest hurdle to getting regular and good results with Copilot is actually not what the tool can do or can’t, the expertise around ‘good prompting‘, as important as it is, but is in fact, realising the benefits of making Copilot part of everything you do through habit forming.
To do this, we need to get into the habit of using Copilot every day to really see the value we get from it little by little. many of our customers have this same problem and it’s not a Copilot thing, it’s a new technology thing. We are all so busy doing our jobs that many don’t have time to learn new things or try new ways of working.
Good adoption and successful use of any technology requires some input and perseverance from us as users. As we realise the value, we use these technologies more and the value we get from increases exponentially. Think about the first time a company introduced a word processor in place of a typewriter for example!
Adoption and Change Management, whether run internally (as part of any technology deployment) makes a huge difference to successful deployment and Copilot is a big change in how people work and what it can do, so it does need to be handled that way. Stats show that technology projects that have a proper adoption and change programme linked to them are significantly more likely to deliver the desired return on investment. According to Microsoft, proper change management can lead to 85% of users finding tools like Copilot helpful in getting to a good first draft faster.
Adoption and change management is not just training (though that is of course part of it). Its about helping people learn the tools within their roles, to see the benefits and to tell/show other team members so they learn and benefit together. At Cisilion, we know (first hand) and through the dozens of customers we are working with that one of the primary blockers to adoption of Microsoft Copilot is simply not knowing how or when to use it and so simply “forgetting about it”.
My Copilot Hero Scenarios
What follows next is 3 (three) Copilot for Microsoft scenarios that I use all the time that I can honestly say have become habit forming for me and many of my team.
Goodbye Internet Search: Firstly, I very rarely now ever use internet search to find information. Both in work and personal life, whenever I need to find information about something I turn to Copilot. Whether I’m looking at finding out about a new product, event, news story or whether it’s in my personal life, Copilot just gives me the details I need in seconds rather than giving me a page of search results which I have to sift through manually to see what is relevant. If you use SharePoint at work – this becomes even more powerful!
Email and Meetings (and calls): These are definitely the biggest use cases for Copilot in my daily routine. I simply don’t work or handle email and meetings in the same way anymore. One of the things Copilot can do really well is summarise what’s in my inbox and prioritise requests and things that need my attention – especially If I have been away for a few days. The same goes for meetings. I can pay more attention “in” meetings and have Copilot tackle notes for me, summarise things or even check things for me.
Copilot can summarise actions, clarify points, and what is really cool is that it can do this for me even if I can’t actually attend the meeting (through a new feature called “Follow a Meeting“. Copilot in Outlook can summarise long email threads and can even draft replies for me in a professional manner so all I have to do is edit and refine before clicking send. Copilot also works on phone calls if you have Teams Phone by the way!
My Goto First: Copilot is the first place I go when I have a document, presentation or other document to read or reference. What do I mean by that?
Like us all, I get sent a lot of documents to read, review and comment on. I am now in a habit (I think it’s a good one) of using Copilot as my assistant as my first point of call every time. I always ask Copilot to summarise the document (Word does this automatically now when you open a document) so I can quickly understand the key points of the document before I read it more deeply. This is useful for getting up to speed quickly, determining if I need to read it (guess what – sometimes I don’t) or to help me understand the theme as I do read it. I also use Copilot to ask questions about a document (PDF, Word, PowerPoint etc).
I can also ask Copilot questions about the document such as, “does this business case make a clear and strong argument“, or “what is the financial impact of this proposal“, or “what risks have been identified in this project plan“, etc. I can use Copilot to help me spot gaps, or areas that the author might have overlooked or omitted. I can also ask Copilot to summarise things I do not understand in a simpler language or to help me get a new perspective on something.
Summary
Using any new tool, like Copilot sometimes takes time to realise the true value and power of what it can do. Working with Gen AI like Copilot is as revolutionary as the internet was back in the 90s. Many doubted it and now the world would stop without it.
If you are lucky enough to have a Copilot for Microsoft 365 license, then I suggest you try the above. Use it every day and share your successes with your peers. If you don’t have an adoption and training team in house, then reach out to a partner for help, check out the adoption hub at Microsoft or get some ideas from my other blogs, or from YouTube 🙂
Remember, think about and push Copilot to help you get more value at work and at home. Before starting any task, such as a presentation, meeting minutes or follow-up or research, think “Can Copilot help me here?“
Yes – there’s a bit of a learning curve, but the effort you in will be worth it (IMO).
Some video links…
I have a growing handful of use case and scenario videos I am happy to share below… Hope you find the useful. If you do.. Let me know.
Mark your calendars for September 16th, as Microsoft is set to unveil the next phase of Copilot innovation!
Hosted by CEO Satya Nadella and VP of AI at Work Jared Spataro, this short event promises to showcase the next phase of what will continue to evolve the Copilot revolution, which will further see the evolution of what is becoming a game-changer for businesses and tech enthusiasts alike.
What to expect.
There a bunch of things I am expecting to see based on the agenda, the Microsoft 365 Roadmap and other Microsoft posts and community updates. As such here’s what I’m hoping we hear about.
Rebranding and New Features: it will be goodbye to “Copilot in Word” and hello to “Microsoft 365 Copilot in Word”. Yes the kind of re brand and renaming have already announced they are rebranding its Copilot products in a goal to provide a more cohesive experience and consistency in naming. We have already seen this change from Microsoft 365 Copilot to Microsoft Copilot in Microsoft 365…
New Business-Focused Enhancements: With a focus on the business side of Microsoft’s Copilot offerings, they will focus on real life example of how these AI tools can revolutionise the way companies operate with an increased focus on smaller businesses along with enhancement for large enterprises.
From Preview to Release: we expect some of the services like Copilot in Excel to finally become “available” after being in preview for a year, updates to PowerPoint and for Team Copilot to go into public preview and more of the roadmap features to start rolling out such as scheduled prompts and proactive catchup.
Copilot Pro for consumer: I’m hoping to see updates and new features to Copilot Pro Updates. While details are still “under wraps” , I anticipate new features will be announced such as being able to reference files (something Copilot in Microsoft 365 already does) and maybe deeper integration into other apps to make this £19 monthly subscription more worth it.
Registering for the event.
The event is live (and will be available on demand) so to make sure you do not miss out on this chance to elevate your understanding of AI and its potential, Register below.
Back in May, Microsoft unveiled the next generation of PCs with the Copilot + PC which was released for consumers. Today (4th September 2024), Microsoft has once again set a new benchmark with the introduction of Copilot+ PCs for Business users.
Like their consumer counter parts, these next generation “AI devices”, which include the Surface Pro 11th Edition and Surface Laptop 7th Edition, are designed to revolutionise productivity and creativity in the business world. Copilot+ PCs are also shipping from other OEMs such as Dell, Lenovo, Acer, HP etc.
Copilot+ PCs are equipped with the most powerful Neural Processing Units (NPUs) available for Windows PCs, delivering blazing-fast processing power. This allows businesses users to handle the toughest tasks with ease, up to 90% faster than previous models. The integration of advanced AI features, such as live captions and real-time translations, ensures that your team can work smarter and more efficiently.
This blog, re-dives into the main differences between Copilot+ PCs and “non-Copilot PCs”, the improvements over previous models, and why these advancements are crucial for businesses and aims to answer the “why now” questions.
Non-Copilot PCs: Traditional PCs rely more on cloud-based AI processing (since they did not have NPUs), or required the CPU to do the grunt work, which can slow down performance and is dependent on internet connectivity.
Non-Copilot PCs: While still powerful, these devices do not benefit from the same level of AI optimisation and processing efficiency, due to lack of NPU which are key for efficient processing of AI workloads.
Non-Copilot PCs: Typically rely on Wi-Fi or wired connections, which may not offer the same level of mobility and security.
Power, Performance, Productivity
This is the “why now” for Copilot+ PCs. More than just a device refresh, this new class of devices brings exceptional performance, never seen before battery life and the fastest application performance on Windows to date.
Built around the user – Surface Copilot+ PCs provide a seamless and intuitive experience. These devices come with features like adaptive colour, optional OLED and HDR displays, and a flexible kickstand (Surface Pro) making them adaptable to any work environment. The all-day battery life (up to 22 hrs) ensures that your people stay productive without frequent interruptions.
Security: Copilot+ PCs come with advanced security features, including the Microsoft Pluton security processor and Windows Hello biometric authentication. Together these provide robust protection against both physical and digital threats and work seemlessly with your device management tools such as Intune. This comprehensive security framework ensures that your data remains safe and easily managed across the organisation. These enhanced security measures in Copilot+ PCs provide a higher level of protection, making them a more secure choice for businesses handling sensitive data.
Future Proofed Investment : As businesses increasingly turn to AI to innovate, having the right hardware is crucial. Surface Copilot+ PCs are built to scale and adapt as AI capabilities evolve, ensuring that your investment remains relevant and valuable. These devices support local development and execution of AI models, providing the agility needed to stay competitive.
What SKUs are available?
As discussed, there are two standout devices – Laptop 7, Pro 11 and the Surface Pro 5G. Here are the key specs and features from a hardware perspective to note:
Surface Laptop 7
Launch Date: 12th September 2024
Size Options: 13.5″ and 15″
Processors: Snapdragon® X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)
Graphics: Qualcomm® Adreno™ GPU
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
Copilot Key: Yes – for quick access to Copilot in Windows 11
Surface Pro 11
Launch Date: 12th September 2024
Processors: Snapdragon® X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)
Graphics: Qualcomm® Adreno™ GPU
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC – Allows use of the built-in NFC reader to sign in with an NFC security key.
Copilot Key: Yes – for quick access to Copilot in Windows 11
Options: New flex Premium keyboard designed to be used either attached to your Pro for the ultimate laptop set-up or detached as a standalone keyboard for a new level of flexibility.
New Surface Pro 5G
Launch Date: October 2024
CPU Options: Available with Intel I5/I7 and Snapdragon X Plus / Snapdragon® X Elite
NPU: Qualcomm® Hexagon™ (45 TOPs)/ Intel AI boost
Graphics: Qualcomm® Adreno™ GPU / Intel graphics
Copilot key: Key – for quick access to Copilot in Windows 11
Cameras: AI enhanced 1440p Quad HD front-facing Surface Studio camera with ultrawide field of view
NFC– Allows use the built-in NFC reader to sign in with an NFC security key.
Conclusion
Surface Copilot+ PCs stand out due to their advanced AI integration and superior performance. Unlike non-Copilot+ PCs, which may lack dedicated NPUs, Copilot+ PCs offer specialised hardware designed to handle AI tasks efficiently. This results in faster processing times and more accurate AI-driven features.
Video (c) Microsoft
Surface Copilot+ PCs are not just another piece of hardware; they are a strategic investment in your business’s future. By equipping your team with these advanced devices, you can unlock new levels of productivity, security, and innovation, positioning your business for success in an AI-driven world.
Copilot is a super powerful tool but if you are not getting the results you expect, you might be “using it wrong”. This is based on my experience working with organisations large and small over the past year or so.
Momentum continues to increase and we are seeing more and more public case studies show casing the value of Copilot for Microsoft 365. These focus on the “huge” time savings and efficiency gains organisations such as Barnsley Council, Clifford Chance, and Hargreves Lansdown experienced and how it’s now a tool their employees would not be able to give up.
Getting to this stage is not as simple as just allocating a license and turning it on. The “view” of Copilot I see in many organisations, is very different and as such is so important organisations get off on the right foot with Copilot to ensure that their early experiences with Copilot go well, they understand and evaluate where and how it fits and also where it doesn’t (or doesnt yet).
It all starts with the right expections
It’s hardly suprising that expectations of what Copilot can achieve are high. It’s not that they shouldn’t be, but we need to remember that most of what we see online and in demos are staged, based on the “perfect use case”, data in the “right place” and with Copilot embedded across all your apps and services.
You need to make the cool aid before you can drink it.
There are two scenarios with Copilot which I commonly see.
First there are organisations that grab a handful of licenses, allocate them to a bunch of people and then expect Copilot to know everything about everything and do anything you can think of – setting themselves up for a fail or “less successful” trial.
Secondly, there are those that follow the general guidance shared by Microsoft and their Copilot partners, who build a pilot team, annonce the trial (and what they expect of the pilot users), train and educate their users and share feedback amongst the teams to ensure everyone learns from each other before they expand it to more people.
Whilst the second approach, almost always succeeds (assuming the pilot team are engaged and are open to sharing), I still find (in both scenarios) that part of the reason Copilot trials/pilots can fail quickly is that, in my experience, “people” try to go from zero to hero and rather than looking for many small gains, are trying to get Copilot do that one big thing that will totally change their workload and save them hours of manual effort per day or week.
I find this problem goes away in the main, where organisations are working either directly with Microsoft or via their Copilot Adoption Partner, since the specialists they work with have the time to work with the employees to not only coach them through how and what Copilot can do, but also where it (on its own) may not be the answer they are looking for.
So in short, I find that, many people are simply using Copilot wrong, misunderstand what it can and can’t do and then simoly give up on it and go back to what they did before.
It’s not Copilot it’s you!
In this blog, I am going to share the most common Copilot mistaken use cases that make people the most frustrated….and how to fix them….
1. Trying to use Copilot as an automation tool
This is very common. I often see people who have watched the Microsoft marketing videos (often sequence shortened) contour up an image in their mind that Copilot will solve all their business challenges. I see organisations map out end to end business processes they “would like” Copilot to solve for them that are, to be frank, sometimes outside of what Copilot is really designed to (or is able) to do.
Copilot is not an RPA (Robotic Process Automation) tool. Yes, it can do many many things for you – such as reviewing documents, summarising meetings and actions and creating other “things” from them such as summaries, presentations or new documents.
One of things I hear a lot (and experience) is often that Copilot doesn’t (or wont) do things in exactly the way I ask it to and it can be inconsistent if I ask the same thing twice.
This is true and it is one of the “behaviours” of Copilot (and other Generative AI tools like ChatGPT or Gemini). I do find the more specific I am, the more “similar” my responses from Copilot become, but it’s serves back to the point that Copilot is not designed to carry out multi-step activities with a fixed predetermined output. It is also not currently possible to schedule or trigger Copilot based on an event or other trigger. See Prompting.
Tip: Understanding the value and use cases of where Copilot fits into the business process and workflow is key to getting the best results. There are many areas where Copilot will provide real business value (either as a first eye, second opinion, note taker, author or creator). Working with a Copilot specialist partner or building a team of them internally will help the rest of the business get used to working “with” Copilot as the “assistant” it is expecting to be.
One of the most common pitfalls in adopting Copilot is overlooking its grounding capabilities and limitations. Grounding is the term that refers to the context of the data Copilot can access/will access to perform the request you pass it.
One of the unique values of Copilot for Microsoft 365 over “other” Generative AI experiences, is its deep-rooted access, context awareness and understanding of your business data [through the Microsoft Graph] to enhance its functionality and response. This means that, in short, you can ask Copilot about a particular file that someone shared or a meeting you had last tuesday and it will understand the context and content of that scenario and base it’s response around that. This is hugely value and one of the reasons it has so much value in the workplace. You can also point Copilot at specific content that is within your organisation (though these connected services) or via a URL – for example web content.
The limitation of this grounding is also it’s benefit, in that for Copilot to be able to interface with your data (or application services), that data needs to be connected to the Microsoft Graph through either a connector or plug-in. These are sometimes provided (at cost) by the third party provider or can be built by your devops team or your partner.
This is important because if your employees work off data that is stored primarily in a Document Management System (DMS) that is not connected to Microsoft 365, then Copilot will not have visibility over it or it’s data meaning that employees would need to manually copy and paste data from it, to Copilot in order for Copilot to do anything with it.
Tip: When running your initial or later stage Copilot rollout, it’s important to ensure you understand where and how people work in different teams so that you know what data people work on and where it is stored.
This grounding process is key as it allows Copilot to build upon the foundation of previous work, such as project histories or meetings. To maximise Copilot’s potential, it’s important to ensure that relevant data is accessible (through connectors or plug-ins) within Microsoft 365 or stored / migrated to Microsoft 365 (OneDrive, SharePoint etc.). For Copilot to work on meetings, you also need to be using Teams and must ensure they are recorded and/or transcribed.
3. Over simplifying or over complicating Prompts
Another key to Copilot’s effective use is the quality of prompts provided. Unlike an AI powered smart speaker, Copilot can handle really complex and specific requests , allowing you to write up to 2,000 (soon to be 8,000) characters in its input boxes.
This means that prompts can well thought out, detailed and quote refined, leading to more specific and sophisticated responses. I have written other blogs on prompt perfection if you wish to read them.
That said, the key when adopting and getting to know Copilot is to encourage your people / teams to experiment with prompts, iterating them and and refining them to achieve the desired outcomes whilst rememering that the same prompt will rarely generate exactly the same answer.
Whilst simple prompts are often to vague, not specific enough and therefore may not yield the desired/expected results, prompts that are too complex can also be ambiguous, conflict or go “off topic” so getting the right balance is needed.
Tip: Another way to get what you wanted it to make your prompta conversation: Copilot support interative responses meaning that you can have a conversation with it. Writing the perfct prompt is not always easy to do and can be frustrating so feel comfortable in having a conversation with Copilot. You may find the iterative process becomes fundamental to how you work with Copilot and perfecting the response.
You see unlike human assistants, Copilot thrives on repeated, slightly altered instructions to refine its output. This approach requires a shift in mindset from one-shot solutions to ongoing dialogues with Copilot. By embracing this iterative process, businesses can tailor Copilot’s responses to their specific needs more effectively.
4. Not feeding Copilot properly.
One of things I often find when working with Copilot on more “complex” prompts and tasks is that you can tell it to base its response or output based on a specific file that contains the things you want Copilot to do / check / review for me. Whilst Copilot can leverage the Microsoft Search (via Graph API), if you know what file(s), meeting, person etc, you want Copilot to leverage, you can include that in your prompt.
In the example below (a real one that I was working with a customer on), you can see that we are using to Copilot to review some CVs against a Job Description and Criteria document.
Example Copilot for Microsoft 365 Prompt – Grounded with specific data/files
In this example, I am “feeding” Copilot the CVs I want it to review along with a Job Requirements document which contains a table of criteria about the role and the scores available based on this criteria. This means I can focus my prompt on what I need Copilot to do for me using existing data which is used to “ground” it’s response.
Tip: One of the bug bears I hear alot around Copilot is why it can’t fill out a form for me. It cant. However…. you can ask Copilot to create an output for you based on an existing document. The video below shows an example of doing just this.
Conclusion
The integration of Copilot for Microsoft 365 presents a transformative opportunity for businesses.
By educating employees, understanding its grounding capabilities, mastering effective prompting, practising an iterative approach, and implementing a strategic adoption plan, businesses can position their organisations to really see the benefits of Copilot.
I hope the tips above help – welcome your questions and views.
Qualcomm’s Snapdragon X series processors are specifically crafted for PCs, particularly Windows on Arm and Copilot Plus PCs available from HP, Dell, Lenovo, Acer and of course Microsoft Surface. The processors inside these latest generation of devices, integrate the renowned Snapdragon technology from premium smartphones with the demanding performance needs of the PC domain. The goal is to deliver a processor that competes with Intel and Apple in terms of performance, while also offering the energy efficiency typical of smartphones and providing cutting edge NPU performance to power existing and upcoming AI powered applications.
Arm vs Intel: The Copilot Plus PC Revolution
Copilot Plus PCs, like the Surface Laptop 7 are powered by these Snapdragon X Arm chips. The fundamental components shared by all Snapdragon X series chips include Qualcomm’s custom Arm-based Oryon CPU, rather than Intel’s x86, an enhanced version of their Adreno GPU (derived from their mobile devices), the Hexagon NPU for on-chip AI capabilities, and cutting-edge networking technology supporting the latest Wi-Fi 6 & 7 and 5G standards.
On the software front, Microsoft offers an emulation layer within Windows on Arm (WoA) to facilitate the running of x64 applications not yet native to Arm processors. Notably, there is an extensive collection of native Arm applications from Microsoft, Adobe, and other prominent developers.
About the Snapdragon X chipset options
Snapdragon X comes in two major flavours. The X Elite, which powers the first wave of top-tier Copilot Plus PCs, and the X Plus, destined for the more affordable range of Copilot Plus PCs (You’ll see most vendors providing options for both).
Today, Qualcomm has a total of four different Snapdragon X SKUs – three under the X Elite branding and one more affordable X Plus unit. You can see the subtle differences below, with the main differentiator being CPU cores and performance.
All current Snapdragon X models boast a remarkable 45TOPS Neural Processing Unit (NPU), which means they are all equipped to handle the same AI features. An NPU enhances the traditional CPU by adding machine learning (AI) specific computational abilities. An NPU is not only faster but also more energy efficient. This offloads work from the CPU, allowing the NPU to manage AI tasks, similar to how a GPU handles graphics-intensive tasks.
Snapdragon X Elite
12 Oryon CPU cores
Clock speeds up to 4.2Ghz
4.6 TFLOPS GPU (Graphic Processing Unit)
45 TOPS NPU (Neural Processing Unit)
Snapdragon X Plus
10 Oryon CPU cores.
Clock speeds up to 3.4Ghz
3.6 TFLOPS GPU
45TOPS NPU
What about the new Surface Line up?
Snapdragon X offers competitive performance against not just Intel’s latest chips, but also against the Apple M3 and M4. The real star though (not a fan of just CPU benchmarks personally), is that battery life is simply incredible compared to previous generations of devices with initial testing and reports (from others such as here and here) showing these devices comfortably exceeding the demands of a busy workday, positioning these laptops as genuine contenders to the MacBook (which has always somehow always won for battery life). Running emulated x86 apps under emulation will (and does) run the CPU harder which will in turn impact battery life.
This next generation of AI powered PCs sch as Surface Laptop 7 and Surface Pro 10 are two such devices offering superior power, power efficiency and extreeeeeeemley long batter life.
Battery Life Wins
That said, tests by PC Magazine, revealed a result of almost 25 hours usage – making “Surface Laptop one of the longest-latest laptops we’ve ever tested on battery“. In comparison a 13-inch MacBook Air lasted “just” 21 hours and 38 minutes in their testing.
Surface Pro 10 and Surface Laptop 7 are the the first Copilot+ PC which feature these new Snapdragon X Elite and Snapdragon X Pro processors.
PC Magazine said in their comprehensive hands-on review of Surface Laptop 7 that
“…this is easily the best Arm chip we’ve tested yet in a PC. The CPU and GPU performance are there and deliver at least competitive benchmark numbers relative to current-gen Intel and AMD offerings in the early going. Qualcomm is to be commended for that.” | PC Magazine
What is your view on these Copilot Plus PCs? Have you got one yet – what are your first impressions?
In my work life, I am a Technology Officer for Cisilion (a leading UK Microsoft and Cisco technology and service integrator and enabler), but beyond work, I love technology and more importantly, I love to find ways in incorporate new and emerging (or just plain cool) technology into the everyday lives of myself and my family. I’m also a Microsoft MVP, which means I have even more reasons to be a fan and supporter of some of the best and Microsoft – these include Microsoft Designer, Microsoft Clipchamp and of course Microsoft Copilot!
In this blog (with some videos along the way), I’ll show you some of the ways we incorporate the latest Microsoft products into our family activities, routine, and life.
This blog will focus around the recently released Microsoft Designer – which we have been using throughout its development – you’ll see just what a simple to use, yet powerful tool this is and how it has allowed me to blend my professional expertise with my role as a parent and cub leader.
For those new to Designer – you can access it on the web https://designer.microsoft.com or via the mobile app on iOS and Android.
Setting the Scene – About our Family!
I’m married, we have a cat and two young boys (currently nine and seven), the youngest is autistic and the eldest is ADHD (though not officially diagnosed). This means attention to detail is really high, yet patience is low, and they both hate waiting for things or things that take too long and are “boring” are a no no! One loves trains and the other planes (and trains). We created this design in Designer for Christmas Cards in December 2023 🙂
In my work life, I am a Technology Officer, my wife is a teacher that specialises in Special Educational Needs, and in my “spare” time I am a Cub Scout Assistant Leader in my hometown of West Wickham in Kent. My kids love trains, and everything related to them and much of our family time is spend satisfying their craving for train related activities…
Work / Technology Blogs
In my line of work, personal (technical life as a Microsoft MVP) and side-blogger, I use Designer to create inspiring, original and personalised images for blog covers and articles.
The example below is an image design I asked Microsoft Designer to create introducing the new Cyber Security bill announced at the recent Kings Speech in July 2024.
Image Created with Microsoft Designer for a recent Blog
Inspiring Young Minds – Scouting
Consistently looking for ways to ensure young people are ready for the world and life ahead of them, scouting is great. The children learn about working together, solving problems, critical thinking, empathy, the role of people in a community as well some great “life” skills such as exploring the great outside, camping, orienteering, first aid and safety and caring and supporting others.
Technology is a given in schools (well many), the workplace and in the home, but less so in scouting. In the past year, we have been looking at more ways to integrate technology into what we do in simple, yet inclusive ways.
This past year we have been using technology subtly within the “curriculum” without impacting the practical and outdoor nature of the groups purpose. We have digital badges and creative projects and decided early last year (2023) to blend AI design creation into the Cub Scout Group.
After some simple interactive design sessions, we soon had the Cub Scouts designing custom badges, event posters (for a gang show), and promotional advertising (shared over parent social media groups, which not only added a digital touch to what we did, but sparked curiosity and awareness.
Then, last Christmas, the Cubs raised some money for Crisis at Christmas (which fund Christmas dinner and shelter for homeless people) and they together in in groups, created some banner/posters. This was the “winning” one which we used to share the donation to Crisis with
Winning Designer Image from 1st West Wickham Cubs
New Business Ideas
In May 2024, my wife, marketing manager, turned mother, then childminder and now Deputy Pre School manager is looking to venture out and start her our Pre-School aimed at children with Special Education Needs. She had contacted a couple of small graphic design companies to get quotes for a logo design, but then turned to Microsoft Designer Image Creator to see what it could produce. Once she overcame the DALLE-3 “wording and spelling challenges”, she very quickly has a design she loved which she then polished off in Designer Editor. This took minutes and saved her at least £100!
Logo for a new “coming soon” Pre-School
Educating Young People – Showcasing AI Design to Year 2 and Year 4
Towards the end of the summer term, parents were invited to come into my children’s school and talk a bit out their job and an what they do. I had 30 minutes with two classes of year 4 children, followed by a the same with two classes in year 2.
Part of my “talk” involved an interactive session with the children, where we talked about how AI would impact every part of their lives and jobs and used a combination of Microsoft Designer and Microsoft Copilot to create a class mascot and a story to go with it.
End of School Year – Thank you gifts
As the school year ended for my children at the end of July, we bought small teacher gifts and my eldest (nine), took to Designer to create some stickers we could print on sticker paper and attach to the gifts to give them a personalised touch.
Microsoft Designer sticker creation handled the task nicely. We took the images, dropped into PowerPoint to duplicate, and size them, and printed out the stickers to add to plants and chocolates we’d bought/grown for the teaching staff and assistants.
Supporting my children’s passion for Trains
My wider blog on Designer’s capability, is focussed heavily on how we use Designer to add some flair into my son’s hobby around trains and travel. We spend most weekends riding trains, visiting train museums and doing videos about different trains, train lines and doing little challenges.
As we aim to “promote” his videos a little more, we have taken to Microsoft Designer to advertise his work.
Using Microsoft Designer to promote upcoming videos….Endless fun creating different train related images on Microsoft Designer.
Improving our promoting skills
Finally, working with Gen AI tools is a skill in its’ own and takes practice and experimenting to get the “perfect image”. There is a great community of people on social media, including some of the @MSFT365Designer team and users. It’s great to get inspiration from others, share your prompts and take on the challenges of creating new and exciting images.
Why not get involved… Don’t forget to #MicrosoftDesigner.
Get involved in the AI Design Promoting Community
Thanks for Reading
Thanks for reading – I hope this gives some inspiration around how you could use Microsoft Designer for work, personal life, hobbies and more.
I have written a wider blog with video guides about how to use Microsoft Designer, which goes into examples of different ways to use it.⬇️
Microsoft is yet again at the forefront of an AI powered design revolution with formal launch of their AI-powered Designer app which is available on web, and mobile (iOS and Android) after being in preview for a year.
Designer is built all around speed and simplicity, empowering users of any level to quickly create custom images, stickers, greeting cards, and invitations with a professional touch using a wide array of tools, simplified editing tools, a fresh and clean UI and rich AI editing capabilities.
Designer is also free though it does require sign-in with a Microsoft MSA app or Microsoft 365 Personal or Family account. Designer features are also popping up on Commercial apps and services such as Teams. More on this later in the blog.
To do this, simply add square brackets round the elements you want to be “custom” and share the prompt… You can also try many of the pre curated prompts that Microsoft provides in the examples in app.
One of the newest things which was introduced at launch was the concept of design prompt templates. These make help #DesignerCreators with ideas, along with editable prompts to help creative minds get to work quickly. You can simply make any prompt you love (or that people share) with you in a sharable and editable prompt.
To do this, simply add square brackets round the elements you want to be “custom” and copy the prompt to share it with others… You can also try many of the pre curated prompts that Microsoft provides in the examples in app.
Let’s dive into some of the key features. For those that know me, my children love London trains, so the theme of my feature explanation and examples will be very “train centered“.
Firstly, Designer has a rich set of starter apps and templates to help you achive a particular design related task – these range from AI image creation, to greeting cards, social media posts and much much more. You also get some great starter prompts too or creations you can use to get you started if you are having a bit of mind blur! You can access these visually or from the <create> menu at the top of the home page.
Powerful integrated or standalone apps and tools
Designer comes with a full design canvas (this was actually the first part of Designer that was built when the beta debuted about a year ago) along with a growing number of mini apps which make doing simple AI assisted tasks easy and quick. Many of these can also be accessed via the main Designer Canvas (which I highlighted above).
Creating a design from scratch with Microsoft Designer.
The video above is aimed to be a simple whistle-stop tour of the Microsoft Designer Interface. I have used a blank canvas to show just how easy and intuitive it is to create a design from scratch – which in this example is a new design that we will use to promotes my son’s next Train Themed YouTube video.
The sections that follow focus on some of the standalone apps and features that Designer brings in its AI Image Treasure Trove – keep reading!
Using the Designer (mini-apps)
The mobile app – Bringing AI Editing on the Go
The Designer mobile app brings the power of AI editing into the palm of your hand.
It’s a modern, clean app and provides most of the features you get in the browser version with a few things missing – more on that later. In short, you can use the mobile app to easily create images, cards, collages, invitations, drawings and generate decorative borders. The app is also slick and fast – a well-designed and written app.
Since our boys are really into trains, the theme of this and most of the examples will be around trains, as most of our weekends involve trips to train stations and journeys on different trains!!
Starting off, here’s how we used designer to create some inspiring images around the London Underground – using the Designer Mobile App.
The app’s intuitive interface makes it simple for anyone to enhance their creations with a professional touch.
The image below was created with a simple prompt. Designer will even suggest tweaks as you type to help make the image more vibrant and exciting.
Example: Image Restyling
Imagine you’ve taken a photo that’s perfect except for one detail. With Designer, you can easily edit that detail without affecting the rest of the image. The AI-powered tools can recognize and isolate different elements in your photo, allowing you to make precise edits.
Again, this is so quick and easy to use – simple open the tool, select a picture from your gallery (if you have pictures you want to use from your mobile, then you can either use the Phone Link or app, or the QR Code which you can scan with your phone that opens on your phone and lets you simply choose images from your mobile).
You then just choose the restyle image type you would like such as drawing or Claymation, add an optional element and off you go.
Now my only critique with this service/tool is that is not yet available on the mobile app – which to me seems an obvious one to include in mobile – shoot ➡️restyle ➡️post on social.
Example: Collage Creation
Creating a collage is usually quite a time-consuming task and tricky, but not with Designers Collage Creator. Here you can choose/select the photos you want to use, and the Collage app will automatically arrange them into a stylish collage. You can then adjust the layout, add text, and apply filters to perfect your collage.
When you open the Collages app, Designer gives you a set of example designs to give you inspiration or you can start from scratch. You can upload images from your device (or mobile using the QR Code), select background frame design you want and let Designer do its thing. Let’s see in action below…. again, sticking to the train theme!!
Greeting Cards
So, following a trip to London Charing Cross, where my boys got to have a tour of the station (behind the scenes, we used Designer to quickly create a thank you card. For this, we used one of the sample cards and simply modified the prompt. Let’s see this in action.
Create your own ClipArt (and Stickers)
One of the other cool features in Designer is the ability to create Stickers and Clipart. These are quite similar and create process is the same. The main difference being that Stickers have a nice cut-out-able border round them whereas Clipart does not. The main reason for separating them out (I think) is that it’s easier to distinguish between the two types of images – as in, it helps spark imagination.
Designer Clipart (and sticker) creation with a simple prompt.
Here’s another “Train” themed image we created – this was ClipArt using Designer. In the screen shot above, you can see the simple prompt we used and the options it gave us.
Wait there is more – Integration across your Microsoft Apps
The standalone Microsoft Designer app, whilst super intuitive and packed full of features is just the beginning – yet this is just the beginning of the Designer journey. Whilst much of the roadmap is under NDA still, what I can tell you is that Microsoft has already (just) seamlessly integrated Designer into Copilot (both in Copilot Pro for consumer and in the corporate Copilot for Microsoft Space). This has the effect of enhancing capability in apps like Word and PowerPoint, whereby users can now ask Copilot to generate images and designs directly within their documents, streamlining the creative process and making content more personalised and unique.
We have also seen Designer get native integration into Teams Channels and Chat and you’ll start to see it make more appearances across the other Microsoft apps and services.
Designer Document Integration in PowerPoint and Word
Imagine you’re working on a report in Word, or PowerPoint and you need an AI generated graphic to illustrate your point. Instead of switching apps and copying and pasting, you can now use Designer right within Word and PowerPoint to create a custom graphics that fits perfectly with your document’s style and content.
To do this, you can simply ask Copilot in Word or PowerPoint to create an image for you.
Why You Should Try Designer
The Designer app is more than just a tool; it’s a gateway to unleashing your creativity. With its user-friendly interface, AI-powered editing tools, and seamless integration with other Microsoft apps, Designer simplifies the design process, making it accessible to everyone, regardless of their design experience.
Whether you’re a professional designer looking for a convenient way to work on the go, a marketeer who needs some new ideas, a student needing to create presentations for school, or someone who enjoys creating personalised greeting cards for friends and family, Designer has something for you.
Moreover, with the daily boosts offered by Microsoft, you can explore the full potential of the app without any cost. And if you find yourself needing more, the Copilot Pro subscription is a worthwhile investment for the additional benefits it provides.
Conclusion
Microsoft’s Designer app is a game-changer for creators of all levels. With its user-friendly AI tools and cross-platform availability, the possibilities are endless. Embrace the future of design with Microsoft Designer. Try it and use it for free today and see how it can transform your creative process.
As we enter Microsoft’s new fiscal 2025, there a bunch of enhancements coming across the board to the Copilot experience inside the Office Copilot experience which im[acts PowerPoint, Word, Excel and Microsoft Loop. Microsoft regularly update the Office Apps, Team, and rest of their products, including Copilot, but the changes rolling out feel more like a “service pack”!
Here’s the key things coming to the app experiences this month and remember, you can always access the Microsoft 365 Copilot Roadmap –> here <–
AI Powered images coming to PowerPoint and Word.
Microsoft are making it much easier to add visuals to both Word and PowerPoint documents with Microsoft Designer in Copilot. This will make it much easier for content creators to get the right image for a document or presentation and will add to the image options within these apps.
With this update, you will be able to create AI-generated image directly from Word and PowerPoint with a simple prompt in additional to using the existing options for stock images as before.
Up until now, this has required users jumping to a browser to create an image in Bing Image Creator or Microsoft Designers, whereas now, they will be able to do this straight from the Copilot prompt in Word and PowerPoint upon which they will be able to create an image from scratch or find and use an existing image from Microsoft’s stock photography library to select from. Microsoft say that PowerPoint, Designer will automatically add the image into a “compelling slide design”.
Image (c) Microsoft
Additional “Document Support” in PowerPoint
Also coming this month, Copilot will support grounding for presentation creation from both encrypted Word documents and PDF files, providing more options for users to create presentation from. This gives users richer context to build new presentations, in addition to referencing.
Copilot in PowerPoint “General Improvements“
Rolling out in June/July and following lots of feedback from users, creating a new presentation from a Copilot is about to get much better with regards the quality or presentations created with more relevant content and images and improved consistency including:
Refined designs for title, section, and content slides.
Improved presentation structure with agenda, section and conclusion slides.
Enhanced abilities to improve transitions and animations across presentation content.
Copilot is also getting the ability to ground itself on your organisations’ people-centric data and insights from the Microsoft Cloud, Microsoft Graph, and the web using Bing Search. This brings Copilot up to the same level of that of Teams, Copilot Chat and Outlook, meaning that users can stay in the app, ask questions, and maintain focus on creating their presentations without having to jump into dfferent apps or windows.
Copilot in Excel is coming out of Preview
In July, Copilot in Excel is also coming out of “preview”.
The first noticable indication will be that Microsoft drops the “in preview” lable that users currently see when using Copilot in Excel.
Secondly, Copilot in Excel is also getting expanded data structure support, meaning it wont be limited to working with just data in tables. Yes, Copilot in Excel will be able to works on data ranges resembling tables so long as the data being worked on contains a single row of headers on top (such as filtered data). Along with this, Copilot in Excel will also now be able to provide more comprehensive answers, just like Word and PowerPoint, Teams and Outlook,
Next up, the edit box will be available on any Excel worksheet, regardless of the selected cell and Copilot will reason over the nearest table, or data range resembling a table, to the user’s selected grid area on the same worksheet.
Finally, Copilot in Excel will provides more conversational and comprehensive answers to a wide array of Excel-related questions, meaning that users can now receive step-by-step instructions to help with complex formulas, fixing errors in formulas or how to do something in Excel.
Image (C) Microsoft.
Copilot in Loop
Copilot is coming to Loop too – one of my favourite “new” apps, with what Microsoft call “Copilot-assisted Loop page creation”
For those unfamiliar with Microsoft Loop, it is described as “flexible canvases that assist users in organising and sharing their work with teams.”
Loop users can now utilise Copilot to transform a blank page into a structured document primed for team collaboration in record time. Whether starting from scratch or using an existing page or template, Copilot can swiftly generate a Loop page tailored to specific requirements, be it a project plan, a feedback session, or any other collaborative effort.
Last month, Microsoft announced the next generation of AI powered PCs from Microsoft and many other OEMs including Acer and Lenovo which leverage the latest Snapdragon ARM chipsets from Qualcomm. I covered this on a previous post here....
Yesterday (June 18th 2024), Microsoft’s own devices (the Surface Laptop 7 and Surface Pro 11) were officially available today to buy and any pre-orders were shipped to customers worldwide 🙂
Microsoft describes Copilot+ PCs as the “most intelligent” Windows PCs ever created. These new processors are capable of performing over 40 trillion operations per second. These PCs also offer long long long battery life and give access to advanced AI tools.
These latest Copilot+ PCs from Microsoft are sleek, lightweight, and elegantly designed to enhance productivity They ship with dedicated NPUs (for processing AI workloads on-chip) and have the longest battery life of any Surface ever.
Microsoft say that the new Surface Laptop and Surface Pro are Copilot+ PCs, are the fastest, most intelligent Windows PCs on the market. They are available in four colour options and start at $999 Estimated Retail Price (ERP) USD on Microsoft.com or at a Microsoft Experience Center (aka store).
What is a Copilot+PCs?
Copilot+ PCs represent a new category of Windows 11 PCs, equipped with a dedicated neural processing unit (NPU), which is a specialised type of processor designed for AI-intensive tasks such as real-time translations and image generation, capable of executing over 40 trillion operations per second (TOPS).
Are Copilot+PC only available from Microsoft?
No. Copilot+PCs are a new generation of PC devices which combined Windows on ARM (WoA) technology, Snagdragon powered chipsets and new updates and features built into Windows.
Other manufacturers are also making Copilot+PCs include (but not limited to).
Copilot+PCs are designed for personal, small business and commercial/enterprise. Devices for Business such as the Surface for Business Range will start shipping in September 2024. More details can be found here.
What can Copilot+PCs do that others cannot?
Microsoft refers to new Copilot+ PC experiences which will be baked in to the next versions of Windows 11 and are advanced AI features unique to Copilot+ PCs that accelerate your productivity and creativity. This will include new AI features such as Recall, Cocreator in Paint, Windows Studio Effects, automatic super resolution and Live Captions.There are many more coming and expect to see new AI powered experiences such as offline Copilot coming to Copilot+PC devices in the future. These features require powerful neural processing units (NPUs) –so will be exclusive to the Copilot+ PC class of devices.
One super cool feature to call out for gamers is the new Auto Super Resolution (Auto SR) feature which integrates smoothly with Windows, automatically boosting the frame rates of existing games in real time and delivering detailed visuals. This feature is said to surpasses the capabilities of standalone PC hardware. Initially, Auto SR will be exclusive to Copilot+ PCs that have a Qualcomm Snapdragon® X Series processor and will support a select list of games available at a third-party open-source site, which Microsoft has provided compatibility data for.
Do I need a special version of Windows 11?
No – all new Copilot+ PCs running a Snapdragon® X Series processor will have Copilot+ PC experiences pre-installed. Microsoft will be continuing to update and enhance the Copilot+ PC experiences, so there will be new Windows Updates coming which will enable new features delivered as part of the usual Windows Update process. Only Copilot+PCs will get the new AI features.
What about devices with the latest AI chips from Intel and AMD ?
Microsoft are partnering with Intel and AMD as well to bring Copilot+ PC experiences to PCs with their processors in the future.
Microsoft also have a real good FAQ section on their website about Copilot+PCs.
Windows Recall is (was) a new AI powered feature, exclusive for Copilot+PCs that can capture snapshots of your screen every few seconds allowing the user to essentially rewind back to a point in time to back track on work, application state and documents being worked on,
Recall overview (Microsoft)
Announced as the headline feature for the new generation of Copilot+PCs, this new flagship Windows Recall will now arrive at a later date, with a wider public preview coming soon for Windows Insiders.
There has been many questions, concerns and clarity demanded from the public and tech pros about this new feature since it was announced in May, with concerns over whether Microsoft had “gone too far” in finding a use for AI and the new NPU powered Copilot+PCs. The fact this has not been through the usual process of testing my Microsoft’s loyal Windows Insider testing community was also surprising for such a huge new feature.
The first of the new Copilot+PCs are launching next week (June 18th), and in an expected update have said that their headlining “Windows Recall” feature will not be shipped at launch and now arrive a few weeks later in an update.
Is Windows Recall too much?
Recall was heavily criticised after sourced said that recall stored it’s Recall data in an unencrypted state, raising huge concerns among IT experts, users and anti-Windows fans!
Last week, Microsoft released a blog and announcement to try to alleviate these concerns by reassuring people that Windows Recall would encrypt data and require the user to be physically present at the device (via multi factor authentication) to access recall. They were clear however, that not only was Recall safe but they it would ship next week with the arrival of the Copilot+PCs.
The Cisilion Fireside Chat suspected so much.
Just this week, I hosted a fireside chat, and we discussed the view of Recall from a security and privacy violation.
There’s a link to the episode here if you’d like to hear the views of a number of IT leaders…but the view of my customer panel ahead of (the now postponed) launch include:
“We’ve gone to extraordinary lengths to protect our data and here we are Tada you can now just have a look at what Kim was sharing three minutes ago.” [link]
In short, our panel, beleived that Recall might face significant challenges before its implementation, possibly leading to its postponement or modification, especially in enterprise environments. They highlight the need for clear communication, education, and possibly policy changes to address the concerns raised – looks like this is exactly what happened.
Microsoft committed to trust and privacy but is it enough?
Just earlier this week, Microsoft had said that all images are encrypted, stored and analyzed locally, using on-device AI capabilities to understand their context. When logged into your Copilot+ PC, you can easily retrace your steps visually using Recall to find things from apps, websites, images, and documents that you’ve seen, operating like your own virtual and completely private “photographic memory.” You are always in control of what’s saved. You can disable saving snapshots, pause temporarily, filter applications and delete your snapshots at any time.
The question still on people minds is is this enough, how does this work if viewing content other people are sharing on screen when Recall is being used and what happens if a device is compromised or user subject to ransomware or phishing attack and get access to this device…
Postponed not cancelled?
Perhaps to ensure the backlash over recall doesn’t impact Copilot+PC sales, these new devices will not ship with Recall initially. Microsoft have said that Windows Recall will be added in a future Windows update, but has not given a timeframe for when this will be. This will give their huge Windows Insider Community time to test this with Microsoft and provide the much needed feedback, tuning controls and more.
The updated Microsoft blog post states the following:
“Recall will now shift from a preview experience broadly available for Copilot+ PCs on June 18, 2024, to a preview available first in the Windows Insider Program (WIP) in the coming weeks. Following receiving feedback on Recall from our Windows Insider Community, as we typically do, we plan to make Recall (preview) available for all Copilot+ PCs coming soon“
Copilot+PCs still get loads of new AI Goodness.
Of course, Recall wasn’t the only AI infused feature that Copilot+PCs will include, and the other rest of the AI features that Microsoft showcased will still be available to use. These include live captions and translations across all apps, new Windows Studio Effects for meetings and video, new. Image creation and generation tools across the stock Windows Apps including paint and photos.
Time will tell
Time and testing wil tell whether this feature gets simply delayed, hugely altered or scrapped all together. What do you think?
This week, Microsoft have announced that the Custom GPT builder which is included in Copilot Pro subscriptions (aimed at consumer and families) will be removed, in “favour” of enhancing the “in app” Copilot experiences.
We are continuing to evaluate our strategy for consumer Copilot extensibility and are prioritising core product experiences, while remaining committed to developer opportunities….We are now shifting our focus on GPTs to Commercial and Enterprise scenarios and are stopping GPT efforts in consumer Copilot.
Secondly, at £20 per user per month, which is a lot on top of a £79 a year Microsoft 365 Family Subscription, the main value of Copilot Pro is now the image creation boosts in Designer and Bing and the faster/access to GPT4-Turbo models. The in app experiences whilst great are no on par to Copilot for Microsoft 365 since there is currently no ability to reference files in Word or PowerPoint which is a huge thing!
I will stick with it for a bit, but keen to see if Copilot Pro continues and if it does, what new features will be announced to retain consumer interest.
What is Copilot Pro again?
Copilot Pro was announced in January 2024, which, along with enhanced and priority access to image creation tools and GPT-4 Turbo, brings the core features of Microsoft 365 Copilot to individuals and families using Microsoft 365 Personal or Family subscriptions.
What is happening then?
Microsoft are retiring the GPT Builder from Copilot Pro from 10th July 10 2024, after which time, users will no longer have access to any of their custom GPTs or the associated data, as Microsoft will delete them during a specified period.
The decision to retire the GPT Builder feature is part of Microsoft’s strategy to focus on core product experiences and developer opportunities, particularly in commercial and enterprise… I read this as simply update and use of GPT Builder in Copilot Pro is low!
Excited yet pessimistic
As I said in the intro, I’m Anticipated about the upcoming improvementsto the In-AppEnhancements as I feel Copilot Pro was kind of rushed with regards the Office App experiences.
I remain excited, no, hopeful, about the potential improvements to Copilot Pro and would like to see:
Ability to reference local or cloud-based files, akin to the functionality available in Copilot for Microsoft 365. This would significantly streamline workflows and enhance productivity, allowing users like me to seamlessly integrate Copilot Pro into our daily tasks.
Inclusion in more native apps, including OneNote (why is it not there) and Whiteboard.
Generals improvements to PowerPoint to leverage Microsoft Designer (not PowerPoint designer) for images rather than the stock apps or at least as an option.
Ability to read and process more data (give it more tokens) to ensure it can rival the likes of Google (and Now Apple).
I do hope Microsoft doesn’t yet again give up on consumer as they have done so many times with other apps and services and instead refine Copilot based on user feedback, I remain hopeful that the upcoming enhancements will enrich the user experience, making Copilot Pro an even more indispensable tool for consumers, artists, and families worldwide. Microsoft need to keep people in their native apps.
Conclusion
In conclusion, while the retirement of the GPT Builder marks the end of an era, it also signals the beginning of a more focused and user-centric approach to Copilot Pro’s development. I do look forward to the next chapter in Copilot Pro’s evolution and the innovative features it will bring.
Microsoft recently announced “Catch up” feature coming to Microsoft Copilot for Microsoft 365 and Microsoft Teams. Whilst similar functionality can be achieved with your own “custom prompt”, this feature will make it easy for anyone (especially those new to Copilot) to catch up!
This new feature will be available later this month (June) in the Copilot chat within Microsoft Teams or from the web interface at https://copilot.microsoft.com.
Catch up in Teams – Image (c) Microsoft.
This new feature, which is rolling during June and July 2024, brings the following capabilities and benefits.
Stay Informed: The ‘Catch up’ tab provides a centralized place for updates on important meetings and documents.
Action-Oriented insights: Each update comes with a suggested prompt, enabling users to delve into details and take immediate action.
Seamless Integration: Accessible directly within Microsoft 365 and Teams, enhancing productivity without switching contexts.
This new feature should make it easier for users to stay on top of tasks and collaborations with others, making it another valuable addition for Copilot for Microsoft 365 and Teams users.
Availability of Catch up
The rollout begins late June 2024 and is expected to complete by late July 2024. Users will need a Copilot for Microsoft 365 license to access this feature
Cisco’s annual event, Cisco Live 2024, has seen a huge number of new AI-powered innovations and investments from a Cisco as they took to the stage in Las Vegas. This year the focus has been about powering the AI transformation and has been particularly impactful with the introduction and expansion of AI-enriched solutions across networking, security, and observability domains.
Here’s my take aways from the event based on snipits I watched and blogs from Cisco I’ve read over night on how these advancements are set to further transform the tech industry across almost almost every vertical.
Digital Resilience Through AI
Cisco talked about how their AI-powered innovations which are heavily focussed on the platform that drives transformation (the network and connectivity) are designed to enhance digital resilience, combining the power of the network with industry-leading security and observability. This integration simplifies adoption and provides comprehensive visibility across the digital landscape.
$1 Billion AI Investment Fund
Cisco annouced a new Global AI Investment Fund in a bold move to foster industry innovation and customer readiness and likely help them fund and invest into future aquisitions which is becoming common in the industry with start up innovation and backing. This strategic initiative supports Cisco’s vision of an AI-powered future, connecting and protecting organisations of all sizes through Cisco innovative networking and secure cloud technology platforms.
New Strategic Initiatives
Cisco’s collaboration with industry giants like NVIDIA, Splunk (who they aquired earlier this year) , and others, showcases its commitment to customer success and growth. Cisco referenced some of their largest clients including Steve Madden and McLaren F1 Racing that see Cisco continuing to play a vital role as a strategic ally in business and technology across their entire portfolio from network, security observability and collaboration.
New certifications to empower partners
Designed to prepare partners and ensure skills for the AI powered future, Cisco annouced new AI Fundamentals for their Partners including a new Certification in AI. Cisco plan to ensure they continue to equip partners and the workforce with the necessary skills to thrive in an AI-driven landscape which shows no sign on flowing down.
New innovations to their portfolio announced
Cisco has also announced new AI-powered features for their contact center solutions at Cisco Live 2024. These include.
New capabilities in Webex Contact Center will help organizations design and manage conversational self-service experiences. . This means businesses can automate their customer service to a greater extent, improving efficiency and customer satisfaction.
An AI Assistant is being provided for contact center agents. This assistant can help agents handle customer queries more effectively and efficiently, leading to improved customer service.
Cisco is also enabling the integration of third-party virtual agent solutions into their contact center offerings12. This allows businesses to leverage a wider range of technologies and services to enhance their customer service.
There is no AI without data and networking
With Cisco networking already the motorway for connectivity inside data centres, organisations IT and for connecting people, things and devices:
Nexus HyperFabric AI clusters. This is a “breakthrough” AI cluster solution developed in collaboration with NVIDIA and provides a single place to design, deploy, monitor, and assure AI pods and data center workloads. This means businesses can manage their AI workloads more efficiently and effectively.
Cisco Hypershield support for AMD Pensando DPUs and Intel IPUs,which Cisco say will enables enterprises to “realize an AI-driven, distributed security architecture” that seamlessly goes from the cloud to the data centers to the edge while still being highly performing and energy efficient.
Cisco will also combine the the power of the Splunk with their AppDynamics Application Performance Monitoring (APM) with the introduction of Splunk Log Observer for Cisco AppDynamics. This integration will enable users to drive faster troubleshooting across on-prem and hybrid environments.
Excitement overdrive
As a leading UK Cisco Partner, Cisco Live brought excitement to our teams and will give new innovation enablement for Cisco customers.
Cisco’s innovations will help us continue to help out customer build a more resilient, intelligent, and secure digital environment.
We’re thrilled to share incredible innovation and new AI-powered capabilities for our customers this week at Cisco Live… Cisco is uniquely positioned to revolutionize the way infrastructure and data connect and protect organizations of all sizes, and we are confident we are the right strategic partner for our customers in this era of AI.”
Chuck Robbins |Chair and CEO | Cisco.
For Cisco, it represents a step forward in leading the industry towards an inclusive AI-powered future. And for partners like Cisilion, it’s an opportunity to leverage these advancements to deliver cutting-edge solutions to our clients.
It’s not over yet.
Stay tuned for more updates from Cisco Live 2024, as we continue to explore the possibilities of AI and its impact on the world of technology.
Microsoft will be taking Copilot in Excel out of preview next month and are adding a bunch of new and needed features.
The Microsoft 365 Roadmap calls out a key feature (ID: 394275) which will allow users to receive more conversational answers to various Excel-related questions and prompts. This aims to provide less expert Excel users with step by step help on formulas, ability to do more things using natural language and also finally the ability to work on data sets that aren’t confined to being encapsulated in an excel table.
The aim: to emoower everyone to use Excel better whether beginners to more advanced users.
Copilot can assist users in completing tasks by providing helpful steps, including formulas to copy and use. It can also explain formula errors and offer corrected formulas along with additional guidance.
Here’s a breakdown of what can be done with this newer functionality coming to Copilot in Excel:
Understand your questions and requests in a more natural way, making it easier to get the help you need and how to perform what you need in excel
Be able to answer a broader range of Excel-related questions, not just specific tasks and will also be able to provide clear instructions, including relevant formulas.
Help with formula errors by explaining the issue and suggesting corrected formulas with additional guidance.
At Microsoft Build this week (May 2024) Microsoft set out their vision for the next stage of Copilot within Microsoft 365 with the announcement of Team Copilot. With the usual sizzle videos, blogs and presentations on this, the vision for the future of Copilot in Microsoft 365, whereby they see Team Copilot as a meeting moderator, group collaborator, or project manager – making it a “valuable team member” as Microsoft put it.
What is Team Copilot?
Team Copilot is the latest iteration of Copilot for Microsoft 365, designed to assist with tasks and activities across various aspects of team collaboration, projects, and meetings through AI support.
Microsoft say that Team Copilot expands Copilot for Microsoft 365 from a behind-the-scenes personal AI assistant to a valuable new team member, improving collaboration and project management. Team Copilot will act on behalf of a team, a department, or an entire company and you’re always in control – assigning tasks or responsibilities to Copilot so the whole team can be more productive, collaborative, and creative, together. Team Copilot will be available where you collaborate – in Teams, Loop, Planner, and more.
Microsoft showcases capabilities where Team Copilot can serve as a meeting moderator, group collaborator, or project manager, undertaking tasks such as:
Manage meeting agendas, meeting flow and also take notes in the Teams app;
Support employees in better performing their duties and solving problems through proactive notifications, suggested actions and guidance
Oversee project execution by assigning tasks, tracking deadlines, and informing team members of their required contributions.
Like Copilot for Microsoft 365 in the “personal assistant space”, The Team Copilot service will be tightly integrated across Microsoft’s core Office applications, such as Teams, Loop, and Planner.
The need for Adoption & Change Management has never been higher
We love the pace of innovation and change coming across the digital technology eco system. Services like Microsoft 365 have always have a rapid release and new feature cycle with literally hundreds of changes and improvements in development and rollout at any time.
Team Copilot – Image (c) Microsoft
In this rapidly evolving landscape of the AI powered workplace, the integration of Microsoft 365 and Copilot represents a significant leap forward. However, to truly harness the potential of these innovations, organisations need to ensure they have a robust and proven Adoption and Change Management (ACM) service in place. Training and coaching in line with this ACM, ensures that employees are not only aware of the new tools, their potential and how to use them, but also that they are coached and mentored to use them proficiently and to their full extent in order to release the value they offer.
This strategic approach mitigates resistance, fosters a culture of continuous learning, and aligns technological advancements with business objectives, thereby maximizing the return on investment.
Being on a Copilot journey ourselves in my organisation (Cisiilion), I see three paramount reasons why we invested in ACM for our Copilot deployment – these apply to almost all of the organisation we are working with today.
User Competency: Simply providing tools is not enough; employees need guidance to use them effectively. If you don’t have a dedicated ACM team in house, the importance of ensuring there is budget to use ACM services from your technology partner is critical to sccess and bridges the gap between access and ability, leading to increased productivity.
Cultural Integration: Tools like Microsoft Copilot are most effective when they become woven into the organisational fabric. Paying for professional ACM services (or leveraging your own in house team) facilitates this integration, ensuring that new technologies enhance, rather than disrupt, workflows.
Optimised Utilization: Without ACM, there is a risk of underutilization or incorrect use of sophisticated tools, which can negate the benefits. ACM services ensure that organizations extract maximum value from their investments.
In essence, simply dropping a license to a user (we did try that first), without support is akin to providing a car without any driving lessons or road to drive it on – it is the mastery and understanding fostered by ACM that truly puts an organisation in the driver’s seat of innovation and supports their employees in understanding, adopting and getting the best our using these technologies to improve the ways they work and get work done.
When will Teams Copilot be available?
Based on the information shared at Build, a preview version of Team Copilot will be available to Copilot for Microsoft 365 license holders before the end of the year.
You can read more from Microsoft on their official blog –> here <–
The day before Microsoft Build 2024, Microsoft unveiled the future of Windows and the PC with what they dubbed “Copilot+ PC”. The build conference (as expected) has unveiled a plethora of innovations aimed at developers and of course AI has at heart of everything.
One of the key pieces of innovation announced at Build and at the Copilot+PC launch was the new AI-powered ‘Recall’ feature which will be coming soon to Windows 11 and will be enabled on devices with the new Copilot+PC powered by the new SnapDragon Elite processors.
This new AI powered feature promises to revolutionise how we interact with our digital histories, but it also raises important questions about privacy.
What is Microsoft Recall?
Recall is designed to transform searchability and predictive search within Windows 11 by recording / snapshotting user activities on their device. It captures snapshots of your screen every five seconds, allowing you to search and retrieve past activities, including app usage, communications in live meetings, and websites visited – giving you (and it) the ability to rewind time to any point (subject to configuration) to help you find what you need or pick up from where you left off. Your snapshots are then locally stored and locally analysed on your PC.
Microsoft Recall – Image (c) Microsoft
Recall’s analysis allows you to search for content, including both images and text, using natural language. Nothing is shared with other users or used to train their AI models. Privacy, Microsoft say is key!
The Promise of Recall
The benefits of Recall are immense. Imagine being able to revisit any moment of your digital life (work or personal), retrieve information from a past meeting, or recall a website or document you reviewed yesterday, last week or last month. This could significantly boost productivity and ensure no detail is ever lost in the digital ether. To “recall” this information, you simple “describe how you remember” using natural language, and Recall will retrieve the moment you saw it. In Microsoft’s blog post around this, they use this example:
“Trying to remember the name of the Korean restaurant your friend Alice mentioned? Just ask Recall and it retrieves both text and visual matches for your search, automatically sorted by how closely the results match your search. Recall can even take you back to the exact location of the item you saw.”
Do we need Recall – what is wrong with search and history?
Recall does sound awesome and very clever – but are Microsoft is creating a solution for a problem that isn’t really there?
Microsoft said in the announcement “We set out to solve one of the most frustrating problems we encounter daily – finding something we know we have seen before on our PC. Today, we must remember what file folder it was stored in, what website it was on, or scroll through hundreds of emails trying to find it.”
Personally, I think search works pretty well on Windows 11 anyway and Edge has a great history, favourites and collections feature to help me find stuff I was browsing (they even work across devices). So why do we need recall?
Well…Recall will definately build on this make it much mich easier to find things and “go back in time”, essentially giving Windows 11 a “photographic memory,” as Microsoft explains it. The reason I think this will be a really awesome feature is less because I can never find something, but is more about the experience I want and am starting to expect from AI.
A webpage, image or document we are looking at doesnt paint the whole picture and with search these things are isolated. Recall brings this all together. Maybe I was researching a trip or a topic – with recall it can colate the whole story, bringing together context, images, notes, documents, searches, websites together.
Privacy Concerns
Recall’s powerful capability to record and store every action poses significant privacy concerns and social media has been rife with this (no such thing as bad press right). The thought of someone else accessing this data is unsettling, yet Microsoft assures us that the data remains fully encrypted, local, and linked to that user’s profile. It is not shared with anyone, accessible by anyone or used to train their Large Language Models or dor advertising purposes.
Of course, despite this, the potential for misuse cannot be ignored, especially if sensitive information like passwords or financial details appear on-screen so people I guess are rightfully concerned and since this is not actually “available” yet many of the concerns, assurances etc., are not yet “proven” either way.
The integration of Recall into Windows 11 by Microsoft is designed to keep user data secure and private. Personally and knowing how Microsoft always put the user in control of what is and is not enabled in Windows 11, I am personally not concerned, but understand why some might be initially.
Secondly, Recall works on-device and not across the cloud. This means, no data leaves the PC to Microsoft’s servers. Microsoft will not improve its large language models using this particularly sensitive data. Microsoft say that they will also not use the data for targeting advrtisments. Recall data isn’t available to other applications.
To mitigate these concerns, Microsoft has implemented several safeguards:
Recall will not capture InPrivate browsing or DRM-protected content.
Users can pause, stop, or delete captured content at any time
Users can exclude specific apps or websites from being recorded
Users can disable recall and not use it at all.
I also wanted to share directly from Microsoft’s post around this – their approach around privavcy and responsible AI
“Microsoft has been working to advance AI responsibly since 2017, when we first defined our AI principles and later operationalized our approach through our Responsible AI Standard. Privacy and security are principles as we develop and deploy AI systems. We work to help our customers use our AI products responsibly, sharing our learnings, and building trust-based partnerships. For more about our responsible AI efforts, the principles that guide us, and the tooling and capabilities we’ve created to assure that we develop AI technology responsibly, see Responsible AI.
Recall uses optical character recognition (OCR), local to the PC, to analyse snapshots and facilitate search. For more information about OCR, see Transparency note and use cases for OCR. For more information about privacy and security, see Privacy and security for Recall & screenray“.
The Future of Recall
As we move forward, the Recall feature will likely evolve, based on feedback from the Window Insider Community and MVPs. Microsoft will need to continually balance AI innovation with user trust, ensuring that privacy is not sacrificed for convenience and that users are given choice with regards features that record and track usage and interactions. The conversation around Recall is just beginning, and it will be fascinating to see how it shapes the future of digital interaction and privacy.
In conclusion, Microsoft’s Recall stands at the crossroads of technological advancement and privacy. It’s a powerful tool that promises huge benefits but also requires careful consideration and management of privacy concerns. As with any new technology, it will be up to both Microsoft and its users to navigate these waters responsibly.
Would love to hear your views on this? What do you think, excited for this new feature (on the new Copilot+PC hardware) or will you be turning it off or jumping OS!! 🙂
Last week, Cisco reported its Q3 fiscal results which beat market in terms of both top and bottom-line.
Cisco achieved this despite a continued decline in overall revenue, showing that like many of the US tech giants, Cisco have become leaner and more cost effective as an entity. It is also recognition of their shift to a software organisation (that also sells hardware).
As a Cisco partner, we understand why Cisco have attributed the majority of their sales revenue decline being due to their customers still deploying data centre and networking equipment purchased late last year due to shifting busienss priorities and re alignment over hybrid work practices. This is certainly something we have seen some still an overspill from the huge chip and stock shortages we saw in COVID-19…
Cisco remain confident that Q4 will see a turn around. Personally, we (Cisilion) have already seen a great Cisco Q3 personally and expect a great Cisco Q4 with some large networking and data centre refreshes.
Riding the AI Wave
Cisco are also making big step forward in the new AI powered world in two parts.
Aquisitions and Parnering
Firstly, Cisco have recently closed the $28 billion acquisition of security and observability software Splunk. Whilst not yet assimilated and incorporated into Cisco’s mainstream portfolio (this won’t likely happen until mid to late FY25) the aquisition will boost their cybersecurity and AI goals. With Splunk, Cisco is gaining a tool to better compete with their competition such as Palo Alto and Crowd Strike and ensures they remain relevant.
Cisco is also well-aware that in order to grow, they need to join forces and work with the other tech giants that dominate the cloud and modern workplace technologies. Their partnership with Microsoft in the modern work space and alignment with building more services for Azure as well as supporting their digitial market place for software and service sales will also boost their reach.
Last month, Cisco have announced a new partnership with NVIDIA to enable enterprises to quickly deploy and manage secure AI infrastructure with new hardware being announced.
As a Cisco and Microsoft Partner, it is great to see the partnership paying off, and our customers live the choice, flexibility and sustainability offerings possible through the deep integration of Cisco meeting room technology on Teams, their integration with Microsoft Sentinel and the work they have done with Cisco Webex Contact Centre which now offers one of the most feature rich and mature customer experience platforms on both Cisco Webex and for Microsoft Teams.
Through these partnerships and aquisitions, Cisco seemed well placed to help organisations build, power, support, and secure AI
Partnership is great for our customers and for us (Cisilion) as a partner.
The Network: Powering the AI Wave
In a recent interview and video we did to celebrate the opening of our new Customer Experience Centre in London, Chintan Patel (Cisco UK CTO) said that “there is no AI without the network“.
This statement, made by Cisco CTO, underscores the critical role that networks play in the functioning and advancement of AI.
Cisco and Cisilion talking AI with Cisco UK CTO
AI rely heavily on data – they need to ingest, process, and learn from vast amounts of information to function effectively. This data needs to be transported, often across great distances, and this is where the network comes in. Without a robust and reliable network, data cannot be moved efficiently, and AI systems cannot operate at their full potential.
Cisco, with its extensive experience in network provision, is uniquely positioned to provide the high-speed, reliable network infrastructure that AI systems require. Their networks are designed to handle the high data volumes and fast data speeds that AI applications demand.
AI is fuelled by the Data Centre.
The Data Centre is the heart of any AI operation. They house the servers that store and process the data AI systems use and are vital for any organisation or service provider building out training their own AI models.
Having been along time leader in the data centre space, offers state-of-the-art technology, from a a compute and networking stack that help organisations design and build through their partners, modern environments that can handle the intensive computational needs of AI, providing a stable and efficient environment for AI operations.
When we come back to partnership and alliance, some of the largest AI service providers, including Microsoft and Adobe use data centres powered by Cisco (amongst others) and rely on their network and data centre (Azure) to power their AI services like Copilot and Azure AI. Cisco’s advanced network solutions and data centres provide the necessary infrastructure for these companies to run their AI applications effectively.
As we see more organisations look to build their own large and small language models, Machine Learning and AI computational and generative AI, Cisco will be helping to power this AI revolution.
As such their technology infrastructure will plays a crucial role in enabling AI service providers to deliver innovative solutions that drive business growth and societal advancement.
I’m confident this will re innovate the infrastructure market across both businesses and service providers. In conclusion, Cisco’s statement that “there is no AI without the network” rings true. As AI continues to evolve and become more integrated into our daily lives, the role of network and data centre providers like Cisco will only become more critical.
Of course Cisco aren’t the only provider in this space, but I’m impressed with shift and direction Cisco are moving to stay relevant and partner with the other AI giants. As a Cisco partner this is great to see.
To read more about Cisco technology, data centre, observability and network, you can check out their pages below.
