The day before Microsoft Build 2024, Microsoft unveiled the future of Windows and the PC with what they dubbed “Copilot+ PC”. The build conference (as expected) has unveiled a plethora of innovations aimed at developers and of course AI has at heart of everything.
One of the key pieces of innovation announced at Build and at the Copilot+PC launch was the new AI-powered ‘Recall’ feature which will be coming soon to Windows 11 and will be enabled on devices with the new Copilot+PC powered by the new SnapDragon Elite processors.
This new AI powered feature promises to revolutionise how we interact with our digital histories, but it also raises important questions about privacy.
What is Microsoft Recall?
Recall is designed to transform searchability and predictive search within Windows 11 by recording / snapshotting user activities on their device. It captures snapshots of your screen every five seconds, allowing you to search and retrieve past activities, including app usage, communications in live meetings, and websites visited – giving you (and it) the ability to rewind time to any point (subject to configuration) to help you find what you need or pick up from where you left off. Your snapshots are then locally stored and locally analysed on your PC.
Recall’s analysis allows you to search for content, including both images and text, using natural language. Nothing is shared with other users or used to train their AI models. Privacy, Microsoft say is key!
The Promise of Recall
The benefits of Recall are immense. Imagine being able to revisit any moment of your digital life (work or personal), retrieve information from a past meeting, or recall a website or document you reviewed yesterday, last week or last month. This could significantly boost productivity and ensure no detail is ever lost in the digital ether. To “recall” this information, you simple “describe how you remember” using natural language, and Recall will retrieve the moment you saw it. In Microsoft’s blog post around this, they use this example:
“Trying to remember the name of the Korean restaurant your friend Alice mentioned? Just ask Recall and it retrieves both text and visual matches for your search, automatically sorted by how closely the results match your search. Recall can even take you back to the exact location of the item you saw.”
Do we need Recall – what is wrong with search and history?
Recall does sound awesome and very clever – but are Microsoft is creating a solution for a problem that isn’t really there?
Microsoft said in the announcement “We set out to solve one of the most frustrating problems we encounter daily – finding something we know we have seen before on our PC. Today, we must remember what file folder it was stored in, what website it was on, or scroll through hundreds of emails trying to find it.”
Personally, I think search works pretty well on Windows 11 anyway and Edge has a great history, favourites and collections feature to help me find stuff I was browsing (they even work across devices). So why do we need recall?
Well…Recall will definately build on this make it much mich easier to find things and “go back in time”, essentially giving Windows 11 a “photographic memory,” as Microsoft explains it. The reason I think this will be a really awesome feature is less because I can never find something, but is more about the experience I want and am starting to expect from AI.
A webpage, image or document we are looking at doesnt paint the whole picture and with search these things are isolated. Recall brings this all together. Maybe I was researching a trip or a topic – with recall it can colate the whole story, bringing together context, images, notes, documents, searches, websites together.
Privacy Concerns
Recall’s powerful capability to record and store every action poses significant privacy concerns and social media has been rife with this (no such thing as bad press right). The thought of someone else accessing this data is unsettling, yet Microsoft assures us that the data remains fully encrypted, local, and linked to that user’s profile. It is not shared with anyone, accessible by anyone or used to train their Large Language Models or dor advertising purposes.
Of course, despite this, the potential for misuse cannot be ignored, especially if sensitive information like passwords or financial details appear on-screen so people I guess are rightfully concerned and since this is not actually “available” yet many of the concerns, assurances etc., are not yet “proven” either way.
Microsoft has a FAQ section that explains how Recall works. This is something everyone panicking about Recall should read.
Microsoft’s Safeguards
The integration of Recall into Windows 11 by Microsoft is designed to keep user data secure and private. Personally and knowing how Microsoft always put the user in control of what is and is not enabled in Windows 11, I am personally not concerned, but understand why some might be initially.
Secondly, Recall works on-device and not across the cloud. This means, no data leaves the PC to Microsoft’s servers. Microsoft will not improve its large language models using this particularly sensitive data. Microsoft say that they will also not use the data for targeting advrtisments. Recall data isn’t available to other applications.
To mitigate these concerns, Microsoft has implemented several safeguards:
- Recall will not capture InPrivate browsing or DRM-protected content.
- Users can pause, stop, or delete captured content at any time
- Users can exclude specific apps or websites from being recorded
- Users can disable recall and not use it at all.
I also wanted to share directly from Microsoft’s post around this – their approach around privavcy and responsible AI
“Microsoft has been working to advance AI responsibly since 2017, when we first defined our AI principles and later operationalized our approach through our Responsible AI Standard. Privacy and security are principles as we develop and deploy AI systems. We work to help our customers use our AI products responsibly, sharing our learnings, and building trust-based partnerships. For more about our responsible AI efforts, the principles that guide us, and the tooling and capabilities we’ve created to assure that we develop AI technology responsibly, see Responsible AI.
Recall uses optical character recognition (OCR), local to the PC, to analyse snapshots and facilitate search. For more information about OCR, see Transparency note and use cases for OCR. For more information about privacy and security, see Privacy and security for Recall & screenray“.
The Future of Recall
As we move forward, the Recall feature will likely evolve, based on feedback from the Window Insider Community and MVPs. Microsoft will need to continually balance AI innovation with user trust, ensuring that privacy is not sacrificed for convenience and that users are given choice with regards features that record and track usage and interactions. The conversation around Recall is just beginning, and it will be fascinating to see how it shapes the future of digital interaction and privacy.
In conclusion, Microsoft’s Recall stands at the crossroads of technological advancement and privacy. It’s a powerful tool that promises huge benefits but also requires careful consideration and management of privacy concerns. As with any new technology, it will be up to both Microsoft and its users to navigate these waters responsibly.
Would love to hear your views on this? What do you think, excited for this new feature (on the new Copilot+PC hardware) or will you be turning it off or jumping OS!! 🙂
For more detailed information on the feature and its capabilities, please refer to the official announcements and resources provided by Microsoft.