Exploring the New ‘Vision’ and File Search Features in Copilot
Microsoft Copilot Upgrades for Windows
Microsoft has made significant announcements regarding enhancements to its Copilot application at the start of the week. Some of these improvements are currently being tested by Windows Insiders. The latest updates include features like Copilot Vision and advanced file search options, which enhance how users interact with their computers.
What is Copilot Vision?
Copilot Vision is a new feature that enables the AI to "see" your screen’s content. This means you can ask Copilot about the websites you are visiting, documents you are editing, or songs you are listening to without needing to take screenshots or copy-paste information. This functionality was first introduced on the web last year and is now available in the Windows Copilot application.
Key Features and Functions
- Real-time Interaction: Users can interact with the AI about what is visible on their screen.
- Voice Activation: Most communications with Copilot occur through voice, enhancing the user experience.
- Contextual Assistance: Whether planning a vacation or shopping online, Copilot Vision can assist by providing relevant suggestions based on what you are currently viewing.
Microsoft has emphasized that users retain full control over what Copilot can access. Data is securely handled, with all information being deleted after each session of Copilot Vision, addressing any potential privacy concerns.
Enhanced File Search Capabilities
Another noteworthy enhancement is the improved file search feature. This allows Copilot to locate, open, and discuss files stored on your device using natural language queries. For instance, you could ask Copilot to find your résumé or to retrieve a slideshow you were working on recently.
Benefits of File Search
- Easy Access: Quickly search for documents or files using simple phrases.
- Content Queries: You can inquire about the contents of your files. For example, you might ask Copilot to extract financial data from a spreadsheet.
- User Control: Similar to Copilot Vision, users can manage the permissions for file access through the settings in the application.
How to Test the New Features
These features are still being finalized for the general user version of Windows. However, those interested in trying them can join the Windows Insider Program. This program allows users to gain early access to new features.
Steps to Join the Insider Program
- Sign Up: Visit the Windows Insider Program website to register.
- Access Beta Channel: Once registered, navigate to the Windows Update section in Settings to enroll in the beta channel for Windows 11.
- Download the Beta Version: After enrolling, you will receive an update, installing the beta version on your computer.
- Install Latest Copilot Version: Ensure you have version 1.25034.133.0 or later from the Microsoft Store for the latest features.
Using Copilot Vision and File Search
To use Copilot Vision, click on the glasses icon found next to the main input box within the Copilot for Windows app. You’ll be prompted to choose which application or browser window to share with Copilot. Chat with the bot using your voice, and end the session by clicking the Stop or X buttons.
File search is integrated within the Copilot app. Users can type or speak their queries naturally, such as, “What were the locations I shortlisted in my vacation plan document last week?” As with any AI tool, it’s advisable to double-check the answers for accuracy on important matters.
As more users join the testing phase, Microsoft aims to gradually roll these features out to a broader audience in the coming months.
