Microsoft Begins Testing Two New Copilot Features, Including One That Can View Your Entire Screen
Microsoft Enhances Copilot App with New Features for Windows
Microsoft has made significant strides in improving the Copilot app for Windows by initiating a rollout of two innovative features designed to enhance user experience. These features are currently being tested exclusively for Windows Insiders under the latest app update, specifically version 1.25034.133.0 and above.
What’s New in the Copilot App?
The update adds two main features: Copilot Vision and File Search. These tools aim to provide users with smarter, more context-aware assistance.
Copilot Vision
One of the standout additions is the Copilot Vision tool. This feature allows the Copilot app to analyze the contents of the user’s entire screen. With this capability, the AI assistant can offer more tailored suggestions based on what it sees on display.
How It Works:
- Users can share any browser or app window with Copilot by clicking the designated glasses icon in the composer.
- After sharing, Copilot reviews the content and provides useful insights along with spoken guidance tailored to the user’s task.
- When users are done, they can simply click “Stop” or the “X” icon to stop sharing.
File Search Feature
The second notable feature is File Search. This tool helps users swiftly locate and interact with various files on their devices.
Functionality:
- Users can access the File Search by asking Copilot to find specific documents or files.
- The feature supports a variety of file types, including .docx, .xlsx, .pptx, .txt, .pdf, and .json.
- Users may ask questions like:
- "Can you find my resume?"
- "Open the trip planning document from last week."
- "Review my budget file and report the dining expenses from last month."
To ensure user privacy and control, permissions can be managed in the Copilot Settings under Permission settings, allowing users to dictate what information and files Copilot can access.
Rollout and Availability
As communicated by Microsoft, the new Copilot features will initially be available to insiders in the United States while the File Search functionality will be rolled out to Insiders worldwide. The company intends to conduct this rollout gradually, meaning not every Insider will receive the update at once. This approach enables Microsoft to gather feedback effectively and refine these features before a broader release.
Future of Copilot
The introduction of Copilot Vision and File Search marks a substantial improvement in the Copilot experience on Windows. By providing features that enhance user productivity and streamline tasks, Microsoft aims to make its AI assistant an integral part of the daily workflow for Windows users.
With the ongoing advancements in AI technology, Microsoft’s initiative demonstrates a commitment to improving how users engage with their applications and files. The integration of these features is an exciting peek into the future potential of AI assistants in personal computing.
