Excitingly, Copilot Vision is now rolling out for Windows 11 users who are part of the Windows Insider Program (encompassing Release Preview, Beta, Dev, and Canary channels).Initially available in the United States, this innovative AI feature is part of the Copilot app version 1.25034.133.0 and higher. Microsoft plans to make it accessible to users globally, as detailed in their official blog post.
Moreover, Microsoft is extending Copilot Vision functionality to Microsoft Edge users, further enhancing the versatility of this AI tool.
Understanding Copilot Vision
Copilot Vision is a unique feature that facilitates screen sharing between the Microsoft Copilot app and any browser or application. By sharing a specific window, this AI chatbot can “see”and comprehend the on-screen content. This capability enables it to provide timely assistance, answer inquiries, or guide users verbally through intricate tasks.
If you are using Microsoft Edge, accessing Vision for help with your web activities is seamless using the Copilot option. Additionally, Copilot Vision is available on iOS and Android for Copilot Pro subscribers, allowing voice interactions along with screen and camera access.
Importantly, Copilot Vision functions with any app or website, barring those containing restricted or DRM-protected content.
This guide aims to equip you with the essential steps to begin using Copilot Vision on Windows 11 and Microsoft Edge.
Initiate Copilot Vision on Windows 11
To utilize Copilot Vision, follow these straightforward steps while navigating a web browser or app:
-
Launch the Copilot app.
-
Click on the “Share screen with Copilot” icon (depicted as glasses) beside the text prompt.
-
Select the desired screen and confirm by clicking the Share button.
-
Pose your queries to Copilot for assistance.
-
To halt sharing, click the Stop button.
Following these steps, Copilot will be prepared to analyze the screen’s contents and assist you with various inquiries. For instance, you can seek guidance on utilizing a specific application feature or ask for clarification on task completion steps.
Initiate Copilot Vision on Microsoft Edge
To access Copilot Vision in Microsoft Edge, proceed with these steps:
-
Launch the Microsoft Edge browser.
-
Navigate to the web page where you seek assistance from Copilot.
-
Click the Copilot button located at the top right corner.
-
Activate voice interactions by pressing the “Talk to Copilot” button (illustrated as a microphone).
-
Ask for assistance, as Vision is automatically enabled.
-
(If desired) Click the “Copilot Vision” (glasses icon) next to the microphone button to activate the feature specifically.
-
To stop sharing your browser screen, click the “Copilot Vision” icon again.
Upon completing these steps, feel free to converse with Copilot about elements displayed on your screen. If you decide to disable Copilot Vision in Microsoft Edge, visit edge://settings/appearance/copilotAndSidebar and toggle off the “Allow Copilot Vision to view your webpage” setting.
Notably, the Copilot app for Windows 11 does not come with an option to turn off the feature because it operates on an opt-in basis. It’s essential to acknowledge that Copilot Vision activates solely during your session, ensuring it doesn’t remain on continuously. The feature will also deactivate after a predetermined period of inactivity.
Also, Microsoft ensures that user images, voice audio, and context are not recorded or stored. However, voice interactions will be transcribed and retained as part of your history, which you can delete at will. Importantly, no data is captured during web usage for AI training purposes.
Frequently Asked Questions
1. What is Copilot Vision and what does it do?
Copilot Vision is an innovative AI feature that allows users to share their screen with the Microsoft Copilot app. This feature enables the AI to “see” and comprehend your screen’s contents, providing timely assistance and insights through voice interaction, whether you’re using apps or browsing the web.
2. How can I enable Copilot Vision on my Windows 11 device?
To get started with Copilot Vision on Windows 11, open the Copilot app, click the “Share screen with Copilot”button, select the desired screen, and confirm sharing. You can then start asking Copilot for assistance with your tasks.
3. Is my data secure while using Copilot Vision?
Yes, your security is prioritized. Copilot Vision is only active during your sessions, and no user images, voice recordings, or context are stored. Transcriptions of voice interactions can be deleted anytime, and no data is used for AI training purposes.
Leave a Reply