Copilot Labs

Copilot Vision is a new way to share your experience with AI as you navigate the web or view the world from your phone. It’s like having a second set of eyes that will instantly scan, analyze, and offer insights based on what Copilot sees. When you activate Copilot Vision, Copilot can view your browser webpage or mobile camera feed and use its voice to answer questions and interact with you.

We are rolling out Copilot Vision in Edge, iOS, and Android to all Copilot Pro subscribers in the United States, and are excited to expand to more users soon.

Copilot Vision is available to Copilot Pro subscribers in Microsoft Edge and Copilot for Android and iOS apps in the US.

Today, Copilot Vision for Edge allows Copilot to see what’s on your screen, whereas Copilot Vision in Mobile is about what you allow Copilot to see from your device’s camera. Both allow you to have a conversation about what you see with Copilot.

Open Edge browser on your desktop. Make sure you're signed in to your personal Microsoft account. There are two ways to access the Copilot Vision feature today:

• From the Copilot sidepane in your Edge browser: In your Edge browser window, tap the Copilot icon in the top right corner to open Copilot in the sidepane. Then, tap the icon at the bottom of the sidepane to begin a session with Vision.
• From your Edge browser: A dark gray line at the bottom of your Edge browser window is a notch indicating it is Copilot. Click the notch to expand the composer and select the icon to begin a session with Vision.

From your Android or iOS, Copilot Vision can be accessed within Voice mode of the Copilot app. When you begin a voice conversation with Copilot, the camera icon will appear for you to begin Copilot Vision.

No, Copilot Vision is not always on. Vision will only be active when you initiate a Vision session. The first time you open Vision, you must read and acknowledge the privacy notice. When a Vision session is ongoing, the Copilot composer will have a Vision glasses icon indicating that you are in an active Vision session. Within ten or more minutes of inactivity the Vision session will automatically disconnect. Also, when you close the Edge window, your Vision session ends.

To use Vision again, click on the glasses icon in the Composer to start a session with Vision. If you want to end a session, you may do so by clicking on the x button to exit the Vision session or closing the Edge window.

Only Copilot’s model responses are being logged to enable monitoring of unsafe interactions and outputs. User images, voice audio, and context will not be logged or stored. For Copilot Vision in Edge, when using voice, your conversation is transcribed as part of your conversation history. You may delete the chat history at any time.

No. No image, context, or user conversations are retained, transcribed, or logged. Once the session ends, all such data is deleted.

No, we are not capturing, storing, or using any data from publishers to train our models. Once the Copilot Vision session ends, all images, audio, and context are deleted. Model responses are being stored to enable monitoring of unsafe interactions. A transcript of your conversation with Vision is stored in your conversation history to enhance Copilot's memory and is not used for training or personalization. You may delete the chat history at any time.

No, Vision remains on until you end the Vision session by either closing the Edge window or exiting from the experience in the Copilot Composer. You can check to see whether Vision is on or off by looking for a visible hue surrounding the window.

Copilot Vision works with most sites, except those containing harmful or adult content.

When you visit a site that is not currently enabled for Copilot Vision, the Copilot Composer at the bottom of the screen will show a crossed eye, and the model will refuse to discuss the content on the page. For more information, see our Terms of Use.

You can indicate what pages you want Copilot to see by turning Vision on or off. During this preview period we will gather feedback on how people want to use Vision. We continue to prioritize user preferences and privacy as we build an experience that gives people control over what they want Copilot Vision to see.

No. Copilot Vision will not limit your ability to visit websites in any way. It simply functions as an AI companion as you browse and can be invoked when you want Copilot's help. However, Copilot Vision will not be able to see the context of all websites and a crossed out Vision icon will appear in the composer to indicate this.

Copilot Vision does not engage directly with the web on your behalf; it’s there to answer questions rather than take actions. Copilot may highlight content on the page to help you find the relevant information. It will not click, enter text, or scroll on your behalf.

Security and digital safety are top priorities for Microsoft. Copilot Vision will not be accessible on offensive and harmful sites, and Copilot cannot be used for harmful, offensive, or illegal topics. To learn more visit Empowering responsible AI practices | Microsoft AI.

At this time Vision is only a part of the consumer Copilot offering. You are required to be signed in to your personal Microsoft account.

Yes. If you would like to revert to the previous Copilot experience on Edge without Copilot Vision, you can do so from your Edge Settings. Go to the Copilot and sidebar tab and toggle off “Allow Copilot Vision to view your webpage”.

Copilot Vision in Mobile is an opt in feature within the voice mode.

Copilot Vision and Recall are different features with different goals in mind:

• Vision works strictly in the context of your Edge browser. You can turn this feature on when you want Copilot's assistance with a page you have open. Vision will not 'remember' content from past browsing sessions. One way to turn Vision off, besides turning it off in the Copilot composer, is to simply close out of the Edge browser window. Future browsing sessions will not reference past browsing activity.
• Recall is a feature that will only be supported on Copilot+ PCs. For Copilot+ PC users who opt in, Recall takes encrypted snapshots of a user's PC screen across apps, websites, images, or documents. Snapshots are then locally stored and locally analyzed on the user's device. Recall will operate like the user's own virtual, private “photographic memory” on their Copilot+ PC. Learn more at Privacy and control over your Recall experience - Microsoft Support.