Secure research starts with responsible testing.
Reporting Vulnerabilities in AI Systems
This page provides guidance for reporting vulnerabilities in AI systems to MSRC, as well as examples of high-impact research. The official definitions of what constitutes a vulnerability are found in the Microsoft Vulnerability Severity Classifications for AI Systems, Online Services, and Windows. Details of which vulnerabilities are eligible for bounty awards are found on the Microsoft Bug Bounty Program page.
Additional resources and training videos can be found on the MSRC YouTube Channel, for example:
- Zero Day Quest training: Optimizing MSRC AI vulnerability submissions
- Security Chats: High-Impact AI & Office Research
You can find further details about the various Copilots and how to access them at: Decide which Copilot is right for you | Microsoft Learn.
Microsoft Copilot is available at copilot.microsoft.com, in the Microsoft Copilot app, and in the Microsoft Edge sidebar (when signed in with a personal account).
To report a vulnerability in Microsoft Copilot, please follow these steps:
- Obtain the Conversation ID by typing /id in the chat session you want to report.
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: Microsoft Copilot
- Conversation ID: The conversation ID obtained above.
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue.
- Attachments:
- Attach the exact prompt you input to Copilot in a text file named `prompt.txt`.
- Attach a video or screenshots showing all relevant aspects of the interaction with Copilot.
Microsoft 365 Copilot is available at m365.cloud.microsoft, in the Microsoft 365 Copilot app, in the Microsoft Edge sidebar (when signed in with a work or school account), and in Microsoft 365 apps.
To report a vulnerability in Microsoft 365 Copilot, please follow these steps:
- Obtain the Conversation ID by typing /id in the chat session you want to report.
- Report the conversation to Microsoft by clicking the 'I don't like something' (thumbs down) button below Copilot’s response. In the box titled 'Submit feedback to Microsoft' enter 'MSRC report' followed by the conversation ID obtained above.
- If the report involves one or more agents, download the .zip package(s) for the relevant agent(s).
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: M365 Copilot
- Conversation ID: The conversation ID obtained above.
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue.
- Attachments:
- Attach the exact prompt you input to Copilot in a text file named `prompt.txt`.
- Attach a video or screenshots showing all relevant aspects of the interaction with Copilot.
- If the report involves one or more agents, attach the .zip package(s) obtained above.
The following are examples of high-impact research in Microsoft 365 Copilot:
- Microsoft Copilot: From Prompt Injection to Exfiltration of Personal Information · Embrace The Red
- Microsoft 365 Copilot – Arbitrary Data Exfiltration Via Mermaid Diagrams – Adam Logue
Copilot Cowork is available via the Cowork tab within Microsoft 365 Copilot.
To report a vulnerability in Copilot Cowork, please follow these steps:
- Obtain the session ID and task ID by clicking the top-right ⋯ → 'Get support' → 'Copy' to capture the identifiers.
- Report the conversation to Microsoft by clicking the top-right ⋯ → 'Send Feedback' → 'Report a problem'. In the feedback field, enter 'MSRC report' followed by the task ID obtained above. Select 'Capture screenshot' and 'Yes, share' when asked to share relevant prompts, responses, and diagnostic data. Then click 'Submit'.
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: Copilot Cowork
- Conversation ID: The task ID obtained above.
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue.
- Attachments:
- Attach the exact prompt you input to Cowork in a text file named `prompt.txt`.
- Attach a video or screenshots showing all relevant aspects of the interaction with Cowork.
Microsoft Copilot Studio is available at copilotstudio.microsoft.com.
To report a vulnerability in Microsoft Copilot Studio, please follow these steps:
- Obtain the Conversation ID by typing /debug conversationid in the chat session you want to report. Alternatively, you can obtain this from the developer console by selecting “Flag an Issue”.
- Add the agent(s) and any other components related to the vulnerability to a solution and export the solution as a .zip file.
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: Copilot Studio
- Conversation ID: The conversation ID obtained above.
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue.
- Attachments:
- Attach the.zip file of the exported solution obtained above.
- Attach a video or screenshots showing all relevant aspects of the interaction with Copilot.
GitHub Copilot is available in Visual Studio Code, Visual Studio, and other IDEs, as well as at github.com/copilot.
To report a vulnerability in GitHub Copilot, please follow these steps:
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: GitHub Copilot
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue.
- Attachments:
- Attach the exact prompt you input to Copilot in a text file named `prompt.txt`.
- Attach a video or screenshots showing all relevant aspects of the interaction with Copilot.
To report a vulnerability in any other AI system provided by Microsoft, please follow these steps:
- Report the vulnerability via the MSRC Researcher Portal with the following details:
- Product: Copilot, AI + ML, and LLMs
- Product version: Enter the name of the product, service, or system.
- Vulnerability description: Clearly describe the observed behavior, the security impact, and the behavior you would expect.
- Steps to reproduce: Describe the exact steps to reproduce the issue. If your report involves interaction via a webpage, include the full URL of the webpage.
- Attachments:
- If your report involves text-based interaction with the AI system, attach the exact prompt you input in a text file named `prompt.txt`.
- Attach a video or screenshots showing all relevant aspects of the interaction with Copilot.