Trace Id is missing
Moderation and enforcement

Content detection

How we use Technology to detect harmful content

We use a multi-layered approach to protect our users from harmful content and conduct.

We deploy the hash-matching technologies PhotoDNA and MD5 on photo and video content shared through Microsoft hosted consumer services and on content uploaded for visual image searches of the internet, to detect and stop the spread of known illegal and harmful image content. A “hash” transforms images into a series of numbers that can be easily compared, stored, and processed. These “hashes” are not reversible, meaning they cannot be used to recreate the original images. We rely on the derogation permitted by European Union Regulation (EU) 2021/1232 as required, for use of these hash-matching technologies in services governed by EU Directive 2002/58/EC.

We also use machine-learning technologies like text-based classifiers, image classifiers, and grooming detection techniques to discover content or conduct shared through Microsoft hosted consumer services that may be illegal or break our policies. Lastly, we leverage reports from users, governments, and trusted flaggers to bring potential policy violations to our attention. These techniques are uniquely tailored to the features and services on which they are deployed. 

We find it

We have invested in and grown our “classifier” capability to proactively detect violations in certain contexts. A “classifier” is used to recognize and label harmful traits based on a predefined policy, like hate speech. In addition, we have developed ways to detect content that is likely malicious such as viruses on our services.

Others find it

Trusted flaggers may identify to Microsoft potentially illegal or harmful content, conduct, or URLs on our services so that we may take action. Trusted flaggers are designated institutions that work with Microsoft either by agreement or as may be required by law. Material reported by trusted flaggers is reviewed against our terms and policies, just like all other reports, and action them accordingly. We do the same if any government or law enforcement reports a potential violation.

You find it

If you have seen or experienced something on a Microsoft service that you are concerned about, you can tell us. Providing detailed information about the content, conduct or other item, including where to find it (such as a link to the content or a copy of an email) will help our reviewers evaluate and take action if it violates our terms and policies. Most products and services have options within the product experience for you to report concerning content or other users conduct. You can also report concerns. Be careful when reporting that you don’t send illegal material. Use links to the content you’re reporting, so we can find it to address it.

Content review

Human reviewers consider images, video, messages, and context.

Policies

Microsoft content and conduct policies explain what is not allowed on our services.