Human language technologies
Researching software and systems that bridge the linguistic divide between people and machines to make communicating with computers as natural as speaking with family and friends.
Microsoft Research Blog
Microsoft Turing Universal Language Representation model, T-ULRv2, tops XTREME leaderboard
Today, we are happy to announce that Turing multilingual language model (T-ULRv2) is the state of the art at the top of the Google XTREME public leaderboard (opens in new tab). Created by the Microsoft…
Video
Domain-specific language model pretraining for biomedical natural language processing
Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general-domain corpora, such as in newswire and web text.…
Webinar
Domain-specific language model pretraining for biomedical natural language processing webinar
In this webinar, Microsoft researchers Hoifung Poon, Senior Director of Biomedical NLP, and Jianfeng Gao, Distinguished Scientist, will challenge this assumption by showing that for domains with abundant unlabeled text, such as biomedicine, pretraining language…
Publication