{"id":968301,"date":"2023-09-19T09:00:00","date_gmt":"2023-09-19T16:00:00","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/announcing-the-deepspeed4science-initiative-enabling-large-scale-scientific-discovery-through-sophisticated-ai-system-technologies\/"},"modified":"2023-09-28T08:01:37","modified_gmt":"2023-09-28T15:01:37","slug":"announcing-the-deepspeed4science-initiative-enabling-large-scale-scientific-discovery-through-sophisticated-ai-system-technologies","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/announcing-the-deepspeed4science-initiative-enabling-large-scale-scientific-discovery-through-sophisticated-ai-system-technologies\/","title":{"rendered":"Announcing the DeepSpeed4Science Initiative: Enabling large-scale scientific discovery through sophisticated AI system technologies"},"content":{"rendered":"\n
\"DeepSpeed4Science<\/figure>\n\n\n\n

Editor\u2019s note, Sept. 28, 2023 \u2013\u00a0<\/strong>The founding collaborators list was updated to correct omissions and the scientific foundation model graph was updated to correct information.<\/em><\/p>\n\n\n\n

Introduction <\/h2>\n\n\n\n

In the next decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scientific exploration, bringing significant advancements across sectors from drug development to renewable energy. In line with Microsoft\u2019s mission to empower every person and every organization on the planet to achieve more, the DeepSpeed (opens in new tab)<\/span><\/a> team at Microsoft is responding to this opportunity by launching a new initiative called DeepSpeed4Science (opens in new tab)<\/span><\/a>, aiming to build unique capabilities through AI system technology innovations to help domain experts to unlock today\u2019s biggest science mysteries.<\/p>\n\n\n\n

The DeepSpeed (opens in new tab)<\/span><\/a> system is an industry leading open-source AI system framework, developed by Microsoft, that enables unprecedented scale and speed for deep learning training and inference on a wide range of AI hardware. Figure 1 demonstrates our basic approach to this new initiative. By leveraging DeepSpeed\u2019s current technology pillars (training, inference and compression) as base technology enablers, DeepSpeed4Science will create a new set of AI system technologies tailored for accelerating scientific discoveries by addressing their unique complexity beyond the common technical approaches used for accelerating generic large language models (LLMs). We work closely with internal and external teams who own AI-driven science models that represent key science missions, to identify and address general domain-specific AI system challenges. This includes climate science, drug design, biological understanding, molecular dynamics simulation, cancer diagnosis and surveillance, catalyst\/material discovery, and other domains.<\/p>\n\n\n\n

\"Figure
Figure 1: DeepSpeed4Science approach: developing a new set of AI system technologies that are beyond generic large language model support, tailored for accelerating scientific discoveries and addressing their complexity.<\/figcaption><\/figure>\n\n\n\n

Our long-term vision is to develop DeepSpeed4Science into a new platform and a unified repository for sharing advanced AI system technologies that support scientific discoveries. DeepSpeed4Science is designed to be inclusive, echoing Microsoft\u2019s AI for Good<\/a> commitment. That is reflected in the initiative\u2019s support for a diverse group of signature science models, representing some of the most critical AI for science investments. In this blog, we showcase how DeepSpeed4Science helps address two of their critical system challenges in structural biology research: (1) eliminating memory explosion problems for scaling Evoformer-centric<\/em> protein-structure prediction models, and (2) enabling very-long sequence support for better understanding the evolutionary landscape of pandemic-causing viruses.<\/p>\n\n\n\n

<\/div>\n\n\n\n\t
\n\t\t\n\n\t\t

\n\t\tSpotlight: AI-POWERED EXPERIENCE<\/span>\n\t<\/p>\n\t\n\t

\n\t\t\t\t\t\t
\n\t\t\t\t\n\t\t\t\t\t\"\"\n\t\t\t\t<\/a>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t
\n\n\t\t\t\t\t\t\t\t\t

Microsoft research copilot experience<\/h2>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

Discover more about research at Microsoft through our AI-powered experience<\/p>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t
\n\t\t\t\t\t\t\n\t\t\t\t\t\t\tStart now\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t<\/div>\n\t<\/div>\n\t\n\n\n

Our launch and key collaborators <\/h2>\n\n\n\n

The new system technologies enabled by DeepSpeed4Science can empower AI-driven scientific discoveries using signature models that represent a wide spectrum of efforts pushing the boundaries of science. Currently, DeepSpeed4Science is honored to support several key science models from Microsoft Research AI4Science<\/a>, Microsoft WebXT\/Bing (opens in new tab)<\/span><\/a> and U.S. DoE National Labs (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

Current Microsoft internal partnerships<\/h3>\n\n\n\n

Scientific Foundation Model (SFM), Microsoft Research AI4Science<\/strong><\/p>\n\n\n\n

\"Graph<\/figure>\n\n\n\n
\"Figure
Figure 2: Scientific foundation model (SFM) and its current exploration: Distributional Graphormer.<\/figcaption><\/figure>\n\n\n\n

Scientific foundation model (SFM) aims to create a unified large-scale foundation model to empower natural scientific discovery by supporting diverse inputs, multiple scientific domains (e.g., drugs, materials, biology, health, etc.) and computational tasks. The DeepSpeed4Science partnership will provide new training and inference technologies to empower the SFM team\u2019s continuous research on projects like Microsoft\u2019s new generative AI methods, such as Distributional Graphormer<\/a>.<\/p>\n\n\n\n

ClimaX, MSR AI4Science<\/strong><\/p>\n\n\n\n

\"Figure
Figure 3: ClimaX is the first foundation model designed to perform a wide variety of weather and climate modeling tasks.<\/figcaption><\/figure>\n\n\n\n

Our changing climate is producing more frequent extreme weather events. To mitigate the negative effects, it is increasingly important to predict where these events will occur. ClimaX<\/a> is the first foundation model designed to perform a wide variety of weather and climate modeling tasks. It can absorb many different datasets with different variables and resolutions, potentially improving weather forecasting. DeepSpeed4Science is creating new system supports and acceleration strategies for ClimaX for efficiently pretraining\/finetuning bigger foundation models while handling very large high-resolution image data (e.g., tens to hundreds of petabytes) with long sequences.<\/p>\n\n\n\n

AI Powered Ab Initio Molecular Dynamics (AI2<\/sup>MD), MSR AI4Science<\/strong><\/p>\n\n\n\n

\"Figure
Figure 4: One million steps of molecular dynamics simulation: RBD-protein interacts with protein inhibitor.<\/figcaption><\/figure>\n\n\n\n

This project simulates the dynamics of large (million-atom) molecular systems with near ab initio accuracy using AI-powered force field models<\/a> while maintaining the efficiency and scalability of classical molecular dynamics. The simulations are efficient enough to generate trajectories long enough to observe chemically significant events. Typically, millions or even billions of inference steps are required for this process. This poses a significant challenge in optimizing the inference speed of graph neural network (GNN)+ LLM models, for which DeepSpeed4Science will provide new acceleration strategies.<\/p>\n\n\n\n

Weather from Microsoft Start, Microsoft WebXT\/Bing<\/strong><\/p>\n\n\n\n

\"Figure
Figure 5: Microsoft Start precipitation nowcast (every 4 minutes for the next 4 hours).<\/figcaption><\/figure>\n\n\n\n

Weather from Microsoft Start (opens in new tab)<\/span><\/a> provides precise weather information to help users make better decisions for their lifestyles, health, jobs and activities (opens in new tab)<\/span><\/a> \u2013 including accurate 10-day global weather forecasts updated multiple times every hour.  Previously, Weather from Microsoft Start benefited from DeepSpeed technologies to accelerate their multi-GPU training environments. Currently, DeepSpeed4Science is working with the WebXT weather team to further enhance Microsoft Weather services with cutting-edge features and improvements.<\/p>\n\n\n\n

Current external collaborators <\/h3>\n\n\n\n

DeepSpeed4Science\u2019s journey started with two pioneering LLM-based AI models for structural biology research: OpenFold (opens in new tab)<\/span><\/a> from Columbia University, an open-sourced high-fidelity protein structure prediction model; and GenSLMs (opens in new tab)<\/span><\/a> from Argonne National Laboratory (opens in new tab)<\/span><\/a>, an award-winning genome-scale language model (opens in new tab)<\/span><\/a> for learning the evolutionary landscape of SARS-CoV-2 (COVID-19) genomes. As the featured showcases for this release, they represent two common AI system challenges facing today\u2019s AI-driven structural biology research. We will discuss how DeepSpeed4Science empowered their scientific discovery in the next section.  <\/p>\n\n\n\n

Additionally, DeepSpeed4Science has recently expanded its scope to support a more diverse range of science models. For example, in our work with Argonne on training a trillion-parameter science model on Aurora Exascale system (opens in new tab)<\/span><\/a>, DeepSpeed4Science technologies will help them reach the performance requirements and scalability needed for this critical mission. Furthermore, by collaborating with Oak Ridge National Lab (opens in new tab)<\/span><\/a> and National Cancer Institute (NCI) (opens in new tab)<\/span><\/a> on cancer surveillance, DeepSpeed4Science will help enable high-fidelity extraction and classification of information from unstructured clinical texts for the MOSSAIC project (opens in new tab)<\/span><\/a>.  DeepSpeed4Science technologies will also be adopted by Brookhaven National Laboratory (opens in new tab)<\/span><\/a> to support development of a large digital twin model for clean energy research by using LLMs to produce more realistic simulation data. You can find more detailed information about our external colleagues and their science missions at DeepSpeed4Science (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

Partnership showcases <\/h2>\n\n\n\n

Showcase (I): DeepSpeed4Science eliminates memory explosion problems for scaling Evoformer-centric<\/em> structural biology models via DS4Sci_EvoformerAttention<\/em><\/strong><\/p>\n\n\n\n

\"Figure<\/figure>\n\n\n\n
\"Figure
Figure 6: OpenFold predictions for PDB chain 7B3A_A as the model trains.<\/figcaption><\/figure>\n\n\n\n

OpenFold<\/strong> (opens in new tab)<\/span><\/a> is a community reproduction of DeepMind\u2019s AlphaFold2 (opens in new tab)<\/span><\/a> that makes it possible to train or finetune AlphaFold2 on new datasets. Researchers have used it to retrain AlphaFold2 from scratch to produce new sets of model parameters, studied the early training phase of AlphaFold2 (Figure 6), and developed new protein folding systems.<\/p>\n\n\n\n

\"Figure
Figure 7: Peak memory requirement for training variants of the multiple sequence alignment (MSA) attention kernels (with bias) with the maximum possible training sample dimension in OpenFold. (Left) The original OpenFold implementation with EvoformerAttention used in AlphaFold2. The memory explosion problems in training\/inference for these types of protein structure prediction models are common. Particularly, state-of-the-art FlashAttention cannot effectively support such science attention variants. (Right) A new solution from DeepSpeed4Science called DS4Sci_EvoformerAttention significantly reduces OpenFold\u2019s peak memory requirement for training by 13X without accuracy loss.<\/figcaption><\/figure>\n\n\n\n

While OpenFold does include performance and memory optimizations using state-of-the-art system technologies, training AlphaFold2 from scratch is still computationally expensive. The model at the current stage is small in absolute terms, with just 93 million parameters, but it contains several custom attention variants that manifest unusually large activations. During the \u201cfinetuning\u201d phase of a standard AlphaFold2 training run, the logit tensor produced in just one of these variants–one designed to attend over the deep protein MSAs fed to the model as input–is in excess of 12GB in half precision alone, dwarfing the peak memory requirements of comparably sized language models. Even with techniques like activation checkpointing and DeepSpeed ZeRO optimizations, this memory explosion problem heavily constrains the sequence lengths and MSA depths on which the model can be trained. Furthermore, approximation strategies can significantly affect the model accuracy and convergence, while still resulting in memory explosion, shown as the left bar (orange) in Figure 7.  <\/p>\n\n\n\n

To address this common system challenge in structural biology research (e.g., protein structure prediction and equilibrium distribution prediction), DeepSpeed4Science is addressing this memory inefficiency problem by designing customized exact attention kernels for the attention variants (i.e., EvoformerAttention<\/em>), which widely appear in this category of science models. Specifically,\u202fa set of highly memory-efficient DS4Sci_EvoformerAttention kernels enabled by sophisticated fusion\/tiling strategies and on-the-fly memory reduction methods, are created for the broader community as high-quality machine learning primitives. Incorporated into OpenFold, they provide a substantial speedup during training and dramatically reduce the model\u2019s peak memory requirement for training and inference. This allows OpenFold to be experimented with bigger and more complex models, and longer sequences, and trained on a wider spectrum of hardware. Detailed information about this technology can be found at DeepSpeed4Science (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

Showcase (II): DeepSpeed4Science enables very-long sequence support via both systematic and algorithmic approaches for genome-scale foundation models (e.g., GenSLMs)<\/strong><\/p>\n\n\n\n

\"Figure
Figure 8: GenSLMs: 2022 ACM Gordon Bell Winning COVID Model (a 25B\/33B dense model based on GPT-NeoX). It is used to learn the latent space that describes biologically meaningful properties for SARS-CoV-2 genomes. This GIF is visualizing an important protein family, malate dehydrogenase, and viewing a projection of the latent space colored by important features such as sequence length and GC content (the ratio of the content of the nucleic acids guanine and cytosine in comparison to adenine and thymine. It measures the ability of a DNA strand to withstand heat).<\/figcaption><\/figure>\n\n\n\n

GenSLMs<\/strong> (opens in new tab)<\/span><\/a>, a 2022 ACM Gordon Bell award (opens in new tab)<\/span><\/a> winning genome-scale language model from Argonne National Lab, can learn the evolutionary landscape of SARS-CoV-2 (COVID-19) genomes by adapting large language models (LLMs) for genomic data. It is designed to transform how new and emergent variants of pandemic-causing viruses, especially SARS-CoV-2, are identified and classified. GenSLM represents one of the first whole genome-scale foundation models which can generalize to other prediction tasks. A good understanding of the latent space can help GenSLMs tackle new domains beyond just viral sequences and expand their ability to model bacterial pathogens and even eukaryotic organisms, e.g., to understand things such as function, pathway membership, and evolutionary relationships. To achieve this scientific goal, GenSLMs and similar models require very long sequence<\/em> support for both training and inference that is beyond generic LLMs\u2019 long-sequence strategies like FlashAttention (opens in new tab)<\/span><\/a>. Through DeepSpeed4Science\u2019s new designs, scientists can now build and train models with significantly longer context windows, allowing them to explore relationships that were previously inaccessible.<\/p>\n\n\n\n

\"DeepSpeed
Figure 9: Maximum sequence lengths of GenSLM models supported by different frameworks at different scales. The hardware profiled here are NVIDIA DGX nodes with eight 40G A100 GPUs per node.<\/figcaption><\/figure>\n\n\n\n

Specifically, at system level, we release the newest Megatron-DeepSpeed (opens in new tab)<\/span><\/a> framework for very-long sequence support along with other new optimizations (opens in new tab)<\/span><\/a>. Scientists can now train their large science models like GenSLMs with much longer sequences via a synergetic combination of our newly added memory optimization techniques on attention mask and position embedding, tensor parallelism, pipeline parallelism, sequence parallelism, ZeRO-style data parallelism and model state offloading. Figure 9 demonstrates that our new release enables the longest sequence length for GenSLMs\u2019 25B and 33B models by up to 12X<\/em> and 14X<\/em>, respectively, over the previous Megatron-DeepSpeed. In terms of supported sequence lengths, this new framework also significantly outperforms NVIDIA\u2019s Megatron-LM by up to 9.8X and 9.1X for the 25B and 33B models, respectively. For example, GenSLMs\u2019 25B model can now be trained with a 512K sequence of nucleotides, compared to the Argonne team\u2019s original 42K sequence length on 64 GPUs. This drastically improves model quality and scientific discovery scope with no accuracy loss<\/em>. Additional support for domain scientists who prefer algorithmic strategies like relative position embedding techniques is also integrated in this new release (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

Summary and roadmap <\/h2>\n\n\n\n

We are very proud and excited to announce the DeepSpeed4Science initiative along with several R&D highlights and achievements. Starting today, we will host our new initiative at DeepSpeed4Science (opens in new tab)<\/span><\/a>, including information about our external colleagues, and current and future DeepSpeed4Science technology releases. One of our high-level goals is to generalize AI system technologies that broadly address the major system pain points for large-scale scientific discoveries. We hope scientists around the world will enjoy the new capabilities unlocked by DeepSpeed4Science through open-sourced software. We are looking forward to better understanding the AI system design challenges that block your discovery progress. We sincerely welcome your participation to help us build a promising AI4Science future. Please email us at deepspeed-info@microsoft.com<\/a>. We encourage you to report issues, contribute PRs, and join discussions on our\u202fDeepSpeed GitHub (opens in new tab)<\/span><\/a>\u202fpage.<\/p>\n\n\n\n

\n
DeepSpeed<\/a><\/div>\n\n\n\n
Contact us<\/a><\/div>\n<\/div>\n\n\n\n

Acknowledgements <\/h2>\n\n\n\n

Core DeepSpeed4Science Team:  <\/h3>\n\n\n\n

Shuaiwen Leon Song<\/a> (DeepSpeed4Science lead), Minjia Zhang<\/a>, Conglong Li<\/a>, Shiyang Chen, Chengming Zhang, Xiaoxia (Shirley) Wu<\/a>, Masahiro Tanaka<\/a>, Martin Cai<\/a>, Adam Graham, Charlie Zhou, Yuxiong He<\/a> (DeepSpeed team lead)<\/p>\n\n\n\n

Our Founding Collaborators (in alphabetical order):<\/h3>\n\n\n\n

Argonne National Lab team<\/strong>: Rick Stevens, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Thomas Gibbs, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin<\/p>\n\n\n\n

AMD<\/strong>: Ashwin Aji, Angela Dalton, Michael Schulte, Karl Schulz<\/p>\n\n\n\n

Brookhaven National Lab team<\/strong>: Adolfy Hoisie, Shinjae Yoo, Yihui Ren. <\/p>\n\n\n\n

Columbia University <\/strong>OpenFold<\/strong> team<\/strong>: Mohammed AlQuraishi, Gustaf Ahdritz <\/p>\n\n\n\n

Microsoft Research AI4Science team: <\/strong>Christopher Bishop, Bonnie Kruft, Max Welling, Tie-Yan Liu, Christian Bodnar, Johannes Brandsetter, Wessel Bruinsma, Chan Cao, Yuan-Jyue Chen, Peggy Dai, Patrick Garvan, Liang He, Elizabeth Heider, PiPi Hu, Peiran Jin, Fusong Ju, Yatao Li, Chang Liu, Renqian Luo, Qi Meng, Frank Noe, Tao Qin, Janwei Zhu, Bin Shao, Yu Shi, Wenlei Shi, Gregor Simm, Megan Stanley, Lixin Sun, Yue Wang, Tong Wang, Zun Wang, Lijun Wu, Yingce Xia, Leo Xia, Shufang Xie, Shuxin Zheng, Jianwei Zhu<\/p>\n\n\n\n

NVIDIA<\/strong>: Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar<\/p>\n\n\n\n

Oakridge National Lab team<\/strong>: Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi Hanson, Thomas E Potok, Massimiliano (Max) Lupo Pasini, Kate Evans, Dan Lu, Dalton Lunga, Junqi Yin, Sajal Dash , Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu<\/p>\n\n\n\n

Princeton University<\/strong>: William Tang, Kyle Felker, Alexey Svyatkovskiy (Microsoft liaison) <\/p>\n\n\n\n

Rutgers University: <\/strong>Hang Liu<\/p>\n\n\n\n

WebXT<\/strong> Weather team<\/strong>: Pete Luferenko, Divya Kumar, Jonathan Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov <\/p>\n","protected":false},"excerpt":{"rendered":"

Editor\u2019s note, Sept. 28, 2023 \u2013\u00a0The founding collaborators list was updated to correct omissions and the scientific foundation model graph was updated to correct information. In the next decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scientific exploration, bringing […]<\/p>\n","protected":false},"author":42735,"featured_media":968769,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Shuaiwen Leon Song","user_id":"42567"},{"type":"user_nicename","value":"Bonnie Kruft","user_id":"41919"},{"type":"user_nicename","value":"Minjia Zhang","user_id":"36335"},{"type":"user_nicename","value":"Conglong Li","user_id":"39318"},{"type":"user_nicename","value":"Martin Cai","user_id":"32856"},{"type":"user_nicename","value":"Yuxiong He","user_id":"35084"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[1],"tags":[],"research-area":[13556],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[264846],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-968301","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research-blog","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[851467],"msr_impact_theme":["Computing foundations"],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[788837,678390],"related-events":[],"related-researchers":[{"type":"user_nicename","value":"Bonnie Kruft","user_id":41919,"display_name":"Bonnie Kruft","author_link":"Bonnie Kruft<\/a>","is_active":false,"last_first":"Kruft, Bonnie","people_section":0,"alias":"bonniekruft"},{"type":"user_nicename","value":"Martin Cai","user_id":32856,"display_name":"Martin Cai","author_link":"Martin Cai<\/a>","is_active":false,"last_first":"Cai, Martin","people_section":0,"alias":"mcai"}],"msr_type":"Post","featured_image_thumbnail":"\"DeepSpeed4Science","byline":"","formattedDate":"September 19, 2023","formattedExcerpt":"Editor\u2019s note, Sept. 28, 2023 \u2013\u00a0The founding collaborators list was updated to correct omissions and the scientific foundation model graph was updated to correct information. In the next decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences.…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/968301","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/42735"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=968301"}],"version-history":[{"count":40,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/968301\/revisions"}],"predecessor-version":[{"id":971271,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/968301\/revisions\/971271"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/968769"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=968301"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=968301"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=968301"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=968301"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=968301"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=968301"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=968301"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=968301"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=968301"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=968301"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=968301"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}