{"id":784627,"date":"2021-12-17T10:04:48","date_gmt":"2021-12-17T18:04:48","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=784627"},"modified":"2024-06-06T18:56:29","modified_gmt":"2024-06-07T01:56:29","slug":"bioacoustics","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/bioacoustics\/","title":{"rendered":"Bioacoustics"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"bioacoustics\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\tAI For Good Lab\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Bioacoustics<\/h1>\n\n\n\n

Leveraging AI to process audio recordings of diverse species<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

Bioacoustics is a cross-disciplinary science that combines biology and acoustics. Usually, it refers to the investigation of sound production, dispersion and reception in animals (including humans). In our research lab, we collaborate with conservation organizations and research labs to leverage machine learning and deep learning models to automatically process and analyze large volumes of audio recordings. Here are a few of the bioacoustics research projects we are working on:<\/p>\n\n\n\n

\n
\n
\"close<\/figure>\n\n\n\n
<\/div>\n\n\n\n

The sounds of the rainforest<\/h4>\n\n\n\n

Listen and learn about the Amazon\u2019s call for conservation through bioacoustics. In the heart of South America lies the Amazon Rainforest, a crucial component of the Earth\u2019s ecological balance. Spanning across nine countries and covering over 5.5 million square kilometers, the Amazon is a critical indicator of the planet\u2019s health.\u00a0<\/p>\n\n\n\n

\n
Listen to our story<\/a><\/div>\n<\/div>\n<\/div>\n\n\n\n
\n
\"AI<\/figure>\n\n\n\n
<\/div>\n\n\n\n

AI-powered conservation for the Amazon<\/h4>\n\n\n\n

Deforestation threatens our planet’s health, with the Amazon losing nearly 2 million hectares in 2022 alone. Project Guacamaya, in partnership with Humboldt Institute, uses AI to combat this crisis: satellite analysis detects illegal deforestation activities, AI-enhanced camera traps streamline wildlife monitoring, and bioacoustics aid species identification.<\/strong> This approach offers efficient monitoring to prioritize action where it’s most needed.<\/p>\n\n\n\n

\n
AI and rainforest preservation article<\/a><\/div>\n\n\n\n
Blog<\/a><\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n
\n
\n
\"animals<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Zero-shot transfer for wildlife bioacoustics detection<\/h4>\n\n\n\n

Building supervised learning models requires manual data labeling which is slow, expensive and error prone. With self-supervised learning models, we are able to learn effective visual representations without human supervision, allowing us to explore clusters of animal calls that are from different species, or different stereotypes of calls from the same species, and also discover new sounds that are of interest.<\/p>\n\n\n\n

\n
Publication<\/a><\/div>\n<\/div>\n<\/div>\n\n\n\n
\n
\"acoustics<\/figure>\n\n\n\n
<\/div>\n\n\n\n

CLAP bioacoustics annotation tool<\/h4>\n\n\n\n

We’ve leveraged CLAP’s group-level generalization capabilities to develop an efficient bioacoustics annotation tool akin to MegaDetector for animal audio detection. By enabling annotators to focus solely on regions of interest rather than listening to entire recordings or deciphering spectrograms, our tool streamlines the annotation process, drastically reducing time, effort, and expertise required. The user-friendly interface can also quickly identify and annotate positive and negative sounds.<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
\n
\"Beluga<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Helping protect beluga whales with deep learning<\/h4>\n\n\n\n

It’s been over a decade since the Cook Inlet beluga was listed as endangered in 2008, and the population continues to decline with a current population estimate of 328 whales. To help understand and mitigate this problem our partners put together an acoustic research program to continuously monitor the beluga whale habitat. Using machine learning our researchers are helping to reduce labor and time for annotation and increase the accuracy of classification results.<\/p>\n\n\n\n

\n
Publication<\/a><\/div>\n\n\n\n
Get beluga sounds code<\/a><\/div>\n<\/div>\n<\/div>\n\n\n\n
\n
\"three<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Using bioacoustics for multi-species classification<\/h4>\n\n\n\n

Acoustic monitoring has gained widespread interest as an ecological tool for wildlife population assessment, conservation, and biodiversity research. Acoustic analyses are often done manually which can be limiting. To enable analysis of entire datasets, accurate, automated sound recognition methods are paramount. In our research, we evaluate deep convolutional neural networks for classifying the calls of 24 birds and amphibian species. This multi-label multi-species classification methodology and its framework can be easily adopted by other acoustic classification problems.<\/p>\n\n\n\n

\n
Publication<\/a><\/div>\n\n\n\n
Get bioacoustic classification code<\/a><\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n
\n

Explore More<\/h4>\n\n\n\n
\n
\n
\n\t
\n\t\t
\n\t\t\t\t\t\tProject<\/span>\n\t\t\tAccelerating Biodiversity Surveys with AI<\/span> <\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n\n\n\n
\n
\n\t
\n\t\t
\n\t\t\t\t\t\tCollection<\/span>\n\t\t\tOpen-source code resources<\/span> <\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"

Bioacoustics is a cross-disciplinary science that combines biology and acoustics. Usually, it refers to the investigation of sound production, dispersion and reception in animals (including humans). In our research lab, we collaborate with conservation organizations and research labs to leverage machine learning and deep learning models to automatically process and analyze large volumes of audio recordings.<\/p>\n","protected":false},"featured_media":798307,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,243062,198583],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-784627","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-audio-acoustics","msr-research-area-ecology-environment","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[696730,696769,696796,757309,757414,769912,787663,967266],"related-downloads":[],"related-videos":[908409],"related-groups":[696544],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Zhongqi Miao","user_id":42462,"people_section":"Section name 0","alias":"zhongqimiao"},{"type":"user_nicename","display_name":"Meghana Kshirsagar","user_id":39736,"people_section":"Section name 0","alias":"mekshirs"},{"type":"user_nicename","display_name":"Shahrzad Gholami","user_id":39757,"people_section":"Section name 0","alias":"sgholami"},{"type":"guest","display_name":"Jane Wang","user_id":798076,"people_section":"Section name 0","alias":""},{"type":"user_nicename","display_name":"Juan M. Lavista Ferres","user_id":39552,"people_section":"Section name 0","alias":"jlavista"},{"type":"user_nicename","display_name":"Rahul Dodhia","user_id":41401,"people_section":"Section name 0","alias":"radodhia"},{"type":"user_nicename","display_name":"Thomas Roca","user_id":41416,"people_section":"Section name 0","alias":"throca"},{"type":"user_nicename","display_name":"Darren Tanner","user_id":41404,"people_section":"Section name 0","alias":"datanner"},{"type":"guest","display_name":"Andres Hernandez Celis","user_id":1026321,"people_section":"Section name 0","alias":""},{"type":"guest","display_name":"Luisa Vargas Daza","user_id":1026324,"people_section":"Section name 0","alias":""}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/784627","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":42,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/784627\/revisions"}],"predecessor-version":[{"id":1121169,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/784627\/revisions\/1121169"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/798307"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=784627"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=784627"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=784627"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=784627"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=784627"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}