{"id":1137041,"date":"2025-04-18T00:00:54","date_gmt":"2025-04-18T07:00:54","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=1137041"},"modified":"2025-04-18T00:00:56","modified_gmt":"2025-04-18T07:00:56","slug":"peace-project-unlocks-ai-applications-in-geology-using-geomap","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/peace-project-unlocks-ai-applications-in-geology-using-geomap\/","title":{"rendered":"PEACE project unlocks AI applications in geology using GeoMap"},"content":{"rendered":"\n<p>When earthquakes hit, they often come with little warning. Each year, about 500,000 earthquakes ripple through the Earth\u2014some are felt, many aren\u2019t, but all are part of a complex and dynamic system that geologists are trying to understand. Earthquakes are notoriously difficult to predict, but a new interdisciplinary effort is using AI to bring us closer. At Microsoft Research Asia, researchers have developed an AI-agent system designed to help geologists understand geologic maps\u2014tools foundational to long-term earthquake assessment and risk analysis. Known as <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/peace-empowering-geologic-map-holistic-understanding-with-mllms\/\">PEACE<\/a> (em<strong>p<\/strong>owering g<strong>e<\/strong>ologic m<strong>a<\/strong>p holisti<strong>c<\/strong> und<strong>e<\/strong>rstanding), the initiative introduces two tools: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/huggingface.co\/datasets\/microsoft\/PEACE\">GeoMap-Bench<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a benchmark dataset for evaluating AI performance on geologic maps, and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/PEACE\">GeoMap-Agent<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, an AI-powered agent to read and analyze them\u2014work recently accepted at CVPR 2025.<\/p>\n\n\n\n<p>Together, they represent a major step forward in bringing vision language models (VLMs) into the realm of earth sciences\u2014and a promising way to speed up and scale geological insights that once took teams of experts days or even weeks to compile.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"why-geologic-maps-matter\">Why geologic maps matter<\/h2>\n\n\n\n<p>Geologic maps are essential tools in earthquake prediction, mineral exploration, infrastructure planning, and environmental assessment. They depict layers of Earth\u2019s crust\u2014faults, rock formations, and tectonic boundaries\u2014often in intricate visual detail. When cross-referenced with tectonic activity and data on the crust\u2019s stability, these maps help scientists assess seismic risk and understand long-term geologic trends.<\/p>\n\n\n\n<p>But interpreting these maps isn\u2019t simple. They\u2019re dense with symbols, annotations, and embedded knowledge that even experienced geologists must study carefully. And while AI has made strides in image analysis and text comprehension, it still struggles to handle the complex, multimodal nature of geologic data.<\/p>\n\n\n\n<p>In many ways, geologic maps are languages in themselves. They\u2019re rich in meaning, but both technical and domain-specific understanding are needed to read them well.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"geomap-bench-establishing-a-benchmark-for-geologic-map-understanding\">GeoMap-Bench: Establishing a benchmark for geologic map understanding<\/h2>\n\n\n\n<p>AI applications in geology are still in their early stages. To close this gap, Microsoft researchers, in collaboration with the Chinese Academy of Geological Sciences and Wuhan University, created GeoMap-Bench\u2014the first benchmark tailored for evaluating geologic maps. The team began by identifying five key capabilities for effective map interpretation:<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Extracting:<\/strong> Can the model retrieve basic information, like title, scale, and, longitude and latitude coordinates?<\/li>\n\n\n\n<li><strong>Grounding:<\/strong> Can it find specific components when prompted by names or intensions?<\/li>\n\n\n\n<li><strong>Referring:<\/strong> Can it match names to their corresponding properties, such as identifying the rock name by its legend color?<\/li>\n\n\n\n<li><strong>Reasoning:<\/strong> Can it perform high-level logical tasks that require connecting information across components or incorporating external knowledge?<\/li>\n\n\n\n<li><strong>Analyzing:<\/strong> Can it comprehensively interpret a given topic on the map and provide detailed and meaningful insights from various perspectives?<\/li>\n<\/ol>\n\n\n\n<p>Based on these competencies, the team created 25 evaluation tasks (Figure 1) and compiled a dataset of over 100 representative geologic maps\u2014sourced from over 7,000 maps provided by the China Geological Survey and the United States Geological Survey. From this, they generated more than 3,000 standardized questions to rigorously test multimodal AI models.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"735\" height=\"615\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/peace-1.png\" alt=\"chart, sunburst chart\" class=\"wp-image-1137046\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/peace-1.png 735w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/peace-1-300x251.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/peace-1-215x180.png 215w\" sizes=\"auto, (max-width: 735px) 100vw, 735px\" \/><figcaption class=\"wp-element-caption\">Figure 1. Distribution of question types in GeoMap-Bench for 25 evaluation tasks<\/figcaption><\/figure>\n\n\n\n<p>\u201cIf AI models can achieve more accurate geologic map interpretation, they will have a profound impact on surveying, geographic information mapping, cartography, navigation and positioning services, and even autonomous driving,\u201d said Zhipeng Gui, director at Wuhan University\u2019s School of Remote Sensing and Information Engineering. &#8220;It could signal a shift in geographic exploration and innovation.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"geomap-agent-accelerating-ai-driven-geologic-map-analysis\">GeoMap-Agent: Accelerating AI-driven geologic map analysis<\/h2>\n\n\n\n<p>Building GeoMap-Bench was the first step. Researchers then used the benchmark to evaluate leading vision language models (VLMs), revealing key limitations in how current AI models interpret geologic maps. Their analysis identified three major challenges:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Resolution:<\/strong> Geologic maps often exceed 10,000\u00d710,000 pixels and require zooming in to identify fine details.<\/li>\n\n\n\n<li><strong>Specialized knowledge:<\/strong> The maps rely on technical symbols and domain-specific knowledge that these models lack.<\/li>\n\n\n\n<li><strong>Diverse visual elements:<\/strong> They contain visual elements\u2014such as the legend, colors, and symbols\u2014requiring capabilities in detection, classification, segmentation, optical character recognition (OCR), and reasoning.<\/li>\n<\/ul>\n\n\n\n<p>&#8220;Geologists urgently need digitalized geologic maps\u2014a relatively straightforward technical goal,\u201d said Yangyu Huang, senior RSDE at Microsoft Research Asia. \u201cBut our ambition goes further: we want AI technology to not only interpret these maps but also support practical applications, like assessing earthquake risks. Geologic maps can serve as a bridge, connecting various knowledge domains to enable more comprehensive insights.&#8221; To meet these challenges and realize this broader vision, the team developed GeoMap-Agent, the first AI assistant built specifically for geologic map analysis. It combines Microsoft Azure OpenAI technology with an architecture designed to handle complex maps. It advances existing models by efficiently handling high-resolution images and the complex relationships between map elements, and by integrating domain-specific knowledge.<\/p>\n\n\n\n<p>GeoMap-Agent is structured around three main modules:<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Hierarchical information extraction (HIE):<\/strong> Breaks down high-resolution maps into manageable sections for detailed analysis, then integrates the results to form a comprehensive interpretation.<\/li>\n\n\n\n<li><strong>Domain knowledge injection (DKI):<\/strong> Supplies the essential field knowledge for question answering, particularly for questions that require reasoning and analyzing.<\/li>\n\n\n\n<li><strong>Prompt-enhanced question answering (PEOA):<\/strong> Crafts tailored prompts using both visual and textual inputs to generate better answers.<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"358\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-22.png\" alt=\"graphical user interface\" class=\"wp-image-1137045\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-22.png 624w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-22-300x172.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-22-240x138.png 240w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\">Figure 2. The GeoMap-Agent framework<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"evaluation-and-performance\">Evaluation and performance<\/h2>\n\n\n\n<p>When tested against other AI models on GeoMap-Bench, GeoMap-Agent consistently outperformed other MLLMs (Table 1). In one case involving earthquake risk analysis (Figure 3), it pulled critical seismic data from maps, integrated expert knowledge, and identified high-risk regions\u2014supporting faster, more informed decision-making.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"418\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-20.png\" alt=\"table\" class=\"wp-image-1137043\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-20.png 624w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-20-300x201.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-20-240x161.png 240w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\">Table 1. Performance of different methods on GeoMap-Bench<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"170\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-21.png\" alt=\"text\" class=\"wp-image-1137044\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-21.png 624w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-21-300x82.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2025\/04\/image-21-240x65.png 240w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\">Figure 3. Earthquake risk analysis responses from GPT-4o (middle) and GeoMap-Agent (right). GeoMap-Agent&#8217;s response is clearer and more comprehensive.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"open-sourcing-a-new-paradigm-for-ai-in-geology\">Open-sourcing a new paradigm for AI in geology<\/h2>\n\n\n\n<p>Specialized maps\u2014such as geologic, meteorological, and hydrological maps\u2014serve as abstract representations of natural phenomena. By addressing core challenges in geologic map interpretation, GeoMap-Agent provides a scalable solution with potential applications across geosciences, Earth sciences, and urban planning.<\/p>\n\n\n\n<p>However, AI-driven geology research requires interdisciplinary collaboration. Certain geological nuances remain difficult for AI to interpret without human expertise, making close cooperation among geologists, AI researchers, and data scientists essential to realizing AI\u2019s full potential in geosciences.<\/p>\n\n\n\n<p>\u201cThe research project GeoMap-Agent has the potential to significantly enhance the efficiency and accuracy of reading, analyzing, and interpreting geologic maps through automation,\u201d said Yang Song, senior engineer at the Chinese Academy of Geological Sciences. \u201cIt can help geologists identify important geological features, such as layers and types of rock, and faults, while providing the data support needed for deeper analysis. For mineral exploration teams, the tool can streamline the extraction of information on mineral distribution and reduce manual errors. Engineers, meanwhile, may be able to more effectively assess geological risks\u2014giving decision-makers a clearer understanding of geological conditions and helping ensure the safety of engineering projects. \u201d<\/p>\n\n\n\n<p>Microsoft Research Asia is committed to advancing AI applications in geology and invites researchers worldwide to contribute to the continued development of GeoMap-Bench and GeoMap-Agent. By expanding the benchmark dataset and refining AI capabilities, we aim to establish a universal AI paradigm for specialized map interpretation.<\/p>\n\n\n\n<p>Both <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/huggingface.co\/datasets\/microsoft\/PEACE\">GeoMap-Bench<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/PEACE\">GeoMap-Agent<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> are open source, offering researchers a foundation for continued progress in geologic AI.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When earthquakes hit, they often come with little warning. Each year, about 500,000 earthquakes ripple through the Earth\u2014some are felt, many aren\u2019t, but all are part of a complex and dynamic system that geologists are trying to understand. Earthquakes are notoriously difficult to predict, but a new interdisciplinary effort is using AI to bring us [&hellip;]<\/p>\n","protected":false},"author":34512,"featured_media":1137047,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":199560,"msr_hide_image_in_river":null,"footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-post-option":[269148,269142],"class_list":["post-1137041","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-post-option-approved-for-river","msr-post-option-include-in-river"],"msr_assoc_parent":{"id":199560,"type":"lab"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1137041","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/34512"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1137041\/revisions"}],"predecessor-version":[{"id":1137048,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1137041\/revisions\/1137048"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1137047"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1137041"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1137041"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1137041"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1137041"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}