{"id":19793,"date":"2025-10-02T09:05:00","date_gmt":"2025-10-02T16:05:00","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=19793"},"modified":"2025-11-13T12:11:48","modified_gmt":"2025-11-13T20:11:48","slug":"unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/","title":{"rendered":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Agentic AI is the frontier of the AI landscape. These tools show enormous promise, but harnessing their power isn\u2019t always as straightforward as prompting a model or accessing data from Microsoft 365 apps. To reach their full potential in the enterprise, agents sometimes need access to data beyond Microsoft Graph. But giving them access to that data relies on an extra layer of extensibility.<\/p>\n\n\n\n<aside class=\"wp-block-group aside-for-guide has-white-200-background-color has-background has-global-padding is-content-justification-right is-layout-constrained wp-container-core-group-is-layout-60c5958e wp-block-group-is-layout-constrained\" style=\"border-radius:10px;margin-top:var(--wp--preset--spacing--spacing-8);margin-bottom:var(--wp--preset--spacing--spacing-8);padding-top:var(--wp--preset--spacing--spacing-12);padding-right:var(--wp--preset--spacing--spacing-12);padding-bottom:var(--wp--preset--spacing--spacing-12);padding-left:var(--wp--preset--spacing--spacing-12)\">\n<div class=\"wp-block-group is-nowrap is-layout-flex wp-container-core-group-is-layout-298f84b7 wp-block-group-is-layout-flex\" style=\"margin-top:0;margin-bottom:0;padding-top:0;padding-bottom:0\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"132\" height=\"132\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/10\/Engage-with-our-experts_blogs.png\" alt=\"\" class=\"wp-image-20636\" style=\"width:48px\"\/><\/figure>\n\n\n\n<p class=\"has-body-lg-font-size wp-block-paragraph\"><strong>Engage with our experts!<\/strong><\/p>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"margin-top:var(--wp--preset--spacing--spacing-4)\">Customers or Microsoft account team representatives from Fortune 500 companies are welcome to <a href=\"mailto:msitstaff@microsoft.com\">request a virtual engagement<\/a> on this topic with experts from our Microsoft Digital team.<\/p>\n<\/aside>\n\n\n\n<p class=\"wp-block-paragraph\">To meet these demands, many of our teams within Microsoft Digital, the company\u2019s IT organization, have been experimenting with API-based agents. This approach combines the best of two worlds: accessing diverse apps and data repositories and eliminating the need to build an agent from the ground up.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We want to empower every organization to unlock the full power of agents through APIs. The lessons we\u2019ve learned on our journey can help you get there.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The need for API-based agents<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The vision for Microsoft 365 Copilot is to serve as the enterprise UX. Within that framework, agents serve as the background applications that streamline workflows and save our employees time.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For many users, the out-of-the-box access Copilot provides to Microsoft Graph is enough to support their work. It surfaces the data and content they need while providing a foundational orchestration layer with built-in capabilities around compliance, responsible AI, and more.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But there are plenty of scenarios that require access to other data sources.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cCopilot provides you with data that\u2019s fairly static as it stands in Microsoft Graph,\u201d says Shadab Beg, principal software engineering manager on our&nbsp;International Sovereign Cloud Expansion team. \u201cIf you need to query from a data store or want to make changes to the data, you\u2019ll need an API layer.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By using APIs to extend agents built on the Copilot orchestration layer, organizations can apply its reasoning capabilities to new data without the need to fine-tune their models or create new ones from scratch. The possibilities these capabilities unlock are driving a boom in API-based agents for key functions and processes.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex has-2-columns\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;Cost is one of the most critical dimensions in how we design, deploy, and scale our solutions. Declarative API-driven agents in Microsoft 365 Copilot offer a path to unify agentic experiences while leveraging shared AI compute and infrastructure.&#8221;<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:150px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faisal-Nasir.png\" alt=\"A photo of Nasir.\" class=\"wp-image-19795\" style=\"object-fit:cover;width:150px;height:150px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faisal-Nasir.png 500w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faisal-Nasir-300x300.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faisal-Nasir-150x150.png 150w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/figure>\n<\/div>\n<\/div>\n<cite>Faisal Nasir, AI Center of Excellence and Data Council lead, Microsoft Employee Experience<\/cite><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">In many ways, IT organizations like ours are the ideal places to implement API-based agents. Our teams are adept at creating and deploying internal solutions to solve technical challenges, and IT work is often about enablement and efficiency\u2014exactly what agents do best.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Cost is one of the most critical dimensions in how we design, deploy, and scale our solutions,\u201d says Faisal Nasir, AI Center of Excellence and Data Council lead in Microsoft Employee Experience. \u201cDeclarative API-driven agents in Microsoft 365 Copilot offer a path to unify agentic experiences while leveraging shared AI compute and infrastructure. By aligning with core architectural principles such as efficiency, scalability, and sustainability, we can ensure these agents not only drive intelligent outcomes but also maximize value across service areas with minimal overhead.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>{<\/em><a href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/ai-powered-agents-in-action-how-were-embracing-this-new-agentic-moment-at-microsoft\/\"><em>Learn more about our vision and strategy around deploying agents internally at Microsoft.<\/em><\/a><em>}<\/em><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Azure FinOps Budget Agent<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Our Azure FinOps Budget Agent is a perfect example of a scenario for API-based agents.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The team responsible for managing our Microsoft Azure budget for IT services was looking for ways to reduce costs by 10\u201320 percent. To do that effectively, service and finance managers needed the ability to track their spending quickly, accurately, and easily.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The conventional approach to solving this problem would be creating a dashboard with access to the relevant data. The problem with a UI-based approach is that it tends to cater to more specific personas by providing data only they need while oversaturating others with information that\u2019s irrelevant to their work.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201c<\/strong>Azure spend is basically the lifeline for our services,\u201d says Faris Mango, principal software engineering manager for infrastructure and engineering services within Microsoft Digital. \u201cGetting the information you need in a concise format that provides a nice, holistic view can be challenging.\u201d <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">With the advent of generative AI and Microsoft 365 Copilot, the team knew that a natural language interface would be much more intuitive. The result was the Azure FinOps Budget Agent.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The team created the agent and the necessary APIs using Microsoft Visual Studio Code. Its tables and functions run on Azure Data Explorer, allowing the APIs and their consumers to access data almost instantaneously, thanks to its low latency and rapid read speeds.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The tool retrieves data by running Azure Data Factory pipelines that pull and transform data from three sources:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\">Our SQL Server for service budget and forecast data<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Azure Spend for the actual spending amounts<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Projected spending, a separate service stored in other Azure Data Explorer tables<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Processing the information relies on our business logic\u2019s join operations, followed by aggregations by fiscal year and service tree levels. These summarize the data per service, team group, service group, and organization.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">After the back end processes the day\u2019s data, it ingests the information into our Azure Data Explorer tables, which the agent accesses by calling via Kusto functions (the query language for Azure Data Explorer). The outcome is very low latency. Typically, the agent returns results in under 500 milliseconds.<strong><\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For users, the tool is stunningly simple. They simply access Copilot and navigate to the Azure FinOps Budget Agent.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The agent provides three core prompts at the very top of the interface: \u201cMy budgets,\u201d \u201cService budget information,\u201d and \u201cService group budget information.\u201d Clicking on one of these pre-loaded prompts returns role-specific information around budget, forecasts, actuals, projections, and variance, all at a single glance. The interface even includes graphs to help people track spending visually.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If users are looking for more specific information, they can input their own queries. For example:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\">\u201cGet me the monthly breakdown of service Azure Optimization Assessment analytics.\u201d<\/li>\n\n\n\n<li class=\"wp-block-list-item\">\u201cFind me the service in this tree with the highest budget.\u201d<\/li>\n\n\n\n<li class=\"wp-block-list-item\">&#8220;Show me the Azure budget for our facilities reporting portal.&#8221;<\/li>\n\n\n\n<li class=\"wp-block-list-item\">\u201cWhich service deviates most from its budget forecasts?\u201d<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The Azure FinOps Budget Agent primarily serves two groups: service managers who directly oversee spend for Azure-based services and FinOps managers responsible for larger budget silos.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Mango is responsible for the internal UI that helps network employees access parts of the Microsoft network. With 18\u201320K users per month, budgeting and forecasting are highly dynamic due to traffic fluctuations and the resourcing that supports them. He also oversees the internal portal that helps service engineers manage our networks. The tool is growing rapidly as we onboard more teams, so forecasting is anything but linear.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For both of these services, keeping close track of spending is essential. Mango finds himself checking the Azure FinOps Budget Agent about twice a month to gauge how his services are trending.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex has-2-columns\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u201cIt&#8217;s taking me less time to do analysis and come up with accurate numbers. And the enhanced user experience just feels more natural, like you&#8217;re asking questions conversationally rather than engaging with a dashboard.\u201d<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:150px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faris-Mango.png\" alt=\"A photo of Mango.\" class=\"wp-image-19796\" style=\"width:150px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faris-Mango.png 500w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faris-Mango-300x300.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Faris-Mango-150x150.png 150w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/figure>\n<\/div>\n<\/div>\n<cite><strong><em>Faris Mango, principal software engineering manager for infrastructure and engineering services, Microsoft Digital<\/em><\/strong><\/cite><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">For FinOps managers, the value is more high-level. They are responsible for overseeing tens of services featuring vast volumes of Azure usage across storage and compute while managing strict budgets. That requires constant vigilance.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Switching context from one dashboard to another to track different Azure management groups was a constant hassle for them. Now, they use the Azure FinOps Budget Agent to get an up-to-date view of the overall spend picture. It gives them a place to start. From there, they can drill down if he sees any abnormalities.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cIt&#8217;s taking me less time to do analysis and come up with accurate numbers,\u201d Mango says. \u201cAnd the enhanced user experience just feels more natural, like you&#8217;re asking questions conversationally rather than engaging with a dashboard.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The arrival of the Azure FinOps Budget Agent is just one example of how agents take your context and get your people the answers they care about faster at less cost.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Benefits like these are spreading across teams throughout Microsoft. Overall, we\u2019ve been able to save 10\u201312 percent of our overall Azure cost footprint for Microsoft Digital, and individual users are thrilled at the amount of time and effort they\u2019re saving.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex has-2-columns\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u201cNow the info is at people\u2019s fingertips. The advantage of an agent is that users don\u2019t have to understand a complex UI, so they can get quick answers and get back to work.\u201d<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:150px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/08\/Shedab-Beg.png\" alt=\"A photo of Beg.\" class=\"wp-image-19954\" style=\"object-fit:cover;width:150px;height:150px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/08\/Shedab-Beg.png 500w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/08\/Shedab-Beg-300x300.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/08\/Shedab-Beg-150x150.png 150w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/figure>\n<\/div>\n<\/div>\n<cite>Shadab Beg, principal software engineering manager, <strong>International Sovereign Cloud Expansion<\/strong><\/cite><\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">Five key strategies for building an API-based agent<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">After seeing what we\u2019ve accomplished with API-based agents, you might be wondering how to put them into action at your organization. This step-by-step guide can help you get there.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Building an API-based agent needs to fulfill multiple requirements. It has to expose APIs, align with real user needs, integrate seamlessly with Microsoft 365 Copilot, and work reliably, efficiently, and scalably. Achieving those outcomes depends on five key strategies. <\/p>\n\n\n\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-59e203da wp-block-columns-is-layout-flex has-2-columns\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:64px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"180\" height=\"180\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/One-icon.png\" alt=\"\" class=\"wp-image-19603\" style=\"object-fit:cover;width:48px;height:48px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/One-icon.png 180w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/One-icon-150x150.png 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading\" style=\"margin-top:0;margin-bottom:0\">Start with user intent, not the API<\/h3>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Start by asking a simple but powerful question: What will users actually ask your agent? Instead of designing the API first, flip the process:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\">Gather real user queries to understand actual use cases.<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Refine the queries using prompt engineering techniques to align them with expected AI behavior.<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Design the API to provide structured responses to those refined queries.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">By starting with user intent, you ensure your agent answers real user questions directly, avoids over-engineering unnecessary endpoints, and delivers meaningful results without excessive back-end processing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cNow the info is at people\u2019s fingertips,\u201d Beg says. \u201cThe advantage of an agent is that users don\u2019t have to understand a complex UI, so they can get quick answers and get back to work.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The advantage of an agent is that users don\u2019t have to understand a complex UI, so they can get quick answers and get back to work.\u201d<strong><\/strong><\/p>\n\n\n\n<div class=\"wp-block-group has-white-200-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-ef8af98e wp-block-group-is-layout-constrained\" style=\"padding-top:var(--wp--preset--spacing--spacing-16);padding-right:var(--wp--preset--spacing--spacing-16);padding-bottom:var(--wp--preset--spacing--spacing-16);padding-left:var(--wp--preset--spacing--spacing-16)\">\n<p class=\"wp-block-paragraph\"><strong>Key learning:<\/strong> An API that doesn\u2019t align with user intent won\u2019t be effective\u2014even if you design it well.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-59e203da wp-block-columns-is-layout-flex has-2-columns\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:64px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"180\" height=\"180\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Two-icon.png\" alt=\"\" class=\"wp-image-19608\" style=\"object-fit:cover;width:48px;height:48px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Two-icon.png 180w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Two-icon-150x150.png 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading\" style=\"margin-top:0;margin-bottom:0\">Design APIs for Microsoft 365 Copilot Integration<\/h3>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">It\u2019s important to build an API schema that returns precise and structured data to make it easy for Copilot to consume. This ensures your APIs return data in a format that directly answers user queries. Copilot expects responses in under three seconds, so focus on optimizing API responses for low latency.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once you have your list of key questions, design your API schema to return the exact data you need to answer those questions. Your goal should be to ensure every API response has a structure that makes it easy for Copilot to understand.<\/p>\n\n\n\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-59e203da wp-block-columns-is-layout-flex has-2-columns\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:64px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"180\" height=\"180\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Three-icon.png\" alt=\"\" class=\"wp-image-19609\" style=\"object-fit:cover;width:48px;height:48px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Three-icon.png 180w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Three-icon-150x150.png 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading\" style=\"margin-top:0;margin-bottom:0\">Teach Microsoft 365 Copilot to call your API<\/h3>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Copilot needs to know how to call your API. Manifests and OpenAPI descriptions accomplish that training. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Create detailed OpenAPI documentation and plugin manifests so Copilot knows what your API does, how to invoke it, and what responses to expect. You\u2019ll likely need to adjust to these files through a process of trial and error. &nbsp;<\/p>\n\n\n\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-59e203da wp-block-columns-is-layout-flex has-2-columns\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:64px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"180\" height=\"180\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Four-icon.png\" alt=\"\" class=\"wp-image-19610\" style=\"object-fit:cover;width:48px;height:48px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Four-icon.png 180w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Four-icon-150x150.png 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading\" style=\"margin-top:0;margin-bottom:0\">Scale APIs for performance and reliability<\/h3>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Once you have your schema and integration in place, it\u2019s time to move on to the primary engineering challenge: making your API scalable, efficient, and reliable.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Prioritize the following goals:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>Fast response times:<\/strong> Copilot expects quick answers.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>High scalability:<\/strong> This ensures seamless performance at scale.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Reliable uptime:<\/strong> The system needs to remain robust.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">We recommend setting a very strict latency limit while implementing your API to retrieve data, since Copilot needs time to generate its response. Existing API endpoints often involve complex data joins rather than simply returning rows from data tables. This complexity can lead to longer processing times, particularly with intricate queries that involve multiple data stores.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To address these potential delays, pre-cache results to significantly enhance performance. This can help overcome the latency requirements imposed by Copilot.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At this point, you\u2019ll see why starting with user intent and iteratively refining API design is important. By grounding your work in user behaviors, you\u2019ll align with the following best practices:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>Structure your response to directly address user queries.<\/strong><br>Instead of just returning raw data, the API should provide meaningful insights Copilot can interpret. Prompt engineering marries user intent with the most understandable API schema.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Keep your API flexible enough to adapt to evolving business needs.<\/strong><br>Real-world workflows change over time, and an API should be able to support those changes without massive refactoring.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Avoid performance bottlenecks caused by unnecessary complexity.<\/strong><br>Understanding the exact data requirements up front prevents heavy joins, excessive filtering, and inefficient data retrieval logic.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Optimize for Copilot&#8217;s real-time response constraints.<\/strong><br>With a strict limit on latency, consider pre-optimization techniques like pre-caching results and simplifying query logic from the very beginning of your API implementation.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">If you attempt to build a scalable, reliable API without first understanding how users will interact with your agent, you\u2019ll spend months reworking the schema, debugging inefficiencies, and struggling with integration challenges.<\/p>\n\n\n\n<div class=\"wp-block-group has-white-200-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-ef8af98e wp-block-group-is-layout-constrained\" style=\"padding-top:var(--wp--preset--spacing--spacing-16);padding-right:var(--wp--preset--spacing--spacing-16);padding-bottom:var(--wp--preset--spacing--spacing-16);padding-left:var(--wp--preset--spacing--spacing-16)\">\n<p class=\"wp-block-paragraph\"><strong>Key learning:<\/strong> A fast, scalable, and reliable API isn\u2019t just about technical optimization. It starts with a deep understanding of the questions it needs to answer and how to structure responses so Copilot can interpret them correctly.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-not-stacked-on-mobile is-layout-flex wp-container-core-columns-is-layout-59e203da wp-block-columns-is-layout-flex has-2-columns\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:64px\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"180\" height=\"180\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Five-icon.png\" alt=\"\" class=\"wp-image-19611\" style=\"object-fit:cover;width:48px;height:48px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Five-icon.png 180w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Five-icon-150x150.png 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading\" style=\"margin-top:0;margin-bottom:0\">Consider compliance and responsible AI<\/h3>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Unlike custom agents or OpenAI API integrations, knowledge-only agents require far less effort to meet Microsoft\u2019s Responsible AI Standard. Microsoft tools\u2019 built-in compliance capabilities handle much of the complexity. As a result, you can focus on efficiency and optimization rather than regulatory hurdles.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cAgent-based automation must balance speed with responsibility,\u201d Nasir says. \u201cWe embed compliance, cost control, and telemetry from the start, so our systems don\u2019t just scale, they mature.\u201d<\/p>\n\n\n\n<div class=\"wp-block-group has-white-200-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-ef8af98e wp-block-group-is-layout-constrained\" style=\"padding-top:var(--wp--preset--spacing--spacing-16);padding-right:var(--wp--preset--spacing--spacing-16);padding-bottom:var(--wp--preset--spacing--spacing-16);padding-left:var(--wp--preset--spacing--spacing-16)\">\n<p class=\"wp-block-paragraph\"><strong>Key learning: <\/strong>It\u2019s helpful to revisit your existing compliance, governance, and responsible AI processes and policies before implementing AI solutions. Copilot adheres to protective structures within your Microsoft technology ecosystem, so this process will ensure you\u2019re starting from the most secure position.<\/p>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">APIs and the agentic future<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Building API-based agents is more than just an integration exercise. It&#8217;s about creating scalable, intelligent, and compliant AI-driven workflows. By aligning your API design with user intent, you set Microsoft 365 Copilot free to retrieve and interpret information accurately. That leads to a seamless AI experience for your employees.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thanks to Copilot\u2019s built-in security and compliance features, API-based Copilot agents are some of the most efficient, compliant, and enterprise-ready ways to deploy AI solutions. They represent another step into an AI-first future tailored to your employees\u2019 and organization\u2019s needs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tools like API-based agents democratize the information we all need to do our jobs better, because we\u2019re all getting the same data from the same place. This is why an AI-first mindset is actually human-first.<strong><em><\/em><\/strong><\/p>\n\n\n\n<div class=\"wp-block-group has-global-padding is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-c0392459 wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-7db9d80f wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<figure class=\"wp-block-image alignleft size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"190\" height=\"190\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Key-takeaways-badge.png\" alt=\"\" class=\"wp-image-19493\" style=\"object-fit:cover;width:75px;height:75px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Key-takeaways-badge.png 190w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Key-takeaways-badge-150x150.png 150w\" sizes=\"auto, (max-width: 190px) 100vw, 190px\" \/><\/figure>\n\n\n\n<p class=\"has-body-xl-font-size wp-block-paragraph\" style=\"margin-top:var(--wp--preset--spacing--spacing-24);margin-bottom:0;padding-top:var(--wp--preset--spacing--spacing-24)\">Key takeaways<\/p>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Here are some things to keep in mind when designing agent-powered experiences that are fast, reliable, and aligned with user expectations.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>Response time is key. <\/strong>Choose single APIs that have low latency to facilitate both the technical requirements of Copilot and users&#8217; needs.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Consider the source.<\/strong> Data has to be high-quality on the backend. It&#8217;s worth reviewing your data and ensuring the hygiene is good.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Agents and APIs need to align. <\/strong>Design with task-centric, well-structured agents. Determine your high-level goals, then use the OpenAI standard, OpenAPI, or graph schemas to describe task endpoints. Define each API&#8217;s capability, input schema, and expected outcome very clearly. <\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Plan ahead to avoid surprises.<\/strong> Design your APIs to minimize potential side effects, especially through enabling natural-language-to-API mapping, because that&#8217;s the biggest change in methodology.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Design for visibility.<\/strong> Agents need to be observable and explainable, so implement metrics-driven monitoring. Having API-level telemetry in addition to Copilot-level telemetry enables continuous improvement.<\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-c0392459 wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-7db9d80f wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<figure class=\"wp-block-image alignleft size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"190\" height=\"190\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Try-it-out-badge.png\" alt=\"\" class=\"wp-image-19492\" style=\"object-fit:cover;width:75px;height:75px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Try-it-out-badge.png 190w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Try-it-out-badge-150x150.png 150w\" sizes=\"auto, (max-width: 190px) 100vw, 190px\" \/><\/figure>\n\n\n\n<p class=\"has-body-xl-font-size wp-block-paragraph\" style=\"margin-top:var(--wp--preset--spacing--spacing-24);margin-bottom:0;padding-top:var(--wp--preset--spacing--spacing-24)\">Try it out<\/p>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-copilot-studio\/fundamentals-get-started?OCID=InsideTrack_Product_10726\" target=\"_blank\" rel=\"noreferrer noopener\">Create and deploy an agent in Microsoft Copilot Studio.<\/a><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-c0392459 wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-7db9d80f wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<figure class=\"wp-block-image alignleft size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"190\" height=\"190\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Related-links-badge.png\" alt=\"\" class=\"wp-image-19491\" style=\"object-fit:cover;width:75px;height:75px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Related-links-badge.png 190w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Related-links-badge-150x150.png 150w\" sizes=\"auto, (max-width: 190px) 100vw, 190px\" \/><\/figure>\n\n\n\n<p class=\"has-body-xl-font-size wp-block-paragraph\" style=\"margin-top:var(--wp--preset--spacing--spacing-24);margin-bottom:0;padding-top:var(--wp--preset--spacing--spacing-24)\">Related links<\/p>\n<\/div>\n\n\n\n<ul style=\"margin-top:var(--wp--preset--spacing--spacing-20)\" class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/enabling-modern-support-at-microsoft-with-ai\/\">Learn how we\u2019re enabling modern support at Microsoft with AI.<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/ai-powered-agents-in-action-how-were-embracing-this-new-agentic-moment-at-microsoft\/\">Find out how we\u2019re embracing this new \u2018agentic\u2019 moment at Microsoft.<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/riding-the-wave-of-agents-washing-over-microsoft-with-good-governance\/\">Check out how we\u2019re riding the wave of agents washing over Microsoft with good governance.<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/how-our-employees-are-extending-enterprise-ai-with-custom-retrieval-agents\/\">Discover ways our employees are extending enterprise AI with custom retrieval agents.<\/a><\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-c0392459 wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-7db9d80f wp-block-group-is-layout-constrained\" style=\"padding-right:0;padding-left:0\">\n<figure class=\"wp-block-image alignleft size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"190\" height=\"190\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Wed-like-to-hear-from-you-badge.png\" alt=\"\" class=\"wp-image-19490\" style=\"object-fit:cover;width:75px;height:75px\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Wed-like-to-hear-from-you-badge.png 190w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/Wed-like-to-hear-from-you-badge-150x150.png 150w\" sizes=\"auto, (max-width: 190px) 100vw, 190px\" \/><\/figure>\n\n\n\n<p class=\"has-body-xl-font-size wp-block-paragraph\" style=\"margin-top:var(--wp--preset--spacing--spacing-24);margin-bottom:0;padding-top:var(--wp--preset--spacing--spacing-24)\">We&#8217;d like to hear from you!<\/p>\n<\/div>\n\n\n\n<ul style=\"margin-top:var(--wp--preset--spacing--spacing-20)\" class=\"wp-block-list is-style-list-no-bullets\">\n<li class=\"wp-block-list-item\"><a href=\"mailto:msitstaff@microsoft.com\">Want more information? Email us and include a link to this story and we\u2019ll get back to you.<\/a><\/li>\n<\/ul>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Agentic AI is the frontier of the AI landscape. These tools show enormous promise, but harnessing their power isn\u2019t always as straightforward as prompting a model or accessing data from Microsoft 365 apps. To reach their full potential in the enterprise, agents sometimes need access to data beyond Microsoft Graph. But giving them access to [&hellip;]<\/p>\n","protected":false},"author":115,"featured_media":19843,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_hide_featured_on_single":false,"_show_featured_caption_on_single":true,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[71,1],"tags":[199,383,331,853,827,115,849],"coauthors":[622],"class_list":["post-19793","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-featured","category-uncategorized","tag-ai","tag-azure-networking","tag-data-and-ai","tag-enterprise-data","tag-microsoft-365-copilot","tag-microsoft-azure","tag-network-and-infrastructure","m-blog-post"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog<\/title>\n<meta name=\"description\" content=\"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog\" \/>\n<meta property=\"og:description\" content=\"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/\" \/>\n<meta property=\"og:site_name\" content=\"Inside Track Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-10-02T16:05:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-13T20:11:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2300\" \/>\n\t<meta property=\"og:image:height\" content=\"1293\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Alex Fleck\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alex Fleck\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/\"},\"author\":{\"name\":\"Alex Fleck\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/#\\\/schema\\\/person\\\/b623d895338189d1c487d4a0b93d4764\"},\"headline\":\"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide\",\"datePublished\":\"2025-10-02T16:05:00+00:00\",\"dateModified\":\"2025-11-13T20:11:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/\"},\"wordCount\":2744,\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/uploads\\\/prod\\\/2025\\\/07\\\/10726_Hero-image.jpg\",\"keywords\":[\"AI\",\"Azure networking\",\"Data and AI\",\"Enterprise Data\",\"Microsoft 365 Copilot\",\"Microsoft Azure\",\"Network and infrastructure\"],\"articleSection\":[\"Featured\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/\",\"name\":\"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/uploads\\\/prod\\\/2025\\\/07\\\/10726_Hero-image.jpg\",\"datePublished\":\"2025-10-02T16:05:00+00:00\",\"dateModified\":\"2025-11-13T20:11:48+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/#\\\/schema\\\/person\\\/b623d895338189d1c487d4a0b93d4764\"},\"description\":\"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/uploads\\\/prod\\\/2025\\\/07\\\/10726_Hero-image.jpg\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/uploads\\\/prod\\\/2025\\\/07\\\/10726_Hero-image.jpg\",\"width\":2300,\"height\":1293,\"caption\":\"At Microsoft, we\u2019re creating API-based agents that extend the reach of Microsoft 365 Copilot to include more diverse apps and data sources.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/\",\"name\":\"Inside Track Blog\",\"description\":\"How Microsoft does IT\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/#\\\/schema\\\/person\\\/b623d895338189d1c487d4a0b93d4764\",\"name\":\"Alex Fleck\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g4cfaccedbee32e457bda8cf3019f258b\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g\",\"caption\":\"Alex Fleck\"},\"description\":\"I\u2019ve always had a passion for story, whether I find it in a novel, a medieval epic, a movie, or a game. Now, I\u2019m helping tell stories about the people and teams at Microsoft who build the technology that moves our world. When I\u2019m not reading, writing, translating, or gaming, you\u2019ll find me on a backcountry trek in Canada\u2019s woods and mountains.\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/insidetrack\\\/blog\\\/author\\\/alexfleck\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog","description":"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/","og_locale":"en_US","og_type":"article","og_title":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog","og_description":"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.","og_url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/","og_site_name":"Inside Track Blog","article_published_time":"2025-10-02T16:05:00+00:00","article_modified_time":"2025-11-13T20:11:48+00:00","og_image":[{"width":2300,"height":1293,"url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","type":"image\/jpeg"}],"author":"Alex Fleck","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Alex Fleck","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#article","isPartOf":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/"},"author":{"name":"Alex Fleck","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/b623d895338189d1c487d4a0b93d4764"},"headline":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide","datePublished":"2025-10-02T16:05:00+00:00","dateModified":"2025-11-13T20:11:48+00:00","mainEntityOfPage":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/"},"wordCount":2744,"image":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","keywords":["AI","Azure networking","Data and AI","Enterprise Data","Microsoft 365 Copilot","Microsoft Azure","Network and infrastructure"],"articleSection":["Featured"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/","name":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide - Inside Track Blog","isPartOf":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","datePublished":"2025-10-02T16:05:00+00:00","dateModified":"2025-11-13T20:11:48+00:00","author":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/b623d895338189d1c487d4a0b93d4764"},"description":"Learn how we\u2019re putting API-based Microsoft 365 Copilot agents into action internally at Microsoft and follow our step-by-step guidance to build your own.","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#primaryimage","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","contentUrl":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","width":2300,"height":1293,"caption":"At Microsoft, we\u2019re creating API-based agents that extend the reach of Microsoft 365 Copilot to include more diverse apps and data sources."},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/unleashing-api-powered-agents-at-microsoft-our-internal-learnings-and-a-step-by-step-guide\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/insidetrack\/blog\/"},{"@type":"ListItem","position":2,"name":"Unleashing API-powered agents at Microsoft: Our internal learnings and a step-by-step guide"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/","name":"Inside Track Blog","description":"How Microsoft does IT","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/b623d895338189d1c487d4a0b93d4764","name":"Alex Fleck","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g4cfaccedbee32e457bda8cf3019f258b","url":"https:\/\/secure.gravatar.com\/avatar\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/340114d229a43eb2e869170b958db0ecd4394144a36e326e2b188d4937b1989d?s=96&d=mm&r=g","caption":"Alex Fleck"},"description":"I\u2019ve always had a passion for story, whether I find it in a novel, a medieval epic, a movie, or a game. Now, I\u2019m helping tell stories about the people and teams at Microsoft who build the technology that moves our world. When I\u2019m not reading, writing, translating, or gaming, you\u2019ll find me on a backcountry trek in Canada\u2019s woods and mountains.","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/author\/alexfleck\/"}]}},"jetpack_featured_media_url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2025\/07\/10726_Hero-image.jpg","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9hcZA-59f","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/19793","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/users\/115"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/comments?post=19793"}],"version-history":[{"count":25,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/19793\/revisions"}],"predecessor-version":[{"id":21085,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/19793\/revisions\/21085"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/media\/19843"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/media?parent=19793"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/categories?post=19793"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/tags?post=19793"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/coauthors?post=19793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}