{"id":25012,"date":"2026-08-06T09:10:00","date_gmt":"2026-08-06T16:10:00","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=25012"},"modified":"2026-08-05T16:05:36","modified_gmt":"2026-08-05T23:05:36","slug":"optimizing-azure-resources-at-microsoft-with-ai-and-managed-cloud-labs","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/optimizing-azure-resources-at-microsoft-with-ai-and-managed-cloud-labs\/","title":{"rendered":"Optimizing Azure resources at Microsoft with AI and Managed Cloud Labs"},"content":{"rendered":"\n

Virtual labs give our employees at Microsoft on-demand access to the environments they need for development, testing, troubleshooting, and customer support.<\/p>\n\n\n\n

But at our scale\u2014we have hundreds of thousands of labs and virtual machines internally here at Microsoft\u2014determining the right amount of cloud resources for each workload becomes a significant challenge.<\/p>\n\n\n\n

Managed Cloud Labs (formerly MyWorkspace) is our internal, Azure-based cloud-labs-on-demand platform that supports more than 20,000 labs and 150,000 VMs across our customer support, cloud solution architecture, engineering, testing, and release teams.<\/p>\n\n\n\n

With Managed Cloud Labs, our employees can model all different kinds of lab environments. Some environments might support a simple customer issue, while others re-create a complex enterprise infrastructure scenario.<\/p>\n\n\n\n

Each lab runs with a mix of workloads, performance needs, storage demands, and usage patterns. Its flexibility makes Managed Cloud Labs beneficial; it\u2019s also what makes cost optimization difficult.<\/p>\n\n\n\n

For example, our business leads configure CPU, memory, and storage quota limits for their teams within Managed Cloud Labs, typically based on the largest environment used. Yet after these quotas have been set, there wasn\u2019t an easily scalable way to determine if a given lab was provisioned for more capacity than it actually needed, resulting in unnecessary excess cost for these teams.<\/p>\n\n\n\n

As the annual cost of Azure resources on Managed Cloud Labs climbed to eight figures at Microsoft, finding a better solution became urgent. This was especially true for storage performance\u2014one of the platform\u2019s primary cost drivers. Our team in Microsoft Digital, the company\u2019s IT organization, went to work on a new approach that connected real usage telemetry with the infrastructure decisions that drive cost.<\/p>\n\n\n\n

The result is an AI optimization service that can process performance telemetry, user behavior, infrastructure configuration, and cost signals across Managed Cloud Labs. The service learns how resources are used and can right size them for labs, matching the needs of each individual workload without disrupting the teams who depend on it every day.<\/p>\n\n\n\n

\n
\n
\"\"<\/figure>\n<\/div>\n\n\n\n
\n

Learn more\u00a0<\/strong><\/strong><\/p>\n\n\n\n

Read more of our stories about Managed Cloud Labs.<\/a><\/p>\n<\/div>\n<\/div>\n\n\n\n

Using AI to match cloud resources to workload needs<\/h2>\n\n\n\n

Managed Cloud Labs was designed as a cost-efficient lab platform, enabling us to quickly provision and deprovision resources on demand. However, due to the popularity of the service, usage and costs continued to rise. The obvious solution was cutting resources or imposing blanket quota, but this would risk damaging the very user experience that made the service valuable.<\/p>\n\n\n\n\n\n

\n

\u201cIt\u2019s an incredible amount of data for a human to analyze. Even using our reporting and querying database capabilities, it would be very difficult to manage manually.\u201d<\/p>\nNathan Prentice, principal product manager, Microsoft Digital<\/cite><\/blockquote>\n\n\n\n

To assess whether a lab is over-provisioned, our team would need to inspect every virtual machine, CPU, disk, performance tier, usage pattern, and cost signal across an enormous, constantly changing environment. Our team uses existing tools like Azure Advisor to help analyze resource configurations and usage telemetry and provide recommendations for optimizing resources, but storage costs remained a concern.<\/p>\n\n\n\n

CPUs can be turned off when not in use, but operating systems and data disks preserve the state of each lab and keep incurring costs. That made storage the most promising place to reduce costs without breaking the experience.<\/p>\n\n\n\n

Our team built an AI workflow that analyzes 30 days of disk usage data\u2014including read\/write operations and usage trends\u2014then recommends whether a disk should stay on premium storage or move to a lower-cost SKU. This helps us individually evaluate each lab, VM, and disk, then recommend or apply the right performance tier, rather than forcing everyone into the same blanket policy.<\/p>\n\n\n\n

\u201cIt\u2019s an incredible amount of data for a human to analyze,\u201d says Nathan Prentice, a principal product manager in Microsoft Digital. \u201cEven using our reporting and querying database capabilities, it would be very difficult to manage manually.\u201d<\/p>\n\n\n\n

Building intelligence into the platform<\/h2>\n\n\n\n

We focused on extending the cost optimization capabilities through an intelligent, data-driven framework that evaluates real-world infrastructure usage at scale. The team developed a system that identifies opportunities to optimize storage performance tiers based on actual workload requirements. A disk may be appropriately sized for capacity, but workload telemetry often reveals that it does not require the performance characteristics of a higher-cost storage SKU.<\/p>\n\n\n\n

Building on Azure’s native optimization capabilities and recommendations from Azure Advisor, the team created an AI-powered workflow that analyzes billions of telemetry signals, including disk utilization trends, throughput, IOPS, workload behaviors, and performance patterns. AI models hosted on Azure AI Foundry assess historical and real-time usage data to generate high-confidence recommendations while continuously evaluating potential risks to application performance and user experience.<\/p>\n\n\n\n

\"A<\/figure>\n\n\n\n
\n

\u201cWe saw an opportunity to combine Microsoft AI capabilities with operational telemetry to change how cloud cost optimization is performed. By using AI models hosted on Azure AI Foundry and enriching them with real-world workload and performance data, we built an intelligent decision framework that identifies optimization opportunities across Azure resources at scale.\u201d<\/p>\nNirag Tibdewal, senior software engineer, Microsoft Digital<\/cite><\/blockquote>\n\n\n\n

We designed the solution with an emphasis on reliability, governance, and operational safety. Recommendations pass through multiple layers of validation and policy-driven guardrails. Managed services perform safety checks and assess workload impact, making sure recommendations meet predefined confidence thresholds before any action is considered.<\/p>\n\n\n\n

To further minimize risk, the team adopted a phased deployment strategy. The system initially operated in observation mode, generating recommendations without taking action. Recommendations are validated in pre-production environments before being rolled out incrementally across increasingly larger virtual machine populations. This approach allowed the team to validate outcomes and refine recommendation quality to build confidence in the system and provide a seamless experience for engineers.<\/p>\n\n\n\n

\u201cWe saw an opportunity to combine Microsoft AI capabilities with operational telemetry to change how cloud cost optimization is performed,\u201d says Nirag Tibdewal, a senior software engineer in Microsoft Digital. \u201cBy using AI models hosted on Azure AI Foundry and enriching them with real-world workload and performance data, we built an intelligent decision framework that identifies optimization opportunities across Azure resources at scale.\u201d<\/p>\n\n\n\n

Tangible impacts without disruption<\/h2>\n\n\n\n

The Microsoft Customer and Partner Solutions (MCAPS) team has been working with the Managed Cloud Labs AI solution since January. MCAPS support engineers work with Microsoft customers and partners who face issues with our products. They use Managed Cloud Labs to set up labs that replicate customer environments and can be used to investigate these issues and test fixes. <\/p>\n\n\n\n

Sometimes these lab environments are used to test performance and to scale related issues, so the business leads configure resource quotas at high levels. But often the labs are built to test configuration issues where large storage capacity or high IOPs aren’t required, resulting in mismatches between Azure resources the teams are paying for and what they actually need.<\/p>\n\n\n\n

\n

\u201cWith this AI-driven solution, we\u2019ve reduced Azure Storage costs by 40%. We’re targeting underutilized disks that can be resized to less costly SKUs while still providing the required performance, with no impact to users. Cost savings is a significant priority for our leadership, so our ability to save this amount of money without impacting users has been a big success.\u201d<\/p>\nKevin Williamson, principal technical advisor, MCAPS<\/cite><\/blockquote>\n\n\n\n

Our solution lowers costs for MCAPS and frees up constrained Azure capacity for other Microsoft teams. The storage-cost reduction is already saving the team a significant chunk of money without having to change business rules or impact support engineers.<\/p>\n\n\n\n

\u201cWith this AI-driven solution, we\u2019ve reduced Azure Storage costs by 40%,\u201d says Kevin Williamson, a principal technical advisor in MCAPS. \u201cWe’re targeting underutilized disks that can be resized to less costly SKUs while still providing the required performance, with no impact to users. Cost savings is a significant priority for our leadership, so our ability to save this amount of money without impacting users has been a big success.\u201d<\/p>\n\n\n\n

Optimizing at scale<\/h2>\n\n\n\n

We can now focus on optimization at platform scale. We\u2019ve reduced premium disk deployment from 95% to approximately 16% without reported disruptions. And we\u2019re hosting the same scale as before, but doing it at 20% to 30% lower cost.<\/p>\n\n\n\n

Our engineers are unaffected by lab performance, and they haven\u2019t changed the way they work.<\/p>\n\n\n\n

\"A<\/figure>\n\n\n\n
\n

\u201cWe advanced infrastructure efficiency by building a time-series\u2013driven pipeline to better understand real disk usage patterns across workloads. This supports AI-powered SKU recommendations, helping make Azure-based lab environments more data-driven and cost-efficient while intelligently optimized at scale.\u201d<\/p>\nJames Ferris, software engineer, Microsoft Digital<\/cite><\/blockquote>\n\n\n\n

\n

Key takeaways<\/h3>\n\n\n\n

Here are some tips to help your organization improve your cloud efficiency:<\/p>\n\n\n\n