Yes, Test Base supports functional tests. Functional tests are tests that enable our customers execute their scripts to run custom functionality on their application.

To submit your application package for functional testing, simply upload the zipped folder containing your application's binaries, dependencies, and test scripts via our self-serve portal dashboard.

Please see the onboarding user guide for more information or contact our team at testbasepreview@microsoft.com for assistance and more information.

Test Base securely collects and manages your test data on the Azure environment.

Yes, Test Base supports automated tests, however, we do not support manual tests at this time due to service capabilities.

We support all languages and frameworks. We invoke all scripts through PowerShell.

You will also need to provide (upload) the dependent binaries of the required framework.

For each test that we run against the pre-release builds, we will provide results within 24 hours on your Azure Portal dashboard.

Yes, our process supports rebooting after installation. Be sure to select this option from the “Optional settings” drop list when setting your Tasks on the onboarding portal.

For Out-of-box (OOB) tests, you can specify whether a reboot is needed for the Install script.

While for functional tests, you can specify whether a reboot is required for each script that is added.

We currently support Windows 11 clients, Windows 10 clients, Windows Server 2016, Windows Server 2016 Core version, Windows Server 2019, and Windows Server 2019 Core version.

For Security update tests, we test against the monthly pre-release security updates on Windows which are focused on keeping our users always secure and protected. For the Feature update tests, we test against the bi-annual pre-release feature updates which introduces new features and capabilities on Windows.

For the service to be compliant and the pre-release updates be secure, only Microsoft has access to the VMs. However, customers can view test results and other test metrics on their portal dashboard, including crash and hang signals, reliability metrics, memory and CPU utilization etc. We also generate and provide logs of test runs on the dashboard for download and further analysis.

We can also provide memory dumps for crash debugging as needed.

The Test Base team will perform an initial triage process to determine the root cause of the error, and then depending on our findings, we will route to the customer or internal teams within Microsoft for debugging.

We always work closely with our customers in joint remediation to resolve any issues.

The goal of Test Base is to ensure our joint end customers do not face any issues. We will work hard with Software Vendors to address any issues before the release, but in case the fix is not feasible we have other resolutions such as shims and blocks.

We currently do not provide support for on-prem servers. However, if the server is exposing HTTP endpoint, we can connect to it over the internet.

Microsoft provisions the VM for this service, taking the load of doing so from the customer.

Currently, our focus is on desktop applications, however, we have plans to onboard web applications in the future, but we do not support mobile applications at this time.

The biggest difference between Test Base and SUVP is that our partners onboard their applications onto the Test Base Azure environment for validation runs against pre-release updates instead of carrying out the tests themselves.

In addition to pre-release security updates testing, we support pre-release feature updates testing on our platform. We have many other types of updates and OS testing on our roadmap.

The cost of the service depends on when you sign up and how much you use it. Here are the details:

• If you signed up before November 15th, 2023, you will receive 100 free hours (valued at $800) of Test Base usage under your subscription. These hours will expire in 6 months from the date of sign up. After the free hours are consumed or expired, you will be charged $8 per hour for your usage.
• If you sign up on or after November 15th, 2023, you will receive 100 free hours (valued at $800) of Test Base usage under your tenant. These hours will expire in 6 months from the date of sign up. After the free hours are consumed or expired, you will be charged $8 per hour for your usage.
• Starting from November 15th, 2023, if you are a Windows E3/E5 or Microsoft 365 E3/E5 customer, you will receive an additional 500 hours (equivalent to $4,000) of Test Base usage under your tenant. These hours do not have an expiration date and can be used anytime. Note: Do not disable the service principal “Test Base for M365 – Billing”, otherwise you may lose the possibility of getting the additional hours.

To share your feedback about Test Base, select the Feedback icon at the bottom left of the portal. Include a screenshot with your submission to help Microsoft better understand your feedback.

You can also submit product suggestions and upvote other ideas at testbasepreview@microsoft.com.