Sarathi-Serve (a research prototype) is a high throughput and low-latency LLM serving framework. This repository contains a benchmark suite for evaluating LLM performance from a systems point of view. It contains various workloads and scheduling policies that together can be…
Vidur is a high-fidelity and extensible LLM inference simulator. It can help you with capacity planning and finding the best deployment configuration for your LLM deployments, test new research ideas like new scheduling algorithms, optimizations like speculative decoding, etc., and…
Uses InfluxDB, Grafana and the Azure IoT Node.js SDK (opens in new tab) to communicate with Azure IoT Hub (opens in new tab) and showcase how the Verified Telemetry features can be utilized in real world scenarios.
Getting Started with Verified Telemetry, Azure RTOS and Azure IoT
Azure Verified Telemetry for IoT is a state-of-the-art solution to seamlessly determine the health of the sensor in real-time.
This repository contains a subset of the internal tests used by Microsoft’s Static Driver Verifier (opens in new tab) tool. These tests are generated from Window’s Device Drivers while checking for one of the various properties (opens in new tab) that WDM drivers…
