{"id":1011459,"date":"2024-03-18T14:03:58","date_gmt":"2024-03-18T21:03:58","guid":{"rendered":""},"modified":"2024-03-18T14:04:00","modified_gmt":"2024-03-18T21:04:00","slug":"introducing-garnet-an-open-source-next-generation-faster-cache-store-for-accelerating-applications-and-services","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/introducing-garnet-an-open-source-next-generation-faster-cache-store-for-accelerating-applications-and-services\/","title":{"rendered":"Introducing Garnet \u2013 an open-source, next-generation, faster cache-store for accelerating applications and services"},"content":{"rendered":"\n
\"Garnet-colored<\/figure>\n\n\n\n

Researchers at Microsoft have been working for nearly a decade to address the increasing demand for data storage mechanisms to support the rapid advances in interactive web applications and services. Our new cache-store system called Garnet, which offers several advantages over legacy cache-stores, has been deployed in multiple use cases at Microsoft, such as those in the Windows & Web Experiences Platform, Azure Resource Manager, and Azure Resource Graph, and is now available as an open-source download at https:\/\/github.com\/microsoft\/garnet (opens in new tab)<\/span><\/a>. In open sourcing Garnet, we hope to enable the developer community to benefit from its performance gains and capabilities, to build on our work, and to expand the Garnet ecosystem by adding new API calls and features.\u00a0We also hope that the open sourcing will encourage follow-up academic research and open future collaboration opportunities in this important research area.<\/p>\n\n\n\n

The cache-store problem<\/h2>\n\n\n\n

The growth of cloud and edge computing has brought an increasing number and range of applications and services that need to access, update, and transform data with higher efficiency, lower latencies, and lower costs than ever before. These applications and services often require significant operational spending on storage interactions, making this one of the most expensive and challenging platform areas today. A cache-store software layer, deployed as a separately scalable remote process, can ease these costs and improve application performance. This has fueled a growing cache-store industry, including many open-source systems, such as Redis, Memcached, KeyDB, and Dragonfly.<\/p>\n\n\n\n

Unlike traditional remote cache-stores, which support a simple get\/set interface, modern caches offer rich APIs and feature sets. They support raw strings, analytic data structures such as Hyperloglog, and complex data types such as sorted sets and hash. They allow users to checkpoint and recover the cache, create data shards, maintain replicated copies, and support transactions and custom extensions.<\/p>\n\n\n\n

However, existing systems achieve this feature richness at a cost, by keeping the system design simple, which limits the ability to fully exploit the latest hardware capabilities (e.g., multiple cores, tiered storage, fast networks). Further, many of these systems are not explicitly designed to be easily extensible by app developers or to work well on diverse platforms and operating systems.<\/p>\n\n\n\n

Introducing Garnet<\/h2>\n\n\n\n

At Microsoft Research, we have been investigating modern key-value database architectures since 2016. Our prior work, the FASTER<\/a> embedded key-value library, which we open-sourced (opens in new tab)<\/span><\/a> in 2018, demonstrated orders-of-magnitude better performance than existing systems, while focusing on the simple single-node in-process key-value model.<\/p>\n\n\n\n

Starting in 2021, based on requirements from use-cases at Microsoft, we began building a new remote cache-store with all the necessary features to serve as a viable replacement to existing cache-stores. Our challenge was to maintain and enhance the performance benefits that we achieved in our earlier work, but in this more general and realistic network setting.<\/p>\n\n\n\n

The result of this effort is Garnet \u2013 a new cache-store that offers several unique benefits:<\/p>\n\n\n\n