{"id":187558,"date":"2012-04-10T00:00:00","date_gmt":"2012-04-11T19:31:48","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/msr-research-item\/towards-complex-query-processing-over-key-value-cloud-stores\/"},"modified":"2018-07-19T11:07:45","modified_gmt":"2018-07-19T18:07:45","slug":"towards-complex-query-processing-over-key-value-cloud-stores","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/towards-complex-query-processing-over-key-value-cloud-stores\/","title":{"rendered":"Towards Complex Query Processing over Key-Value Cloud Stores"},"content":{"rendered":"
\n

Facts: Cloud infrastructures bear an ever-increasing responsibility for storing and maintaining massive volumes of data for different types of data-intensive applications. Key-value cloud-stores, have become a premium choice as the storage back-end for such applications. We need complex query processing capability to access\/analyze this data.<\/p>\n

Questions: Do we have adequate solutions required to support complex queries, over data residing in such storage infrastructures? Do standard, \u201ccloud-friendly\u201d approaches, such as MapReduce-based algorithms, offer a satisfactory solution? What additional support, in the form of indexing and query processing algorithms, would expedite query processing? Can we do so, while benefiting from the simplicity of the key-value systems’ interface and free-ride on their inherent scalability, elasticity, and reliability?<\/p>\n

Answers: In this talk I will present novel indexing structures and processing algorithms for complex query types. Specifically, I will first cover interval queries in depth, presenting indices and associated query processing algorithms. I will also overview indexing and query processing approaches for rank-join queries. Our contributions include key-value representations of our index and statistical structures, MapReduce algorithms to build and populate them, and query processing algorithms utilizing them, catering to idiosyncrasies of key-value stores, but inheriting their advantages. Our implementation and experimentation are over the popular HBase key-value store. I will report on the results of extensive performance evaluations, which show large performance improvements. En route, I will touch upon differences in existing key-value system architectures and their implications. The talk will conclude with the lessons we have learned, pointing to key design decisions, and promising ideas for outstanding challenges.<\/p>\n<\/div>\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Facts: Cloud infrastructures bear an ever-increasing responsibility for storing and maintaining massive volumes of data for different types of data-intensive applications. Key-value cloud-stores, have become a premium choice as the storage back-end for such applications. We need complex query processing capability to access\/analyze this data. Questions: Do we have adequate solutions required to support complex […]<\/p>\n","protected":false},"featured_media":196752,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"research-area":[13563],"msr-video-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-session-type":[],"msr-impact-theme":[],"msr-pillar":[],"msr-episode":[],"msr-research-theme":[],"class_list":["post-187558","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-data-platform-analytics","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/c_E9gac2Etg","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/187558","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/187558\/revisions"}],"predecessor-version":[{"id":496247,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/187558\/revisions\/496247"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/196752"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=187558"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=187558"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=187558"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=187558"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=187558"},{"taxonomy":"msr-session-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-session-type?post=187558"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=187558"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=187558"},{"taxonomy":"msr-episode","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-episode?post=187558"},{"taxonomy":"msr-research-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-theme?post=187558"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}