{"id":16305,"date":"2016-06-30T10:40:38","date_gmt":"2016-06-30T17:40:38","guid":{"rendered":""},"modified":"2024-01-22T22:50:32","modified_gmt":"2024-01-23T06:50:32","slug":"celebrating-with-hadoop-and-red-hat-communities","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/30\/celebrating-with-hadoop-and-red-hat-communities\/","title":{"rendered":"Celebrating with Hadoop and Red Hat communities"},"content":{"rendered":"

This post\u00a0was authored\u00a0by Joseph Sirosh, Corporate Vice President of the Data Group at Microsoft<\/em><\/p>\n

This week I had the opportunity to represent Microsoft in keynotes at both the Hadoop and Red Hat<\/a> Summits in San Jose and San Francisco, and during that time speak to many customers and members of the open source and big data communities. The energy in these communities is incredible and I\u2019m proud to see Microsoft engage as an active participant and contributor. Below I want to share a quick summary of recent news related to both these events and communities.<\/p>\n

Hadoop Summit<\/b><\/b><\/p>\n

This year we celebrated 10 years of Hadoop and along with the rest of the community we\u2019re working hard to make big data easier for customers, no matter the type of data, what they need to do or what platform they\u2019re on. At Hadoop Summit, Hortonworks also announced Microsoft Azure HDInsight as its Premier Connected Data Platforms solution to deliver Apache Hadoop in a cloud environment. This announcement culminates a long-standing partnership with Hortonworks that started in 2011<\/a> when Hortonworks was three-months-old. It\u2019s been rewarding to see how far Hadoop has come, and it\u2019s now deployed in thousands of organizations. As an example, Jet.com is using Hadoop with HDInsight to help redefine the e-commerce category by providing consumers with completely transparent pricing that dynamically changes based on the actual costs of the transaction \u2013 warehouse location, payment method, and number of items shipped.<\/p>\n

Looking back at our journey with Hadoop, it\u2019s also been gratifying to see our contributions accelerate its adoption. Members of Microsoft have been contributing to the development of Apache YARN<\/a> since its inception. We\u2019ve also been leading or contributing to projects like bringing Hadoop onto Azure and Windows, speeding up the query processing of Hive, making cloud-based stores accessible via WebHDFS, and making Spark execution available through a REST endpoint. Recently, we also announced our commitment to Apache Spark at Spark Summit 2016<\/a> including:<\/p>\n