Data Services Firm Uses Microsoft BI and Hadoop to Boost Insight into Big Data
Klout wanted to give consumers, brands, and partners faster, more detailed insight into hundreds of terabytes of social-network data. It also wanted to boost efficiency. To do so, Klout deployed a business intelligence solution based on Microsoft SQL Server 2012 Enterprise and Apache Hadoop. As a result, Klout processes data queries in near real time, minimizes costs, boosts efficiency, increases insight, and facilitates innovation.
In 2011, Klout decided to implement a BI solution based on Microsoft SQL Server 2012 Enterprise data management software and the open-source Hive data warehouse system. “When it comes to BI and analytics, open-source tool sets are just ineffective and there’s really not a good choice,” Mariani says. “Instead, Klout chose the best of both worlds by marrying the Microsoft BI platform with Hadoop and Hive.” Based on employees’ previous experience with the Microsoft BI platform, Klout also knew that SQL Server offers excellent compatibility with third-party software and it can handle the data scale and query performance needed to manage big-data sets.
In August 2011, engineers implemented a data warehouse with Hive, which consolidates data from all of the network silos hosted by Hadoop. In addition, Klout deployed SQL Server 2012 on a system that runs the Windows Server 2008 R2 Enterprise operating system to take advantage of Microsoft SQL Server 2012 Analysis Services. Engineers use it to manage all business logic required to facilitate multidimensional online analytical processing (MOLAP). Data is stored in multidimensional cubes, which helps preserve detail and speed analysis. To provide high availability, Klout replicates the database to a secondary system using SQL Server 2012 AlwaysOn.
At the time that Klout was initially deploying its solution, SQL Server 2012 and Hive could not communicate directly. To work around this issue, engineers set up a temporary relational database that runs MySQL 5.5 software. It includes data from the previous 30 days and serves as a staging area for data exchange and analysis. Klout engineers are currently working to implement the new open database connectivity driver in SQL Server 2012 to directly join Hive with SQL Server 2012 Analysis Services. In addition, to enhance insight Klout plans to work with Microsoft to incorporate other Microsoft BI tools into its solution, such as Microsoft SQL Server Power Pivot for Microsoft Excel.
- Speeds efficiency and cuts costs
- Increases insight and advantage
- Facilitates innovation
SQL Server 2012 Business Intelligence Overview
Learn more about the business intelligence capabilities of SQL Server 2012.
SQL Server 2012 Breakthrough Insight Whitepaper for TDMs
This white paper presents an overview of the new features related to the business intelligence stack in Microsoft SQL Server 2012 for technical decision makers.
Microsoft Big Data Solution Datasheet
Organizations can use the Microsoft Big Data solution to unleash business insights from their own structured and unstructured data. Microsoft makes this possible by offering an open, flexible, and enterprise-ready Big Data solution that provides insights to all users through compelling BI tools and a connection with external data.
Forrester Consulting: Total Economic Impact of SQL Server 2012 Upgrade
Forrester Consulting examines the total economic impact and potential return on investment enterprises might realize by upgrading from SQL Server 2008 to SQL Server 2012 in this white paper.