{"id":31452,"date":"2020-06-22T09:00:23","date_gmt":"2020-06-22T16:00:23","guid":{"rendered":""},"modified":"2024-01-22T22:51:25","modified_gmt":"2024-01-23T06:51:25","slug":"apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/","title":{"rendered":"Apache Spark Connector for SQL Server and Azure SQL is now open source"},"content":{"rendered":"<h2><span data-contrast=\"none\">Accelerating big data analytics with the <\/span><span data-contrast=\"none\">Spark connector for SQL<\/span><span data-contrast=\"none\">\u00a0Server<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h2>\n<p><span data-contrast=\"auto\"><img loading=\"lazy\" decoding=\"async\" class=\"attachment-full webp-format alignleft\" src=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS.png\" alt=\"SQL Server logo\" width=\"167\" height=\"166\" data-orig-srcset=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS.png 513w, https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS-300x300.png 300w, https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS-150x150.png 150w, https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS-250x250.png 250w, https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS-330x329.png 330w, https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS-400x399.png 400w\" data-orig-src=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/SQLOS.png\" \/>We&#8217;re happy to announce <\/span><span data-contrast=\"auto\">that\u00a0<\/span><span data-contrast=\"auto\">we have\u00a0<\/span><span data-contrast=\"auto\">open<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">sourced<\/span><span data-contrast=\"auto\">\u00a0the\u00a0<\/span><a href=\"https:\/\/github.com\/microsoft\/sql-spark-connector\" target=\"_blank\" rel=\"noopener noreferrer\"><span data-contrast=\"auto\">Apache Spark\u00a0<\/span><span data-contrast=\"auto\">Connector for SQL Server and Azure SQL<\/span><span data-contrast=\"auto\">\u00a0on\u00a0<\/span><span data-contrast=\"none\">GitHub<\/span><\/a><span data-contrast=\"auto\">.\u00a0<\/span><span data-contrast=\"auto\">Born out of Microsoft\u2019s SQL Server Big Data Clusters investments, <\/span><span data-contrast=\"auto\">t<\/span><span data-contrast=\"auto\">he\u00a0<\/span><span data-contrast=\"auto\">Apache Spark Connector for SQL Server and Azure SQL<\/span><span data-contrast=\"auto\">\u00a0is a high-performa<\/span><span data-contrast=\"auto\">nce connector that\u00a0<\/span><span data-contrast=\"auto\">enables\u00a0<\/span><span data-contrast=\"auto\">you\u00a0<\/span><span data-contrast=\"auto\">to\u00a0<\/span><span data-contrast=\"auto\">use<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">t<\/span><span data-contrast=\"auto\">ransactional<\/span><span data-contrast=\"auto\">\u00a0data<\/span><span data-contrast=\"auto\"> in big data analytics and persists results for\u00a0<\/span><span data-contrast=\"auto\">ad-hoc<\/span><span data-contrast=\"auto\">\u00a0queries or reporting. The connector\u00a0<\/span><span data-contrast=\"auto\">allows you to use any SQL database, on-premises or in the cloud,<\/span><span data-contrast=\"auto\">\u00a0as an input data source or output data sink for<\/span><span data-contrast=\"auto\">\u00a0Spark jobs.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<h2><span data-contrast=\"none\">Why use the\u00a0<\/span><span data-contrast=\"none\">Apache Spark Connector for SQL Server and Azure SQL<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h2>\n<p><span data-contrast=\"auto\">The\u00a0<\/span><span data-contrast=\"auto\">Apache Spark Connector for SQL Server and Azure SQL<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">is based on the Spark DataSource<\/span><span data-contrast=\"auto\">V1 API a<\/span><span data-contrast=\"auto\">nd<\/span><span data-contrast=\"auto\">\u00a0SQL Server Bulk API<\/span><span data-contrast=\"auto\">\u00a0and<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">uses the same interface as the built-in JDBC Spark-SQL connector<\/span><span data-contrast=\"auto\">. This allows you to easily integrate\u00a0<\/span><span data-contrast=\"auto\">the connector\u00a0<\/span><span data-contrast=\"auto\">and migrate your existing Spark jobs\u00a0<\/span><span data-contrast=\"auto\">by simply updat<\/span><span data-contrast=\"auto\">ing the format\u00a0<\/span><span data-contrast=\"auto\">parameter<\/span><span data-contrast=\"auto\">!<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Notable\u00a0<\/span><span data-contrast=\"auto\">features and benefits<\/span><span data-contrast=\"auto\">\u00a0of the connector<\/span><span data-contrast=\"auto\">:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Support for all Spark bindings (Scal<\/span><span data-contrast=\"auto\">a<\/span><span data-contrast=\"auto\">, Python, R).<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">B<\/span><span data-contrast=\"auto\">asic authentication and Active Directory<\/span><span data-contrast=\"auto\"> (AD) keytab support.<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Reordered\u00a0<\/span><span data-contrast=\"auto\">DataFrame<\/span><span data-contrast=\"auto\"> write support.<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Reliable connector\u00a0<\/span><span data-contrast=\"auto\">support for single instance.<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ul>\n<p>Depending on your scenario, the Apache Spark Connector for SQL Server and Azure SQL is up to 15X faster than the default connector. The connector takes advantage of Spark\u2019s distributed architecture to move data in parallel, efficiently using all cluster resources.<\/p>\n<p><span data-contrast=\"auto\">Visit the\u00a0<\/span><a href=\"https:\/\/github.com\/microsoft\/sql-spark-connector\"><span data-contrast=\"none\">GitHub page<\/span><\/a><span data-contrast=\"auto\">\u00a0for the connector to download the project and get started!<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<h2><span data-contrast=\"none\">Get involved<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h2>\n<p><span data-contrast=\"auto\">The release of the\u00a0<\/span><span data-contrast=\"auto\">Apache Spark Connector for SQL Server and Azure SQL<\/span><span data-contrast=\"auto\">\u00a0makes\u00a0<\/span><span data-contrast=\"auto\">the interaction\u00a0<\/span><span data-contrast=\"auto\">between SQL Server and Spark\u00a0<\/span><span data-contrast=\"auto\">even more flawless.\u00a0<\/span><span data-contrast=\"auto\">We are continuously evolving and improving the connector, and we look forward to your feedback and contributions!<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Want to contribute or have feedback or questions?\u00a0<\/span><span data-contrast=\"auto\">Check out the\u00a0<\/span><a href=\"https:\/\/github.com\/microsoft\/sql-spark-connector\"><span data-contrast=\"none\">project on\u00a0<\/span><span data-contrast=\"none\">GitHub<\/span><\/a><span data-contrast=\"auto\">\u00a0and<\/span><span data-contrast=\"auto\">\u00a0follow us on\u00a0<\/span><span data-contrast=\"none\">Twitter at <a href=\"https:\/\/twitter.com\/sqlserver?lang=en\" target=\"_blank\" rel=\"noopener noreferrer\">@SQLServer<\/a><\/span><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Accelerating big data analytics with the Spark connector for SQL\u00a0Server\u00a0 We&#8217;re happy to announce that\u00a0we have\u00a0open&#8211;sourced\u00a0the\u00a0Apache Spark\u00a0Connector for SQL Server and Azure SQL\u00a0on\u00a0GitHub.\u00a0Born out of Microsoft\u2019s SQL Server Big Data Clusters investments, the\u00a0Apache Spark Connector for SQL Server and Azure SQL\u00a0is a high-performance connector that\u00a0enables\u00a0you\u00a0to\u00a0use\u00a0transactional\u00a0data in big data analytics and persists results for\u00a0ad-hoc\u00a0queries or reporting.<\/p>\n","protected":false},"author":1457,"featured_media":32022,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","footnotes":""},"post_tag":[],"product":[],"content-type":[2448],"topic":[2451],"coauthors":[2487],"class_list":["post-31452","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","content-type-updates","topic-big-data","review-flag-integ-1593580287-179"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog\" \/>\n<meta property=\"og:description\" content=\"Accelerating big data analytics with the Spark connector for SQL\u00a0Server\u00a0 We&#8217;re happy to announce that\u00a0we have\u00a0open&#8211;sourced\u00a0the\u00a0Apache Spark\u00a0Connector for SQL Server and Azure SQL\u00a0on\u00a0GitHub.\u00a0Born out of Microsoft\u2019s SQL Server Big Data Clusters investments, the\u00a0Apache Spark Connector for SQL Server and Azure SQL\u00a0is a high-performance connector that\u00a0enables\u00a0you\u00a0to\u00a0use\u00a0transactional\u00a0data in big data analytics and persists results for\u00a0ad-hoc\u00a0queries or reporting.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft SQL Server Blog\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/sqlserver\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-22T16:00:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-23T06:51:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-1024x683.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"683\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"SQL Server Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:site\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"SQL Server Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 min read\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\"},\"author\":[{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/sql-server-team\/\",\"@type\":\"Person\",\"@name\":\"SQL Server Team\"}],\"headline\":\"Apache Spark Connector for SQL Server and Azure SQL is now open source\",\"datePublished\":\"2020-06-22T16:00:23+00:00\",\"dateModified\":\"2024-01-23T06:51:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\"},\"wordCount\":343,\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\",\"name\":\"Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg\",\"datePublished\":\"2020-06-22T16:00:23+00:00\",\"dateModified\":\"2024-01-23T06:51:25+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg\",\"width\":2560,\"height\":1707,\"caption\":\"a woman standing in front of a window\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Apache Spark Connector for SQL Server and Azure SQL is now open source\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"name\":\"Microsoft SQL Server Blog\",\"description\":\"Official News from Microsoft\u2019s Information Platform\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\",\"name\":\"Microsoft SQL Server Blog\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"width\":259,\"height\":194,\"caption\":\"Microsoft SQL Server Blog\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/www.facebook.com\/sqlserver\",\"https:\/\/x.com\/SQLServer\",\"https:\/\/www.youtube.com\/user\/MSCloudOS\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/","og_locale":"en_US","og_type":"article","og_title":"Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog","og_description":"Accelerating big data analytics with the Spark connector for SQL\u00a0Server\u00a0 We&#8217;re happy to announce that\u00a0we have\u00a0open&#8211;sourced\u00a0the\u00a0Apache Spark\u00a0Connector for SQL Server and Azure SQL\u00a0on\u00a0GitHub.\u00a0Born out of Microsoft\u2019s SQL Server Big Data Clusters investments, the\u00a0Apache Spark Connector for SQL Server and Azure SQL\u00a0is a high-performance connector that\u00a0enables\u00a0you\u00a0to\u00a0use\u00a0transactional\u00a0data in big data analytics and persists results for\u00a0ad-hoc\u00a0queries or reporting.","og_url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/","og_site_name":"Microsoft SQL Server Blog","article_publisher":"http:\/\/www.facebook.com\/sqlserver","article_published_time":"2020-06-22T16:00:23+00:00","article_modified_time":"2024-01-23T06:51:25+00:00","og_image":[{"width":1024,"height":683,"url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-1024x683.jpg","type":"image\/jpeg"}],"author":"SQL Server Team","twitter_card":"summary_large_image","twitter_creator":"@SQLServer","twitter_site":"@SQLServer","twitter_misc":{"Written by":"SQL Server Team","Est. reading time":"1 min read"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#article","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/"},"author":[{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/sql-server-team\/","@type":"Person","@name":"SQL Server Team"}],"headline":"Apache Spark Connector for SQL Server and Azure SQL is now open source","datePublished":"2020-06-22T16:00:23+00:00","dateModified":"2024-01-23T06:51:25+00:00","mainEntityOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/"},"wordCount":343,"publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/","name":"Apache Spark Connector for SQL Server and Azure SQL is now open source - Microsoft SQL Server Blog","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg","datePublished":"2020-06-22T16:00:23+00:00","dateModified":"2024-01-23T06:51:25+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg","contentUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2020\/06\/Win19a_Cowork_TechA_0077-scaled.jpg","width":2560,"height":1707,"caption":"a woman standing in front of a window"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2020\/06\/22\/apache-spark-connector-for-sql-server-and-azure-sql-is-now-open-source\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/"},{"@type":"ListItem","position":2,"name":"Apache Spark Connector for SQL Server and Azure SQL is now open source"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","name":"Microsoft SQL Server Blog","description":"Official News from Microsoft\u2019s Information Platform","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization","name":"Microsoft SQL Server Blog","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","width":259,"height":194,"caption":"Microsoft SQL Server Blog"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/sqlserver","https:\/\/x.com\/SQLServer","https:\/\/www.youtube.com\/user\/MSCloudOS"]}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/31452","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/users\/1457"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/comments?post=31452"}],"version-history":[{"count":0,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/31452\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/media\/32022"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/media?parent=31452"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/post_tag?post=31452"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/product?post=31452"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/content-type?post=31452"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/topic?post=31452"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/coauthors?post=31452"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}