Today's post is a fairly short one. Let's say you want to connect to Azure Data Lake Storage Gen2 from SQL Server 2022. We saw in a recent post how to connect to Azure Blob Storage. When it comes to Azure Data Lake Storage, the story is almost the same, though there are a couple…
SQL Server 2022 Data Virtualization: Insert into Azure Blob Storage
Several years ago, I wrote a blog post on how to insert data into Azure Blob Storage from SQL Server using PolyBase. That technique used PolyBase V1: the Java connector for Hadoop. With SQL Server 2022 eliminating that connector, we're going to learn the new method. Starting out the Same Regardless of the version of…
PolyBase and Named Instances
One of the built-in connectors for PolyBase in SQL Server 2022, as well as SQL Server 2019, is to connect one SQL Server instance to another. In this post, we'll look at how to connect to a named instance of SQL Server. And then There Were Two We have two SQL Server instances running on…
PolyBase and Azure Blob Storage
A long, long time ago (I can still remember) PolyBase used to connect to Azure Blob Storage. Specifically, you could use the wasbs:// protocol and connect to Azure Blob Storage over WebHDFS. Here's an example of an external data source which would work for SQL Server 2016 through 2019: USE MyDB GO CREATE DATABASE SCOPED…
PolyBase and Windows Authentication in SQL Server 2022
Back in the SQL Server 2019 days, I laid out a post which covered a really annoying bug around Windows authentication and PolyBase. The upshot is that SQL Server 2019 CU2 broke Windows authentication, meaning that you could not create external objects on a SQL Server instance while using a Windows authenticated session. In CU2,…
PolyBase 2022 and Cosmos DB (Core API)
Getting Back to Basics To date, I've always used the MongoDB API for Cosmos DB when demonstrating PolyBase. This is true in PolyBase Revealed, as well as blog posts here. Today, that changes: we are going to use PolyBase to get data from a Cosmos DB using the Core API, also known as the SQL…
PolyBase 2022 and Cosmos DB (Mongo API)
Now that SQL Server 2022 has hit RC0, I've decided to give it a try and see what has changed with respect to PolyBase. In today's post, we'll look at connecting to Cosmos DB using the MongoDB PolyBase connector. The Problem Back in the 2019 days, I noted a problem when CU2 of SQL Server…
Upcoming Events: DBA Fundamentals Group
Key Details What: DBA Fundamentals Group.Where: The broader Internet.When: Tuesday, August 30th.Admission is free. Register on the DBA Fundamentals meetup. What I’m Presenting 12:00 – 13:00 PM EDT — Data Virtualization with PolyBase and SQL Server 2022. This is a total revamp of a talk I've done many a time, so even if you've seen Data Virtualization…
Upcoming Events: Rhode Island SQL Server User Group
Key Details What: Rhode Island SQL Server User Group.Where: Internet Rhode Island.When: Thursday, April 7th.Admission is free. Register on the Rhode Island SQL Server User Group meetup. What I’m Presenting 2022-04-06 — 19:00 – 20:00 PM EDT — Low-Code Machine Learning with Azure ML. Frequent readers here might remember this as a blog series that I did earlier…
Product Reviews: DevToys
Three-Word Review Get it. Now. More Than Three Word Review DevToys is a Windows app which provides a series of helpful tools for developers. We know they're helpful because in many cases, there are popular websites which provide these tools. For example, there is a built-in PNG/JPEG compression tool, similar to what TinyPNG offers us.…
36 Chambers - The Legendary Journeys: Execution to the max! 