In light of my 2016 goals, I've decided to make my 2017 speaking goals a little bit more ambitious and keep them public. To wit: Speak at 20 SQL Saturday and 10 User Groups Last year, I broke both of these barriers, so you might wonder how this is particularly ambitious. The way I figure…
Inserting Into Azure Blob Storage
This is a continuation of my Polybase series. My goal in today's post is to insert data into Azure Blob Storage using Polybase and see what happens. My expectation is that it will behave the same as inserting into Hadoop. Creating A New External Table Our first step is to create a new external table.…
Understanding Blob Storage Behavior
This is a continuation of my Polybase series. In the last chapter of the Polybase series, I looked at creating external tables pointing to files in Azure Blob Storage. Today, we're going to take a deeper look at how the Polybase engine interacts with Azure Blob Storage. To do this is as simple as running a…
Connecting To Blob Storage With Polybase
This is a continuation of my Polybase series. To this point, I have focused my Polybase series on interactions with on-premises Hadoop, as it's the use case most apropos to me. I want to start expanding that out to include other interaction mechanisms, and I'm going to start with one of the easiest: Azure Blob…
Brave New World
For the past three years, I've worked as a Database Engineer---in other words, as a database developer---at ChannelAdvisor. 2 1/2 years of that time was spent working in the digital marketing space. Coming into this job, I had worked at small-scale organizations: the smallest cabinet-level department in Ohio, followed by a relatively small subsidiary of a large insurance…
New Talks For 2017
2017 is just around the corner, and my intent is to revamp my presentation lineup for the new year. Here is a quick look at how my presentation lineup looks for 2017, given the proviso that by August, the lineup will probably change. Headline Talks These are the talks I lead with. They're fun and fit…
Inserting Into Hadoop
See the entire Polybase series. Today, we are going to explore inserting data into a Hadoop cluster using Polybase. As always, I am using a Hortonworks sandbox, but as long as you are using a supported distribution, that's not particularly relevant. Step One: Configuration The first thing we need to do is enable data modification using…
Speaking: 2016 In Review
This has been a busy year for me as a speaker. With my last public talk in the books, I get to take a few weeks of rest and preparation for next year. Now, let's see how close I got to my 2016 goals. For reference, here's how things looked on May 30th. Here are…
Hall of Fame Coverage
I deeply apologize to you, dear readers. I have been quite busy with other projects and have failed you. We have two Hall of Fame ballots to discuss for baseball and I haven't talked about either one! Shall we? Yes, I believe we shall! Author's note: They went and elected people to the HOF while this article was…
Reading Polybase Execution Plan Details
A few days ago, I made mention of how the Remote Query in a Polybase execution plan contained interesting details. Today we're going to look at what we can find in the execution plan XML. We'll start with a basic (i.e., non-MapReduce) query and follow up with a MapReduce query and see how they change. As a…