Yesterday the wether in Frankfurt was horrible and so my plane from Berlin was late. I missed my connection flight to Linz and had to stay in a hotel in Frankfurt. Therefore I had some time and I used it for implementing a little sample showing how you can use a customer SSIS data source to easily transfer data from Windows Azure Table Storage to SQL Server databases using the ETL tool "SQL Server Integration Services" (SSIS).
If you want to use this stuff you have to compile and deploy it. Check out the post-build actions in the project to see which DLLs you have to copy to which folders in order to make them run.
Let's start by demonstrating how the resulting component works inside SSIS. For this I have created this very short video:
Now let's take a look at the source code.
Reading an Azure Table without a fixed class
The first problem that has to be solved is to read data from an Azure table without knowing it's schema at compile time. There is an excellent post covering that in the Azure Community pages. I took the sourcecode shown there and extended/modified it a little bit so that it fits to what I needed.
First class is just a helper representing a column in the table store (Column.cs):
Second class represents a row inside the table store (without strong schema; GenericEntity.cs):
Last but not least we need a context class that interprets the AtomPub format and builds the generic content objects (GenericTableContent.cs):
The Custom SSIS Data Source
The custom SSIS data source is quite simple (TableStorageSsisSource.cs):
For the next two days, I will be at the first API Summit in Berlin. I will do the keynote and two sessions about serverless cloud computing and .NET Core fundamentals. In this blog post I share slides and samples of my talks.
At this year's Advanced Developer Conference (ADC) in Germany, I did the vision keynote and a session about Azure Active Directory B2C. The keynote was about the future of enterprise software development. In this blog article I publish the material for my talks including all slides.
In software architecture workshops I regularly discuss the concept of Microservices with customers. In this blog article I share the slide deck that I use for that. Sometimes I use it to present the concept of Microservices to customers who are not familiar with it. Sometimes I only hand it out because of the reference links included in the slides. Hope you find the presentation interesting.
Time Cockpit Newsletter
Thanks for your registration! You are almost finished. We need to confirm your email address. To complete the subscription process, please click the link in the email we just sent you.