This is something that happens to a lot of people it would seem. A quick search reveals hundreds, thousands, even millions of cries for help on this one…
Polybase should be pointed to a directory containing a collection of same-structure files. These can be in further sub directories since Polybase will recursively descend and glob all the files under the directory. Continue reading “Access Data from Azure Data Lake Store using Polybase with Azure Data Warehouse”
Python is a pretty useful language: powerful, easy to use and pretty much everything has a python port or interface available. The main drawback is that, as an interpreted language, it is not the fastest solution. But for the kind of “tinkering” that I do, ease of use really outranks speed.
Now since I prefer to use CentOS, using python version 3 takes a little setup and every time I do this, I need to look up something I forgot, so time for a Cheat-Sheet!
I just spent a couple of hours to get this to work and since I will most probably do the same thing again in a couple of months, here is a cheat-sheet.
Feel free to folow it but make sure to replace the IP address and usernames! 🙂
In part two of this build log, I will cover the internals of the system. Be sure to have read the first part of this build log first!