Azure SQL DW to Azure SQL DW using Polybase

Question

I know you can use polybase using external table to load large volume of data from Blob Storage to Azure SQL DW. But is there any possibility that we can import the data from SQL DW to another SQL DW using polybase directly? Or is there some other way? There must be some way to avoid control node in both SQL DW.

Answer 1

You might be better off using Azure Data Factory to move data between two Azure SQL Data Warehouses. It would make light work of moving the data, but beware any data movement costs, particularly moving across region. Start here. Check the 'Use Polybase' checkbox.

If you do just want to use Polybase and Blob Storage, then you would have to:

1. first export the data from the source system internal tables to blob store using CETAS.
2. in the target system create external tables over the files in blob store
3. n the target system import the data from the external tables into the database using CTAS.

Answer 2

As far as I know, you have to use PolyBase and either Blob Storage or Data Lake Store to get the maximum throughput (bypass the control node)