Connecting azure data factory to Databricks SQL endpoint

Question

Can we connect to an Azure Databricks SQL endpoint from data factory? I am using the odbc connector in data factory to create a linked service to the sql endpoint, however I am failing to do so. In the databracks sql endpoint UI, I am able to grab the jdbc based connection string, but I am not able to translate the same in odbc terms.

We are restrained from accessing the Databricks workspace, so we cannot author Databricks notebook to access the sql endpoint. However, we only have read level access to the Databricks sql tables, so we are using odbc connector to setup the linked service in ADF.

Any help is truly appreciated.

Thanks.

Answer 1

You just need to follow documentation for JDBC/ODBC configuration. Just substitute specific parameters from the SQL Endpoint (like workspace URL, HTTP Path of the endpoint, etc.) into the connection string (I'm just not sure how to upload ODBC driver into Data Factory, something like this):

Driver=<path-to-driver>;Host=<server-hostname>;Port=443;HTTPPath=<http-path>;ThriftTransport=2;SSL=1;AuthMech=3;UID=token;PWD=<personal-access-token>