Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Connect to Spark SQL via ODBC

According to this page: https://spark.apache.org/sql/ you can connect existing BI tools to Spark SQL via ODBC or JDBC: screen shot for spark sql

I don't mean Shark as this is basically EOL:

It is for this reason that we are ending development in Shark as a separate project and moving all our development resources to Spark SQL, a new component in Spark.

How would a BI tool (like Tableau) connect to shark sql via ODBC?

like image 902
Chris Matta Avatar asked Sep 08 '14 18:09

Chris Matta


People also ask

Does Spark support ODBC?

The Spark ODBC Driver is a powerful tool that allows you to connect with Apache Spark, directly from any applications that support ODBC connectivity.

Can Spark connect with SQL Server?

Start a Spark Shell and Connect to SQL Server Data With the shell running, you can connect to SQL Server with a JDBC URL and use the SQL Context load() function to read a table.

Can we use SQL queries directly in Spark?

Spark SQL lets you query structured data inside Spark programs, using either SQL or a familiar DataFrame API. Usable in Java, Scala, Python and R. Apply functions to results of SQL queries.


1 Answers

With the release of Spark SQL 1.1 you also have thrift JDBC driver see https://spark.apache.org/docs/latest/sql-programming-guide.html#distributed-sql-engine

like image 175
Arnon Rotem-Gal-Oz Avatar answered Sep 17 '22 12:09

Arnon Rotem-Gal-Oz