Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

Is there a way to connecto Spark-Sql with sqlalchemy

Tags:

python

sqlalchemy

apache-spark

pyspark

Is there a way to connect Spark-Sql with sqlalchemy I have legacy code that uses sqlalchemy How could i make it use spark-sql ,can i make sqlalchemy as the translation layer to spark-sql ?

like image 549
sami Avatar asked Apr 25 '17 16:04

sami

People also ask

What SQL does SQLAlchemy use?

Supported Databases. SQLAlchemy includes dialects for SQLite, Postgresql, MySQL, Oracle, MS-SQL, Firebird, Sybase and others, most of which support multiple DBAPIs.

1 Answers

yes , look at this project https://github.com/dropbox/PyHive

There are some adjustments you will need to do , fortunately SQLAlchemy is build for that

like image 160
sami Avatar answered Sep 27 '22 20:09

sami
Sign in to Comment

Related questions

How to initialize OpenGL context with PyGame instead of GLUT
"Can't initialize character set utf8mb4" with Windows mysql-python
PyDev debugging: do not open "_pydev_execfile" at the end
Automagically propagating deletion when using a bidirectional association_proxy
Python Documentation (:obj:`str`) vs (str)
Detect bounced emails in Python smtplib
What's the difference between .post() , .create() and perform_create() in views.py and .create() in serializers.py
httplib.BadStatusLine: '' on Linux but not Mac
Initialize field only once in Python
Pandas MultiIndex lookup with Numpy arrays
How do you keep table rows together in python-docx?
Enable Django admin functionality at frontend with inlines
How to install Mayavi Trait backends?
Which seeds have to be set where to realize 100% reproducibility of training results in tensorflow?
Pandas column indexing for searching?
Firebase JWT library can't verify Python JWT token
How to simulate reduced precision floats in TensorFlow?
`Optimal` variable initialization and learning rate in Tensorflow for matrix factorization
Can I prevent pip from downgrading packages implicitly?
Redshift + SQLAlchemy long query hangs

Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!