How to Connect Airflow to oracle database

Question

I am trying to create a connection to an oracle db instance (oracle:thin) using Airflow.

According to their documentation I entered my hostname followed by port number and SID:

Host: example.com:1524/sid

filled other fields as:

Conn Type: Oracle

Schema: username ( documentation says: use your username for schema )

Login: username

Password: * * *

After connection is setup, it gives the save error code for every query that I tried to execute (ORA-12514). It seems like oracle doesn't let airflow to connect:

ORA-12514: TNS:listener does not currently know of service requested in connect descriptor

Has someone experienced the same problem before. I mean connecting to a database shouldn't be a problem for a big platform like this. Or I am probably doing something wrong. Thanks

Version: Airflow v1.7.0, Oracle11g

EDIT:

I am using the same hostname which I use in Oracle SQLDeveloper client:

Answer 1

After digging into the source code, this is what finally how it worked for me:

Conn Type: Oracle

Host: example.com

schema: username

login: username

port: port number

extra: {"sid": "my sid", "dsn": "example.com"}

Answer 2

You have a problem in your connection settings, either your setting is not loading properly to the oracle hook or you are missing a python package that save/load your connection settings. You can test it by hard coding your credentials.

https://github.com/airbnb/airflow/blob/master/airflow/hooks/oracle_hook.py

conn = self.get_connection(self.oracle_conn_id)
dsn = conn.extra_dejson.get('dsn', None)
sid = conn.extra_dejson.get('sid', None)
service_name = conn.extra_dejson.get('service_name', None)
if dsn and sid and not service_name:
    dsn = cx_Oracle.makedsn(dsn, conn.port, sid)
    conn = cx_Oracle.connect(conn.login, conn.password, dsn=dsn)
elif dsn and service_name and not sid:
    dsn = cx_Oracle.makedsn(dsn, conn.port, service_name=service_name)
    conn = cx_Oracle.connect(conn.login, conn.password, dsn=dsn)
else:
    conn = cx_Oracle.connect(conn.login, conn.password, conn.host)