I'm looking to see this information as python message:
But currently, I can see only first/second
This is what I'm currently using
from google.api_core.exceptions import BadRequest
if __name__ == '__main__':
try:
upload('XXX','XXX')
except BadRequest as e:
print('ERROR: {}'.format(str(e)))
UPLOAD:
def upload(FILE_NAME, TABLE_ID):
client = bigquery.Client()
dataset_ref = client.dataset(config.DATASET_ID )
table_ref = dataset_ref.table(TABLE_ID)
job_config = bigquery.LoadJobConfig()
job_config.source_format = bigquery.SourceFormat.NEWLINE_DELIMITED_JSON
job_config.autodetect = False
with open(FILE_NAME, 'rb') as source_file:
job = client.load_table_from_file(
source_file,
table_ref,
location='EU', # Must match the destination dataset location.
job_config=job_config) # API request
job.result() # Waits for table load to complete.
The BigQuery client library for Python is automatically installed in a managed notebook. Behind the scenes, the %%bigquery magic command uses the BigQuery client library for Python to run the given query, convert the results to a pandas DataFrame, optionally save the results to a variable, and then display the results.
Code: BEGIN SELECT 1/0; -- attempts to divide by zero RAISE USING message = "divisible with zero is not allowed."; EXCEPTION WHEN ERROR THEN SELECT FORMAT("Hey, you. When you executed %s at %s, it caused an error: %s. Please don't do that.", @@error.
This error is not raised as an exception. You can find it in the errors property of the LoadJob object. Here is an example:
try:
job.result()
except BadRequest as e:
for e in job.errors:
print('ERROR: {}'.format(e['message']))
Output:
ERROR: Error while reading data, error message: JSON table encountered too many errors, giving up. Rows: 1; errors: 1. Please look into the errors[] collection for more details.
ERROR: Error while reading data, error message: JSON processing encountered too many errors, giving up. Rows: 1; errors: 1; max bad: 0; error percent: 0
ERROR: Error while reading data, error message: JSON parsing error in row starting at position 0: No such field: SourceSystem.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With