I ran into this issue below, when trying to run a simple pyspark script in Azure:
%%pyspark df = spark.read.load('abfss://[email protected]/userdata1.parquet', format='parquet') display(df.limit(10))
InvalidHttpRequestToLivy: Your Spark job requested 24 vcores. However, the workspace has a 12 core limit. Try reducing the numbers of vcores requested or increasing your vcore quota. HTTP status code: 400. Trace ID: 3308513f-be78-408b-981b-cd6c81eea8b0.
I am new to Azure and using the free trial now. Do you know how to reduce the numbers of vcores requested?
Thanks a lot
You can solve this problem by just closing the other notebook tabs. It will simply close that session.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With