Apache Avro as a Built-in Data Source in Apache Spark 2.4

Question

I recently read this article and tried out the example but when I run

val usersDF = spark.read.format("avro")
                        .load("examples/src/main/resources/users.avro")

But this gives me an error when I try to run it.

Exception in thread "main" org.apache.spark.sql.AnalysisException: Failed to find data source: avro. Avro is built-in but external data source module since Spark 2.4. Please deploy the application as per the deployment section of "Apache Avro Data Source Guide".; at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:647)

Answer 1

Upon reading up Apache Avro Data Source Guide, I figured build.sbt needs to be updated with a new dependency.

val sparkVersion = "2.4.0"
"org.apache.spark" %% "spark-avro" % sparkVersion

Everything worked fine after this.