Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Can't find spark-hbase mvn dependency

I want to read table in HBase using Spark. I added the following dependency:

libraryDependencies += "org.apache.hbase" %% "hbase-spark" % "2.0.0-SNAPSHOT"

as mentioned in hbase website, but the dependency can't be resolved !!

I also tried different versions (1.2.0, 1.1.2) and it didn't work.

like image 411
Mahmoud Hanafy Avatar asked Jan 06 '23 13:01

Mahmoud Hanafy


1 Answers

It doesn't look like hbase-spark is in maven central, which is the default repository that dependencies will be retrieved from.

You'll need to configure your build management tool (unclear if you're using Maven or SBT) to use the correct repository.

From the project page you can use

  • https://repository.apache.org/content/repositories/snapshots for snapshots
  • https://repository.apache.org/content/repositories/releases for releases

Currently, however, it looks like only snapshots are available.

Additionally, as mentioned in the comment from the author below, the line

libraryDependencies += "org.apache.hbase" %% "hbase-spark" % "2.0.0-SNAPSHOT"

should actually be

libraryDependencies += "org.apache.hbase" % "hbase-spark" % "2.0.0-SNAPSHOT"

The double % is not needed in this case as you do no want to append the scala version to the artifact name.

like image 102
tschaible Avatar answered Jan 10 '23 20:01

tschaible