Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

pom.xml for Hadoop 2.6.0

I am trying to implement an app => find maximum temperature from weather data (exepmle from Tom White’s book Hadoop: Definitive Guide (3rd edition)) using Hadoop. I have downloaded and installed Hadoop 2.6.0 what dependencies should I add to make it work?

like image 820
Yosser Abdellatif Goupil Avatar asked Dec 09 '14 16:12

Yosser Abdellatif Goupil


People also ask

Where can I find POM XML?

The POM file is named pom. xml and should be located in the root directory of the project. The pom. xml has declaration about the project and various configurations.


Video Answer


1 Answers

Step by step :

  1. Add cloudera your settings.xml (under ${HOME}/.m2/settings.xml) to access hadoop dependencies

    <repository>
         <id>cloudera</id>
         <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
         <releases>
              <enabled>true</enabled>
         </releases>
         <snapshots>
              <enabled>true</enabled>
         </snapshots>
    </repository>
    
  2. Add hadoop dependencies to your pom.xml .

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-hdfs</artifactId>
        <version>2.6.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-auth</artifactId>
        <version>2.6.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <version>2.6.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-core</artifactId>
        <version>1.2.1</version>
    </dependency>
    
  3. Then try to "mvn clean install" command into project folder that contains pom.xml file.

like image 89
dogankadriye Avatar answered Sep 26 '22 23:09

dogankadriye