Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to install RHadoop packages (Rmr, Rhdfs, Rhbase)?

Tags:

r

hadoop

rhadoop

Actually I am trying my level best to integrate with R, but I got this error.

packages ‘rmr’, ‘rJava‘, ‘RJSONIO‘, ‘rhdfs’, ‘rhbase’, ‘plyrmr’ are not available (for R version 3.1.3)

Steps to integrate Hadoop with R:

Installed R, and Hadoop in ubuntu.

Add these three lines in ~/.bashrc file.

*export HADOOP_PREFIX=/Users/hadoop/hadoop-1.1.2

export HADOOP_CMD=/Users/hadoop/hadoop-1.1.2/bin/hadoop

export HADOOP_STREAMING=/Users/hadoop/hadoop-1.1.2/contrib/streaming/hadoop-streaming-1.1.2.jar*

Installed R packages by using this command

install.packages(c("rJava", "RJSONIO", "rmr", "rhdfs", "rhbase", "plyrmr").

But i got above error. What is the main problem how to integrate R and Hadoop. I have followed this link to integrate.

like image 736
Venu A Positive Avatar asked Apr 15 '15 09:04

Venu A Positive


3 Answers

Download packages rhdfs, rhbase, rmr2 and plyrmr from https://github.com/RevolutionAnalytics/RHadoop/wiki and install them as below :

install.packages("<path>/rhdfs_1.0.8.tar.gz", repos=NULL, type="source")
install.packages("<path>/rmr2_2.2.2.tar.gz", repos=NULL, type="source")
install.packages("<path>plyrmr_0.2.0.tar.gz", repos=NULL, type="source")
install.packages("<path>/rhbase_1.2.0.tar.gz", repos=NULL, type="source")
like image 169
Jinith Avatar answered Oct 17 '22 13:10

Jinith


With devtools you can install directly from Github:

install.packages('devtools')
devtools::install_github(c('RevolutionAnalytics/rmr2/pkg', 'RevolutionAnalytics/plyrmr/pkg'))
like image 37
Sam Brightman Avatar answered Oct 17 '22 12:10

Sam Brightman


can you try to install these packages by specifying the reposetory:

install.packages(c("rJava", "RJSONIO", "rmr", "rhdfs", "rhbase", "plyrmr"), repos="http://cran.r-project.org/")
like image 1
RockScience Avatar answered Oct 17 '22 14:10

RockScience