Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Failed to set permissions of path: \tmp

Tags:

hadoop

Failed to set permissions of path: \tmp\hadoop-MayPayne\mapred\staging\MayPayne2016979439\.staging to 0700 

I'm getting this error when the MapReduce job executing, I was using hadoop 1.0.4, then I got to know it's a known issue and I tried this with the 1.2.0 but the issue still exists. Can I know a hadoop version that they have resolved this issue.

Thank you all in advance

like image 345
user360321 Avatar asked Jun 20 '13 08:06

user360321


1 Answers

I was getting the same exception while runing nutch-1.7 on windows 7.

bin/nutch crawl urls -dir crawl11 -depth 1 -topN 5

The following steps worked for me

  1. Download the pre-built JAR, patch-hadoop_7682-1.0.x-win.jar, from theDownload section. You may get the steps for hadoop.
  2. Copy patch-hadoop_7682-1.0.x-win.jar to the ${NUTCH_HOME}/lib directory
  3. Modify ${NUTCH_HOME}/conf/nutch-site.xml to enable the overriden implementation as shown below:

    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <!-- Put site-specific property overrides in this file. -->
    <configuration>
        <property>
            <name>fs.file.impl</name>
            <value>com.conga.services.hadoop.patch.HADOOP_7682.WinLocalFileSystem</value>
            <description>Enables patch for issue HADOOP-7682 on Windows</description>
        </property>
     </configuration>
    
  4. Run your job as usual (using Cygwin).

like image 124
VirtualLogic Avatar answered Jan 03 '23 21:01

VirtualLogic