Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hadoop Configuration Error

I am attempting to start up my hadoop application, however upon startup i am seeing this in the log files, does anyone have a clue as to what the problem is?

Creating filesystem for hdfs://10.170.4.141:9000 java.io.IOException: config() at org.apache.hadoop.conf.Configuration.(Configuration.java:229) at org.apache.hadoop.conf.Configuration.(Configuration.java:216) at org.apache.hadoop.security.SecurityUtil.(SecurityUtil.java:60) at org.apache.hadoop.net.NetUtils.makeSocketAddr(NetUtils.java:188) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:168) at org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:198) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:88) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1413) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:68) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1431) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:256) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:125) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:240) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:372) at org.blismedia.VolumeReportGenerateUpdates.main(VolumeReportGenerateUpdates.java:156) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:187)

like image 766
godzilla Avatar asked Mar 01 '13 08:03

godzilla


People also ask

What is configuration in hadoop?

Configuration Files are the files which are located in the extracted tar. gz file in the etc/hadoop/ directory. All Configuration Files in Hadoop are listed below, 1) HADOOP-ENV.sh->>It specifies the environment variables that affect the JDK used by Hadoop Daemon (bin/hadoop).

Where is hadoop conf directory?

All the configuration files will be located in the extracted tar. gz file in the etc/hadoop/ directory.

What is configuration in MapReduce?

The configuration files for the MapReduce framework in IBM® Spectrum Symphony configure the environment in which the MapReduce daemons execute, as well as the configuration parameters for the daemons.


1 Answers

I think you're running into HADOOP-2851. This "error" can safely be ignored.

Apparently, Configuration's constructor logs an exception to the debug log, despite no exception actually being thrown. Why? Your guess is as good as mine. But the issue is resolved in their project as won't fix. "It's a feature, not a bug."

public Configuration(boolean loadDefaults) {
  if (LOG.isDebugEnabled()) {
    LOG.debug(StringUtils.stringifyException(new IOException("config()")));
  }
  // ...
}
like image 179
ceyko Avatar answered Sep 19 '22 15:09

ceyko