Yarn JobHistory Error: Failed redirect for container_1400260444475_3309_01_000001

Question

My MR job is executed successfully .But when i am checking its History getting error as:

Failed redirect for container_1400260444475_3309_01_000001

Failed while trying to construct the redirect url to the log server. Log Server url may not be     configured Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.

Also my HistoryServer is running fine. Good thing is,older jobs(retired ones) i can browse from JobHistory UI. Only it is missing for recent jobs.

Do i need to change log rolling properties,retention period ?

Thanks in advance !!!

Answer 1

Try these steps

1. add to mapred-site.xml

<name>mapreduce.jobhistory.address </name>
<value>hostName:10020</value>

<name>mapreduce.jobhistory.webapp.address</name>
<value>hostName:19888</value>

2. add to yarn-site.xml

<property>
         <name>yarn.log.server.url</name>
         <value>http://<LOG_SERVER_HOSTNAME>:19888/jobhistory/logs</value>
</property>

3. start history server with $ mr-jobhistory-daemon.sh start historyserver

Answer 2

I got it fixed by adding actual hostname instead of 0.0.0.0 in mapred-site.xml

<name>mapreduce.jobhistory.address </name>
<value>hostName:10020</value>

<name>mapreduce.jobhistory.webapp.address</name>
<value>hostName:19888</value>