Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Default Namenode port of HDFS is 50070.But I have come across at some places 8020 or 9000 [closed]

Tags:

hadoop

hdfs

When I setup the hadoop cluster, I read the namenode runs on 50070 and I set up accordingly and it's running fine.

But in some books I have come across name node address :

hdfs://localhost:9000/ 

or

hdfs://localhost:8020 

What exactly is the proper number to set the port of namenode?

like image 440
Kumar Avatar asked Apr 04 '14 06:04

Kumar


People also ask

What is the default port number for accessing NameNode?

The default port for namenode UI is 50070.

What is the default port that has been used for checking the node status?

50070 is the default UI port for namenode . while 8020/9000 is the Inter Process Communicator port (IPC) for namenode.

What port is Hadoop running on?

Default HTTP port is 9870. Default HTTP port is 8088.

How many NameNodes can we have in a HA high availability Hadoop architecture?

Implementation of NameNode High Availability Architecture. In HDFS NameNode High Availability Architecture, two NameNodes run at the same time.


1 Answers

The default Hadoop ports are as follows: (HTTP ports, they have WEB UI):

Daemon                   Default Port  Configuration Parameter -----------------------  ------------ ---------------------------------- Namenode                 50070        dfs.http.address Datanodes                50075        dfs.datanode.http.address Secondarynamenode        50090        dfs.secondary.http.address Backup/Checkpoint node?  50105        dfs.backup.http.address Jobracker                50030        mapred.job.tracker.http.address Tasktrackers             50060        mapred.task.tracker.http.address 

Internally, Hadoop mostly uses Hadoop IPC, which stands for Inter Process Communicator, to communicate amongst servers. The following table presents the ports and protocols that Hadoop uses. This table does not include the HTTP ports mentioned above.

Daemon      Default Port        Configuration Parameter      ------------------------------------------------------------ Namenode    8020                fs.default.name          Datanode    50010               dfs.datanode.address         Datanode    50020               dfs.datanode.ipc.address                                     Backupnode  50100               dfs.backup.address           

check out this link For more info: http://blog.cloudera.com/blog/2009/08/hadoop-default-ports-quick-reference/

like image 149
Muhammad Soliman Avatar answered Oct 22 '22 06:10

Muhammad Soliman