I configured and installed hadoop 1.2.1 single node. I configured the namenode and jobtracker address with ports as "hdfs://localhost:9000" and "localhost:9001" respectively.
After starting the cluster (start-all.sh). I ran netstat -nltp
after this, which listed the hadoop ports.
50030 - jobtracker Web UI
50060 - tasktracker Web UI
50070 - namenode Web UI
50075 - datanode Web UI
(http://localhost:50075/browseDirectory.jsp?dir=%2F)
50090 - secondary namenode Web UI
54310 - namenode (as configured in XML)
54311 - jobtracker (as configured in XML)
50010 - datanode (for data transfer)
50020 - datanode (for block metadata operations & recovery)
33447 - tasktracker ( not configured. Any unused local port is chosen by hadoop itself)
But, a couple of other ports also were occupied and it shows it is java process (I stopped hadoop and confirmed that these belonged to that hadoop cluster only).
48212 - ???
41888 - ???
47448 - ???
52544 - ???
These are not fixed ports. They are chosen dynamically. Because, when i restarted the cluster (stop-all.sh and start-all.sh), the other ports were same as first time, except these ports changed
48945 - tasktracker (This is fine, as explained before)
What about the other ports? What are these ports used for?
44117 - ???
59446 - ???
52965 - ???
56583 - ???
On a linux
system, known services are typically listed in the /etc/services
file. This is where network utilities (eg. netstat
) get's the friendly names for port numbers (ie. 80/http).
Certain packages may update /etc/services
. If the hadoop
ports in question have a dynamic range that changes then there would be no reason to perform this update.
http://www.cyberciti.biz/faq/find-out-which-service-listening-specific-port/
http://www.tldp.org/LDP/nag2/x-087-2-appl.services.html
Hope this helps.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With