hadoop 1.x ports list - 4 more unknown ports

Question

I configured and installed hadoop 1.2.1 single node. I configured the namenode and jobtracker address with ports as "hdfs://localhost:9000" and "localhost:9001" respectively.

After starting the cluster (start-all.sh). I ran netstat -nltp after this, which listed the hadoop ports.

50030 - jobtracker Web UI
50060 - tasktracker Web UI
50070 - namenode Web UI
50075 - datanode Web UI
(http://localhost:50075/browseDirectory.jsp?dir=%2F)
50090 - secondary namenode Web UI

54310 - namenode (as configured in XML)
54311 - jobtracker (as configured in XML)
50010 - datanode (for data transfer)
50020 - datanode (for block metadata operations & recovery)
33447 - tasktracker ( not configured. Any unused local port is chosen by hadoop itself)

But, a couple of other ports also were occupied and it shows it is java process (I stopped hadoop and confirmed that these belonged to that hadoop cluster only).

48212 - ???
41888 - ???
47448 - ???
52544 - ???

These are not fixed ports. They are chosen dynamically. Because, when i restarted the cluster (stop-all.sh and start-all.sh), the other ports were same as first time, except these ports changed

48945 - tasktracker (This is fine, as explained before)

What about the other ports? What are these ports used for?

44117 - ???
59446 - ???
52965 - ???
56583 - ???

Answer 1

On a linux system, known services are typically listed in the /etc/services file. This is where network utilities (eg. netstat) get's the friendly names for port numbers (ie. 80/http).

Certain packages may update /etc/services. If the hadoop ports in question have a dynamic range that changes then there would be no reason to perform this update.

References

http://www.cyberciti.biz/faq/find-out-which-service-listening-specific-port/
http://www.tldp.org/LDP/nag2/x-087-2-appl.services.html

Hope this helps.