Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Datanode decommisioning vs Write

Tags:

hadoop

hdfs

What happens when we decommission a datanode while write is happening to HDFS on that node?

Will it stop writing the data to HDFS on that node and decommision that node or will it finish writing and then decommision it.

like image 929
alekya reddy Avatar asked Mar 05 '26 03:03

alekya reddy


1 Answers

I found a solution for this in cloudera.

Decommissioning applies to only to HDFS DataNode, MapReduce TaskTracker, YARN NodeManager, and HBase RegionServer roles. If the host has other roles running on it, those roles are stopped/killed.

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_mc_decomm_host.html

like image 189
alekya reddy Avatar answered Mar 08 '26 21:03

alekya reddy



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!