Hadoop: HDFS File Writes & Reads

Question

I have a basic question regarding file writes and reads in HDFS.

For example, if I am writing a file, using the default configurations, Hadoop internally has to write each block to 3 data nodes. My understanding is that for each block, first the client writes the block to the first data node in the pipeline which will then inform the second and so on. Once the third data node successfully receives the block, it provides an acknowledgement back to data node 2 and finally to the client through Data node 1. Only after receiving the acknowledgement for the block, the write is considered successful and the client proceeds to write the next block.

If this is the case, then isn't the time taken to write each block is more than a traditional file write due to -

1. the replication factor (default is 3) and
2. the write process is happening sequentially block after block.

Please correct me if I am wrong in my understanding. Also, the following questions below:

1. My understanding is that File read / write in Hadoop doesn't have any parallelism and the best it can perform is same to a traditional file read or write (i.e. if the replication is set to 1) + some overhead involved in the distributed communication mechanism.
2. Parallelism is provided only during the data processing phase via Map Reduce, but not during file read / write by a client.

Answer 1

Though your above explanation of a file write is correct, a DataNode can read and write data simultaneously. From HDFS Architecture Guide:

a DataNode can be receiving data from the previous one in the pipeline and at the same time forwarding data to the next one in the pipeline

A write operation takes more time than on a traditional file system (due to bandwidth issues and general overhead) but not as much as 3x (assuming a replication factor of 3).