Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

DFSOutputStream ResponseProcessor exception in Hadoop

I have been facing this problem when I am trying to put a file in hdfs from local system. Below I have pasted the error

15/04/06 15:26:01 WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception  for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540
java.io.IOException: Bad response ERROR for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540 from datanode 192.168.2.82:50010
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:897)
like image 850
G Krishna Sampath Avatar asked Feb 03 '26 19:02

G Krishna Sampath


1 Answers

Try doing hadoop fsck / -blocks -locations -files to clear up any lost blocks.

like image 165
Dragonborn Avatar answered Feb 12 '26 17:02

Dragonborn