搭建hadoop遇到的问题

时间:2022-09-05 11:08:31

1.Copy the input files into the distributed filesystem 时报错

WARN hdfs.DFSClient: Caught exception 
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1281)
at java.lang.Thread.join(Thread.java:1355)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:609)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:577)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:573)

而且日志中没有错误。
官网语句:$ bin/hdfs dfs -put etc/hadoop input
出错语句:$ bin/hdfs dfs -put etc/hadoop /data/hadoop-2.7.3/hdfs

原来是input目录没有按照官网:
$ bin/hdfs dfs -mkdir /user
$ bin/hdfs dfs -mkdir /user/<username>
于是重新创建目录:
$ bin/hdfs dfs -mkdir -p /user/zexi
$ bin/hdfs dfs -put etc/hadoop /user/zexi
就OK了。