hadoop2.7单节点

时间:2023-03-08 22:05:40
hadoop2.7单节点
$ sudo apt-get install ssh$ sudo apt-get install rsync

修改文件 etc/hadoop/hadoop-env.sh

# set to the root of your Java installation

export JAVA_HOME=/usr/java/latest

伪分布式:

修改 etc/hadoop/core-site.xml:
<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

修改 etc/hadoop/hdfs-site.xml:
<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>
无密码登录设置:
  $ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
  $ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
  $ chmod 0600 ~/.ssh/authorized_keys
bin/hdfs namenode -format
sbin/start-dfs.sh登录http://localhost:50070/