hadoop2.5的伪分布式安装配置

时间:2023-03-09 15:01:14
hadoop2.5的伪分布式安装配置

一.windows环境下安装

根据博主写的一次性安装成功了:

http://blog.csdn.net/antgan/article/details/52067441

二.linux环境下(centos6.5,JDK1.7)

1.主机名与IP的映射

2.关闭防火墙

3.vi hadoop2.5/etc/hadoop/hadoop-env.sh

    配置JDK路径

4.core-site.xml

 <configuration>

   <property>
    <name>fs.defaultFS</name>
    <value>hdfs://master-qian:8020</value>
   </property>

   <property>
    <name>hadoop.tmp.dir</name>
    <value>/opt/modules/hadoop-2.5/data/tmp</value>
   </property>

 </configuration>

5.hdfs-site.xml

  <configuration>

    <property>
      <name>dfs.replication</name>
      <value>1</value>
    </property>
    <property>
      <name>dfs.namenode.secondary.http-address</name>
      <value>master-qian:50090</value>
    </property>
    <property>
      <name>dfs.permissions.enabled</name>
      <value>false</value>
    </property>

  </configuration>

6.mapred-site.xml

<configuration>

<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>master-qian:10020</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>master-qian:19888</value>
</property>
</configuration>

7.yarn-site.xml

<configuration>

<property>
<name>yarn.resourcemanager.hostname</name>
<value>master-qian</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

</configuration>