Hive安装配置详解步骤以及hive使用mysql配置

　　Hive是一个数据仓库基础工具在Hadoop中用来处理结构化数据。它架构在Hadoop之上，总归为大数据，并使得查询和分析方便。并提供简单的sql查询功能，可以将sql语句转换为MapReduce任务进行运行。
环境介绍：

hadoop：3.2.0

jdk：1.8

Linux：centos7

mysql：5.6

1.mysql安装配置

wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm

rpm -ivh mysql-community-release-el7-.noarch.rpm

执行yum install -y mysql -server

Systemctl start mysql

完成

2.配置创建hive需要的数据库以及账户

create database hive;

create user 'hadoop1'@'localhost' identified by '';

grant all privileges on *.* to 'hadoop1'@'localhost' with grant option;

3.下载hive

wget http://mirror.bit.edu.cn/apache/hive/hive-3.1.1/apache-hive-3.1.1-bin.tar.gz

tar xzvf apache-hive-3.1.1-bin.tar.gz
cd hive-3.1.1

4.配置hive以及hadoop的变量记得source 让bianl生效。

vim /etc/profile

export HIVE_HOME=/home/apache-hive-3.1.-bin

export HADDOP_HOME=/home//home/hadoop-3.2.0

export PATH=.:${JAVA_HOME}/bin/:$HIVE_HOME/bin:$HADOOP_HOME/bin:$PATH

5.编辑hive-site.xml 和hive-env.sh文件

此文件是通过hive-default.xml.template 复制出来的，需要删除原文件所有内容后新增如下配置，因为hive在启动的时候会加载两个文件，default.xml和Hive-site.xml，所以如果直接新增一下内容是无效的。

            [root@localhost conf]# cat hive-site.xml

            <configuration>

              <property>

                 <name>javax.jdo.option.ConnectionURL</name>

                 <value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value>

              </property>

              <property>

                 <name>javax.jdo.option.ConnectionDriverName</name>

                 <value>com.mysql.jdbc.Driver</value>

              </property>

              <property>

                 <name>javax.jdo.option.ConnectionUserName</name>

                 <value>hadoop</value>####用户注意修改

              </property>

              <property>

                 <name>javax.jdo.option.ConnectionPassword</name>

                 <value></value>####密码注意修改

              </property>

              <property>

                 <name>hive.metastore.schema.verification</name>

                 <value>false</value>

              </property>

            </configuration>

            [root@localhost conf]#

hive-env.sh

Hive安装配置详解步骤以及hive使用mysql配置

6.在初始化前查看是否有mysql的connectorjar包如果没有请下载

[root@localhost apache-hive-3.1.1-bin]# ll lib/mysql-
mysql-connector-java-5.1.47.jar

下载地址：http://central.maven.org/maven2/mysql/mysql-connector-java/找对应的下载即可。

wget http://central.maven.org/maven2/mysql/mysql-connector-java/5.1.47/mysql-connector-java-5.1.47.jar

7.初始化hive

[root@localhost apache-hive-3.1.-bin]# bin/schematool -dbType mysql -initSchema

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/apache-hive-3.1.-bin/lib/log4j-slf4j-impl-2.10..jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/home/hadoop-3.2./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

Metastore connection URL:     jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true

Metastore Connection Driver :     com.mysql.jdbc.Driver

Metastore connection User:     hadoop

Starting metastore schema initialization to 3.1.

Initialization script hive-schema-3.1..mysql.sql

······································此处省略 太多log了----------

Initialization script completed

schemaTool completed

8.出现初始化完成之后可以去mysql数据库中查看hive下的表

Hive安装配置详解步骤以及hive使用mysql配置

会出现74张表。到此hive的配置和部署完成。

秒客网

Hive安装配置详解步骤以及hive使用mysql配置

相关文章