文章目录一. 设置mysql中的hive库二. hive-site.xml 设置三. 测试hive支持中文需要关注两个方面设置hive 元数据库中的一些表设置hive-site.xml.一. 设置mysql中的hive库use hivedb;alter table TBLS modify column TBL_NAMEvarchar(1000)character set utf8;alter table COLUMNS_V2 modify column COMMENTvarchar(256)character set utf8;alter table TABLE_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;alter table PARTITION_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;alter table PARTITION_KEYS modify column PKEY_COMMENTvarchar(4000)character set utf8;alter table INDEX_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;二. hive-site.xml 设置由于Hive元数据表的属性、字段定义等都是存储在Mysql中所以在mysql连接中设置支持中文characterEncodingUTF-8具体的在hive-site.xml中propertynamejavax.jdo.option.ConnectionURL/namevaluejdbc:mysql://ip:3306/hivedb?createDatabaseIfNotExisttrueamp;useUnicodetrueamp;characterEncodingUTF-8amp;useSSLfalse/valuedescriptionJDBC connect stringfora JDBC metastore/description/propertypropertynamehive.metastore.readonly.ConnectionURL/namevaluejdbc:mysql://ip:3306/hivedb?createDatabaseIfNotExisttrueamp;useUnicodetrueamp;characterEncodingUTF-8amp;useSSLfalse/value/property三. 测试重启hive-serverjps kill-9hive_server_pid nohup./hive--service hiveserver2/tmp/hiveserver2.log21建表create tableifnot existsstudentno(stuno string comment学号,stuname1 string comment姓名)comment学生信息表;hiveshow create table studentno;OK CREATE TABLE studentno(stuno string COMMENT学号,stuname1 string COMMENT姓名)COMMENT学生信息表。。。 Time taken:0.059seconds,Fetched:15row(s)插入数据insert into studentnovalues(一号,gao1);hiveselect*from studentno;OK 一号 gao1注含有中文列的表报错create tablestudent(学号 string comment学号,姓名 string comment姓名)comment学生信息表;FAILED:Execution Error,returncode1from org.apache.hadoop.hive.ql.exec.DDLTask.MetaException(message:Add request failed:INSERT INTO COLUMNS_V2(CD_ID,COMMENT,COLUMN_NAME,TYPE_NAME,INTEGER_IDX)VALUES(?,?,?,?,?))
文章目录一. 设置mysql中的hive库二. hive-site.xml 设置三. 测试hive支持中文需要关注两个方面设置hive 元数据库中的一些表设置hive-site.xml.一. 设置mysql中的hive库use hivedb;alter table TBLS modify column TBL_NAMEvarchar(1000)character set utf8;alter table COLUMNS_V2 modify column COMMENTvarchar(256)character set utf8;alter table TABLE_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;alter table PARTITION_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;alter table PARTITION_KEYS modify column PKEY_COMMENTvarchar(4000)character set utf8;alter table INDEX_PARAMS modify column PARAM_VALUEvarchar(4000)character set utf8;二. hive-site.xml 设置由于Hive元数据表的属性、字段定义等都是存储在Mysql中所以在mysql连接中设置支持中文characterEncodingUTF-8具体的在hive-site.xml中propertynamejavax.jdo.option.ConnectionURL/namevaluejdbc:mysql://ip:3306/hivedb?createDatabaseIfNotExisttrueamp;useUnicodetrueamp;characterEncodingUTF-8amp;useSSLfalse/valuedescriptionJDBC connect stringfora JDBC metastore/description/propertypropertynamehive.metastore.readonly.ConnectionURL/namevaluejdbc:mysql://ip:3306/hivedb?createDatabaseIfNotExisttrueamp;useUnicodetrueamp;characterEncodingUTF-8amp;useSSLfalse/value/property三. 测试重启hive-serverjps kill-9hive_server_pid nohup./hive--service hiveserver2/tmp/hiveserver2.log21建表create tableifnot existsstudentno(stuno string comment学号,stuname1 string comment姓名)comment学生信息表;hiveshow create table studentno;OK CREATE TABLE studentno(stuno string COMMENT学号,stuname1 string COMMENT姓名)COMMENT学生信息表。。。 Time taken:0.059seconds,Fetched:15row(s)插入数据insert into studentnovalues(一号,gao1);hiveselect*from studentno;OK 一号 gao1注含有中文列的表报错create tablestudent(学号 string comment学号,姓名 string comment姓名)comment学生信息表;FAILED:Execution Error,returncode1from org.apache.hadoop.hive.ql.exec.DDLTask.MetaException(message:Add request failed:INSERT INTO COLUMNS_V2(CD_ID,COMMENT,COLUMN_NAME,TYPE_NAME,INTEGER_IDX)VALUES(?,?,?,?,?))
