Hive表数据的加载与导出

December 17, 2023
测试
测试
测试
测试
4 分钟阅读

本篇博客,小菌为大家详细地带来Hive中表数据的加载与导出。

Hive表数据加载

1.直接向分区表中插入数据

insert into table score3 partition(month =‘201807’) values (‘001’,‘002’,‘100’);

2、通过查询插入数据

先通过load加载创建一个表 (linux) load data local inpath ‘/export/servers/hivedatas/score.csv’ overwrite into table score partition(month=‘201806’);

(HDFS) load data inpath ‘/export/servers/hivedatas/score.csv’ overwrite into table score partition(month=‘201806’);

通过查询方式加载数据 create table score4 like score;

insert overwrite table score4 partition(month = ‘201806’) select s_id,c_id,s_score from score; 关键字overwrite必须要有

3、多插入模式

from score insert overwrite table score_first partition(month=‘201806’) select s_id,c_id insert overwrite table score_second partition(month = ‘201806’) select c_id,s_score;

4、查询语句中创建表并加载数据(as select)

create table score5 as select * from score;

5、创建表时通过location指定加载数据路径

create external table score6 (s_id string,c_id string,s_score int) row format delimited fields terminated by ‘\t’ location ‘/myscore6’;

Hive表数据的导出

1、将查询的结果导出到本地

insert overwrite local directory ‘/export/servers/exporthive/a’ select * from score;

2、将查询的结果格式化导出到本地 insert overwrite local directory ‘/export/servers/exporthive’ row format delimited fields terminated by ‘\t’ collection items terminated by ‘#’ select * from student;

3、将查询的结果导出到HDFS上(没有local)

insert overwrite directory ‘/export/servers/exporthive’ row format delimited fields terminated by ‘\t’ collection items terminated by ‘#’ select * from score;

4、Hadoop命令导出到本地 dfs -get /export/servers/exporthive/000000_0 /export/servers/exporthive/local.txt;

5.hive shell 命令导出 bin/hive -e “select * from yhive.score;” > /export/servers/exporthive/score.txt

6.export导出到HDFS上(全表导出) export table score to ‘/export/exporthive/score’;

继续阅读

更多来自我们博客的帖子

如何安装 BuddyPress
由 测试 December 17, 2023
经过差不多一年的开发,BuddyPress 这个基于 WordPress Mu 的 SNS 插件正式版终于发布了。BuddyPress...
阅读更多
Filter如何工作
由 测试 December 17, 2023
在 web.xml...
阅读更多
如何理解CGAffineTransform
由 测试 December 17, 2023
CGAffineTransform A structure for holding an affine transformation matrix. ...
阅读更多