impala刷新hive数据shell脚本
来源:互联网 发布:java统一协议才能注册 编辑:程序博客网 时间:2024/05/21 08:13
#!/bin/bash
source job.properties
impalaHost=$1
databaseName=$2
tableName=$3
echo "[INFO]: Hive Database :------> ${databaseName}"
echo "[INFO]: Table Name :---------> ${tableName}"
echo "[INFO]: Impala Host :--------> ${impalaHost}"
echo " "
export PYTHON_EGG_CACHE=./myeggs
#Impala metadata refresh
impala-shell -i ${impalaHost} -d ${databaseName} -q "invalidate metadata ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
echo "[INFO]: The impala invalidate metadata command executed successfully."
else
echo "[ERROR]: Problem in executing the Impala invalidate metadata command."
exit 1
fi
#Refresh the impala tableName
impala-shell -i ${impalaHost} -d ${databaseName} -q "REFRESH ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
echo "[INFO]: The impala REFRESH ${tableName} command executed successfully."
else
echo "[ERROR]: Problem in executing the Impala REFRESH ${tableName} command."
exit 1
fi
echo " "
echo "[INFO]: The impala table and metadata refreshed successfully."
exit 0
source job.properties
impalaHost=$1
databaseName=$2
tableName=$3
echo "[INFO]: Hive Database :------> ${databaseName}"
echo "[INFO]: Table Name :---------> ${tableName}"
echo "[INFO]: Impala Host :--------> ${impalaHost}"
echo " "
export PYTHON_EGG_CACHE=./myeggs
#Impala metadata refresh
impala-shell -i ${impalaHost} -d ${databaseName} -q "invalidate metadata ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
echo "[INFO]: The impala invalidate metadata command executed successfully."
else
echo "[ERROR]: Problem in executing the Impala invalidate metadata command."
exit 1
fi
#Refresh the impala tableName
impala-shell -i ${impalaHost} -d ${databaseName} -q "REFRESH ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
echo "[INFO]: The impala REFRESH ${tableName} command executed successfully."
else
echo "[ERROR]: Problem in executing the Impala REFRESH ${tableName} command."
exit 1
fi
echo " "
echo "[INFO]: The impala table and metadata refreshed successfully."
exit 0
阅读全文
0 0
- impala刷新hive数据shell脚本
- impala刷新hive或者hbase中表的结构或数据
- impala同步hive数据
- impala操作hive数据实例
- impala 刷新同步hive表命令
- shell脚本不换行刷新数据
- shell脚本不换行刷新数据
- 在脚本中刷新impala元信息
- 大数据提速:Impala能否取代Hive
- 大数据提速:Impala能否取代Hive
- 使用impala/hive查询hbase数据
- hive和impala查询数据对比
- Impala实践之二:Hive元数据
- 数据分析:Hive、Pig和Impala
- impala如何出现hive表的数据
- 【甘道夫】实现Hive数据同步更新的shell脚本
- impala导入数据见表语句脚本
- Shell脚本执行Hive语句
- vim 技巧篇
- Docker 清理命令集锦
- 网络加载图片案例
- 《Using OpenRefine》翻译~10
- git 学习资料汇总
- impala刷新hive数据shell脚本
- 【cc2541历程】dht11
- api校验原理图解
- javascript——数组的那些事
- 2017 年最流行的 15 个数据科学 Python 库
- Centos7网络配置
- 程序员面试金典——维护x的秩___
- 图像处理 伽玛校正
- MyBatis开发dao的两种方式