hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: pool-8-thread-114: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: pool-8-thread-114: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

HiveServer2-Handler-Pool: Thread-190281: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Semantic Analysis Completed

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Returning Hive schema: Schema(fieldSchemas:FieldSchema(name:database_name, type:string, comment:from deserializer), properties:null)

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281

HiveServer2-Background-Pool: Thread-191087: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始!

HiveServer2-Background-Pool: Thread-191087: Starting task Stage-0:DDL in serial mode

HiveServer2-Background-Pool: Thread-191087: results : 12

HiveServer2-Background-Pool: Thread-191087: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间!

HiveServer2-Background-Pool: Thread-191087: OK

HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

HiveServer2-Handler-Pool: Thread-190281: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

。。。。。。

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
刘胡子大叔5 小时前
SQL 脚本的导入顺序
数据库·sql
yumgpkpm9 小时前
Acceldata ODP(Open Data Platform)3.3.6.4(RHEL9)保姆级完整安装手册
大数据·人工智能·hive·hadoop·kafka·hbase·cloudera
sunxunyong10 小时前
hs2偶发连接失败问题处理
hadoop
陈年老古董13 小时前
Hive 函数学习笔记(上):单行函数与炸裂函数
hive·笔记·学习
lvqinglou16 小时前
学习Sql-part1 for婷姐
sql·学习·性能优化
冰暮流星17 小时前
sql之is not null运算符
数据库·sql·oracle
冰暮流星17 小时前
sql之is null 运算符
java·数据库·sql
2601_9629666417 小时前
数学与应用数学专业准备风险管理岗,2027届秋招金融知识和工具技能怎么补?
python·sql
陈年老古董18 小时前
Hive 分区表学习笔记:语法、操作、二级分区与动态分区
hive·笔记·学习