hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

[HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

[HiveServer2-Handler-Pool: Thread-190281]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Adding operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced]

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Semantic Analysis Completed

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null)

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Initializing operator LIST_SINK[0]

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281

[HiveServer2-Background-Pool: Thread-191087]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始!

[HiveServer2-Background-Pool: Thread-191087]: Starting task [Stage-0:DDL] in serial mode

[HiveServer2-Background-Pool: Thread-191087]: results : 12

[HiveServer2-Background-Pool: Thread-191087]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间!

[HiveServer2-Background-Pool: Thread-191087]: OK

[HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

[HiveServer2-Handler-Pool: Thread-190281]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

。。。。。。

[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Closing operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced]

相关推荐
大数据编程之光4 小时前
Hive 窗口函数与分析函数深度解析:开启大数据分析的新维度
hive·hadoop·数据分析
Minyy115 小时前
牛客网刷题SQL--高级查询
数据库·sql
YueTann6 小时前
Leetcode SQL 刷题与答案-基础篇
sql·算法·leetcode
web136885658718 小时前
Spring Boot 中使用 @Transactional 注解配置事务管理
数据库·spring boot·sql
qq_10799104059 小时前
E172 ASP.NET+SQL+C#+LW+图书管理系统的设计与实现 配置 源码 文档 全套资料
sql·c#·asp.net
老牛源码10 小时前
2290 ASP.NET+SQL+LW+基于.NET旅游网站系统的开发与实现 源码 配置 文档
sql·asp.net·.net·旅游
sunxunyong11 小时前
hive 刷新数据适用场景
数据仓库·hive·hadoop
GoodStudyAndDayDayUp13 小时前
一个老是用的SQL
java·数据库·sql
先睡14 小时前
动态sql
java·数据库·sql