hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Semantic Analysis Completed \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Returning Hive schema: Schema(fieldSchemas:\[FieldSchema(name:database_name, type:string, comment:from deserializer)\], properties:null) \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281 \[HiveServer2-Background-Pool: Thread-191087\]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始! \[HiveServer2-Background-Pool: Thread-191087\]: Starting task \[Stage-0:DDL\] in serial mode \[HiveServer2-Background-Pool: Thread-191087\]: results : 12 \[HiveServer2-Background-Pool: Thread-191087\]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间! \[HiveServer2-Background-Pool: Thread-191087\]: OK \[HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 。。。。。。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
孤雪心殇16 小时前
快速上手数仓基础知识
数据仓库·hive·spark
俺不要写代码17 小时前
数据库:DQL
数据库·sql·mysql
uElY ITER21 小时前
MySQL 中如何进行 SQL 调优
android·sql·mysql
禹凕1 天前
MYSQL——基础知识(元数据)
数据库·sql·mysql
隐于花海,等待花开1 天前
39.ROUND / FLOOR / CEIL 函数深度解析
hive·hadoop
juniperhan1 天前
Flink 系列第22篇:Flink SQL 参数配置与性能调优指南:从 Checkpoint 到聚合优化
大数据·数据仓库·分布式·sql·flink
东风破1371 天前
DM用户权限、表、约束等对象的基本操作,SQL日志的开启介绍
数据库·sql·dm达梦数据库
juniperhan1 天前
Flink 系列第21篇:Flink SQL 函数与 UDF 全解读:类型推导、开发要点与 Module 扩展
java·大数据·数据仓库·分布式·sql·flink
Irene19912 天前
SQL示例:为什么同样的条件需要重复两次排序
sql