hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Semantic Analysis Completed \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Returning Hive schema: Schema(fieldSchemas:\[FieldSchema(name:database_name, type:string, comment:from deserializer)\], properties:null) \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281 \[HiveServer2-Background-Pool: Thread-191087\]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始! \[HiveServer2-Background-Pool: Thread-191087\]: Starting task \[Stage-0:DDL\] in serial mode \[HiveServer2-Background-Pool: Thread-191087\]: results : 12 \[HiveServer2-Background-Pool: Thread-191087\]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间! \[HiveServer2-Background-Pool: Thread-191087\]: OK \[HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 。。。。。。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
杨云龙UP5 小时前
MySQL 自动备份与覆盖恢复实战:一套脚本搞定全库/按库备份恢复
linux·运维·数据库·sql·mysql
元气满满-樱11 小时前
SQL语句***重点
数据库·sql
咨询QQ:48773927814 小时前
探索Qt下的UI皮肤生成器:多风格与编译那些事儿
hive
阿杰同学14 小时前
Hadoop 面试题及答案整理,最新面试题
大数据·hadoop·分布式
小白勇闯网安圈14 小时前
unserialize3、php_rce、Web_php_include、warmup、NewsCenter
sql·网络安全·web
思成不止于此15 小时前
【MySQL 零基础入门】DCL 核心语法全解析:用户管理与权限控制篇
数据库·笔记·sql·学习·mysql
weixin_4476719915 小时前
【MySQL从节点异常断连后的Slave_SQL_Running 处于Connecting的解决方案】
android·sql·mysql
roman_日积跬步-终至千里15 小时前
【源码分析】StarRocks TRUNCATE 语句执行流程:从 SQL 到数据清空的完整旅程
java·数据库·sql
ClouGence15 小时前
从 0 到 1 构建 TDSQL MySQL 实时同步链路
数据库·分布式·sql·mysql
Hello.Reader16 小时前
Flink SQL 的 LIMIT 子句语义、坑点与实战技巧
sql·flink·wpf