hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Semantic Analysis Completed \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Returning Hive schema: Schema(fieldSchemas:\[FieldSchema(name:database_name, type:string, comment:from deserializer)\], properties:null) \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281 \[HiveServer2-Background-Pool: Thread-191087\]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始! \[HiveServer2-Background-Pool: Thread-191087\]: Starting task \[Stage-0:DDL\] in serial mode \[HiveServer2-Background-Pool: Thread-191087\]: results : 12 \[HiveServer2-Background-Pool: Thread-191087\]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间! \[HiveServer2-Background-Pool: Thread-191087\]: OK \[HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 。。。。。。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
yyywoaini~1 小时前
序列化和反序列化hadoop实现
hadoop·eclipse·php
菜鸟蹦迪1 小时前
学习记录:mybatis和jdbc实现数据表作为参数的相关的sql操作
sql·学习·mybatis
薇晶晶1 小时前
hadoop中spark基本介绍
hadoop
hnlucky3 小时前
Windows 上安装下载并配置 Apache Maven
java·hadoop·windows·学习·maven·apache
Johny_Zhao4 小时前
Vmware workstation安装部署微软SCCM服务系统
网络·人工智能·python·sql·网络安全·信息安全·微软·云计算·shell·系统运维·sccm
kaixiang3007 小时前
sqli-labs靶场23-28a关(过滤)
数据库·sql
张伯毅8 小时前
Flink SQL 将kafka topic的数据写到另外一个topic里面
sql·flink·kafka
TiDB 社区干货传送门10 小时前
从40秒到11毫秒:TiDB环境下一次SQL深潜优化实战
数据库·sql·tidb
尘世壹俗人10 小时前
hadoop.proxyuser.代理用户.授信域 用来干什么的
大数据·hadoop·分布式
TY-202511 小时前
数据库——SQL约束&&窗口函数介绍
数据库·sql·oracle