hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Semantic Analysis Completed \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Returning Hive schema: Schema(fieldSchemas:\[FieldSchema(name:database_name, type:string, comment:from deserializer)\], properties:null) \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281 \[HiveServer2-Background-Pool: Thread-191087\]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始! \[HiveServer2-Background-Pool: Thread-191087\]: Starting task \[Stage-0:DDL\] in serial mode \[HiveServer2-Background-Pool: Thread-191087\]: results : 12 \[HiveServer2-Background-Pool: Thread-191087\]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间! \[HiveServer2-Background-Pool: Thread-191087\]: OK \[HiveServer2-Handler-Pool: Thread-190281\]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe \[HiveServer2-Handler-Pool: Thread-190281\]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281 。。。。。。 \[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
A__tao1 小时前
一键实现 SQL 转 Elasticsearch Mapping(支持字段注释 + meta 描述)
数据库·sql·elasticsearch
Dreamboat¿11 小时前
SQL 注入漏洞
数据库·sql
武子康15 小时前
大数据-264 实时数仓-MySQL Binlog配置详解:从原理到实践|数据恢复与主从复制实战
大数据·hadoop·后端
武子康16 小时前
大数据-265 实时数仓-Canal MySQL Binlog配置详解:从原理到实践|数据恢复与主从复制实战
大数据·hadoop·后端
StackNoOverflow16 小时前
Spring Security权限控制框架详解
java·数据库·sql
晓纪同学16 小时前
WPF-03 第一个WPF程序
大数据·hadoop·wpf
databook19 小时前
逃离SQL丛林:实用主义的数据救赎
后端·sql·数据分析
流觞 无依19 小时前
DedeCMS plus/comment.php 评论 XSS/注入(XSS、SQL注入)修复教程
sql·php·xss
流觞 无依21 小时前
DedeCMS plus/recommend.php SQL注入漏洞修复教程
sql·php
流觞 无依1 天前
DedeCMS plus/list.php 参数注入(SQL注入)修复教程
sql·安全·php