hive hms和hs2的sql执行日志分析

HMS日志:

2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: pool-8-thread-114: 114: source:10.11.17.999 get_all_databases

2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: pool-8-thread-114: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志:

HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

HiveServer2-Handler-Pool: Thread-190281: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Adding operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置,根据Thread-190281 查询线程运行,根据产生的queryId,往后查sql执行。

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Semantic Analysis Completed

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Returning Hive schema: Schema(fieldSchemas:FieldSchema(name:database_name, type:string, comment:from deserializer), properties:null)

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Initializing operator LIST_SINK\[0

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281

HiveServer2-Background-Pool: Thread-191087: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始!

HiveServer2-Background-Pool: Thread-191087: Starting task Stage-0:DDL in serial mode

HiveServer2-Background-Pool: Thread-191087: results : 12

HiveServer2-Background-Pool: Thread-191087: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间!

HiveServer2-Background-Pool: Thread-191087: OK

HiveServer2-Handler-Pool: Thread-190281: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe

HiveServer2-Handler-Pool: Thread-190281: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281

。。。。。。

c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281\]: Closing operation: OperationHandle \[opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced

相关推荐
浅念-1 小时前
Redis基础详解:单线程模型、String与Hash数据结构
服务器·数据库·redis·sql·mysql·nosql数据库·nosql
databook7 小时前
使用 DuckDB 分析 Parquet 文件
sql·数据分析·nosql
旺仔不是程序员7 小时前
相关子查询与性能优化:PostgreSQL 逐行执行的代价与 JOIN 重写
数据库·后端·sql
卷毛迷你猪9 小时前
快速实验篇(A9-2)Python vs MapReduce:小批量任务的工具选择
大数据·hadoop
姜穆澜10 小时前
Apache Hive 4.x 完全学习指南
大数据·hive
绘梨衣54710 小时前
慢SQL排查手册
python·sql
知识的搬运工旺仔1 天前
CREATE INDEX CONCURRENTLY:线上建索引不阻塞 DML 的代价与坑
数据库·后端·sql
天天喝旺仔1 天前
MySQL索引优化实战:B+Tree原理、索引失效与覆盖索引调优
数据库·sql·mysql·性能优化
迷枫7121 天前
MySQL 迁移到达梦过程中遇到的一些问题记录
sql