hbase 优化节点进程停止方式

bigdata-余建新2024-06-28 23:02

一、命令

shell 复制代码 
/usr/local/fqlhadoop/hbase/bin/graceful_stop.sh 4.hadoop3.com

日志：

shell 复制代码 
[biadmin@4 ~]$ /usr/local/fqlhadoop/hbase/bin/graceful_stop.sh 4.hadoop3.com
2024-06-24T09:42:27 Disabling load balancer
log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.
log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/fqlhadoop/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/fqlhadoop/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2024-06-24T09:42:37 Previous balancer state was true
2024-06-24T09:42:37 Unloading 4.hadoop3.com region(s)
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/fqlhadoop/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/fqlhadoop/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.
log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.
2024-06-24 09:42:38,717 WARN  [main] client.ConnectionImplementation: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:38,748 WARN  [main] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:38,750 WARN  [main] client.AsyncProcess: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:host.name=4.hadoop3.com
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_121
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.8.0_121/jre
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: educe/lib/paranamer-2.3.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.5.jar:/usr/local/fqlhadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.5-tests.jar:/usr/local/fqlhadoop/hadoop/contrib/capacity-scheduler/*.jar:/usr/local/fqlhadoop/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.library.path=/usr/local/fqlhadoop/hadoop/lib/native:/usr/local/fqlhadoop/hadoop/lib/native
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:os.name=Linux
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:os.arch=amd64
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:os.version=2.6.32-642.el6.x86_64
2024-06-24 09:42:38,836 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:user.name=biadmin
2024-06-24 09:42:38,837 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:user.home=/home/biadmin
2024-06-24 09:42:38,837 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Client environment:user.dir=/home/biadmin
2024-06-24 09:42:38,838 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ZooKeeper: Initiating client connection, connectString=1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181 sessionTimeout=180000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$13/861628141@77b17d3d
2024-06-24 09:42:38,856 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6-SendThread(3.hadoop3.com:2181)] zookeeper.ClientCnxn: Opening socket connection to server 3.hadoop3.com/10.9.21.37:2181. Will not attempt to authenticate using SASL (unknown error)
2024-06-24 09:42:38,863 WARN  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6-SendThread(3.hadoop3.com:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
2024-06-24 09:42:38,978 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6-SendThread(1.hadoop3.com:2181)] zookeeper.ClientCnxn: Opening socket connection to server 1.hadoop3.com/10.9.21.39:2181. Will not attempt to authenticate using SASL (unknown error)
2024-06-24 09:42:38,978 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6-SendThread(1.hadoop3.com:2181)] zookeeper.ClientCnxn: Socket connection established to 1.hadoop3.com/10.9.21.39:2181, initiating session
2024-06-24 09:42:38,982 WARN  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6] zookeeper.ReadOnlyZKClient: 0x00865dd6 to 1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181 failed for get of /hbase/hbaseid, code = CONNECTIONLOSS, retries = 1
2024-06-24 09:42:38,988 INFO  [ReadOnlyZKClient-1.hadoop3.com:2181,2.hadoop3.com:2181,3.hadoop3.com:2181@0x00865dd6-SendThread(1.hadoop3.com:2181)] zookeeper.ClientCnxn: Session establishment complete on server 1.hadoop3.com/10.9.21.39:2181, sessionid = 0x11ebf379aff641b, negotiated timeout = 40000
2024-06-24 09:42:40,881 INFO  [pool-2-thread-1] util.RegionMover: Moving 7 regions from 4.hadoop3.com to 2 servers using 1 threads .Ack Mode:true
2024-06-24 09:42:40,960 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:41,100 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:41,127 INFO  [pool-3-thread-1] util.RegionMover: Moving region:bf87bdf2f592eba2a65f81942e2c963a from 4.hadoop3.com,16020,1712450694709 to 3.hadoop3.com,16020,1718963825877
2024-06-24 09:42:42,411 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:42,417 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:42,426 INFO  [pool-3-thread-1] util.RegionMover: Moved Region t2024,,1710491832830.bf87bdf2f592eba2a65f81942e2c963a. cost:1.542
2024-06-24 09:42:42,427 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:42,433 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:42,443 INFO  [pool-3-thread-1] util.RegionMover: Moving region:f2b2762c312106000a7fd290f50b889d from 4.hadoop3.com,16020,1712450694709 to 5.hadoop3.com,16020,1718964163316
2024-06-24 09:42:43,657 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:43,663 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:43,982 INFO  [pool-3-thread-1] util.RegionMover: Moved Region archi_trace_info_2024-06-21,,1718812998944.f2b2762c312106000a7fd290f50b889d. cost:1.556
2024-06-24 09:42:43,983 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:43,987 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:43,999 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:44,002 INFO  [pool-3-thread-1] util.RegionMover: Moving region:cf0d46666c7a8ed289b3c5031c9bcd95 from 4.hadoop3.com,16020,1712450694709 to 3.hadoop3.com,16020,1718963825877
2024-06-24 09:42:46,163 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:46,167 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:46,178 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:46,185 INFO  [pool-3-thread-1] util.RegionMover: Moved Region archi_trace_info_2024-06-23,,1718985801607.cf0d46666c7a8ed289b3c5031c9bcd95. cost:2.203
2024-06-24 09:42:46,185 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:46,189 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:46,192 INFO  [pool-3-thread-1] util.RegionMover: Moving region:84d6dc8baa202330aeda3ab63c0d6be9 from 4.hadoop3.com,16020,1712450694709 to 5.hadoop3.com,16020,1718964163316
2024-06-24 09:42:47,330 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:47,335 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:47,342 INFO  [pool-3-thread-1] util.RegionMover: Moved Region archi_trace_info_2024-06-25,,1719158598133.84d6dc8baa202330aeda3ab63c0d6be9. cost:1.157
2024-06-24 09:42:47,343 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:47,349 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:47,371 INFO  [pool-3-thread-1] util.RegionMover: Moving region:50637945a7f37725c0ce191ea688fd2e from 4.hadoop3.com,16020,1712450694709 to 3.hadoop3.com,16020,1718963825877
2024-06-24 09:42:48,523 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:48,528 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:48,581 INFO  [pool-3-thread-1] util.RegionMover: Moved Region panda_feature,,1702977799676.50637945a7f37725c0ce191ea688fd2e. cost:1.238
2024-06-24 09:42:48,582 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:48,585 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:48,592 INFO  [pool-3-thread-1] util.RegionMover: Moving region:882ce86ae6dc43cc91d00cb6dafa2dfa from 4.hadoop3.com,16020,1712450694709 to 5.hadoop3.com,16020,1718964163316
2024-06-24 09:42:49,735 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:49,739 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:49,748 INFO  [pool-3-thread-1] util.RegionMover: Moved Region hbase:namespace,,1702977675141.882ce86ae6dc43cc91d00cb6dafa2dfa. cost:1.167
2024-06-24 09:42:49,749 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:49,753 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:49,757 INFO  [pool-3-thread-1] util.RegionMover: Moving region:8db1d588b3cf6e958db6e06954718904 from 4.hadoop3.com,16020,1712450694709 to 3.hadoop3.com,16020,1718963825877
2024-06-24 09:42:50,898 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:50,901 WARN  [pool-3-thread-1] client.RpcRetryingCallerFactory: The hbase.client.pause.cqtbe setting: 100 is smaller than hbase.client.pause, will use 500 instead.
2024-06-24 09:42:50,909 INFO  [pool-3-thread-1] util.RegionMover: Moved Region portrait_info_fql,,1709101671739.8db1d588b3cf6e958db6e06954718904. cost:1.161
2024-06-24 09:42:50,910 INFO  [pool-2-thread-1] util.RegionMover: No Regions to move....Quitting now
2024-06-24 09:42:50,929 INFO  [main] client.ConnectionImplementation: Closing master protocol: MasterService
2024-06-24T09:42:51 Unloaded 4.hadoop3.com region(s)
2024-06-24T09:42:51 Stopping regionserver on 4.hadoop3.com
running regionserver, logging to /usr/local/fqlhadoop/logs/hbase/hbase-biadmin-regionserver-4.hadoop3.com.out
stopping regionserver.
2024-06-24T09:42:52 Restoring balancer state to true
[biadmin@4 ~]$
相关推荐
tatasix8 分钟前
MySQL UPDATE语句执行链路解析
数据库·mysql
南城花随雪。21 分钟前
硬盘（HDD）与固态硬盘（SSD）详细解读
数据库
儿时可乖了22 分钟前
使用 Java 操作 SQLite 数据库
java·数据库·sqlite
懒是一种态度24 分钟前
Golang 调用 mongodb 的函数
数据库·mongodb·golang
天海华兮26 分钟前
mysql 去重 补全 取出重复 变量 函数 和存储过程
数据库·mysql
智慧化智能化数字化方案29 分钟前
华为IPD流程管理体系L1至L5最佳实践-解读
大数据·华为
gma9991 小时前
Etcd 框架
数据库·etcd
爱吃青椒不爱吃西红柿‍️1 小时前
华为ASP与CSP是什么？
服务器·前端·数据库
PersistJiao2 小时前
在 Spark RDD 中，sortBy 和 top 算子的各自适用场景
大数据·spark·top·sortby
2301_811274312 小时前
大数据基于Spring Boot的化妆品推荐系统的设计与实现
大数据·spring boot·后端
热门推荐
01(欧拉)openEuler系统添加网卡文件配置流程、(欧拉)openEuler系统手动配置ipv6地址流程、(欧拉)openEuler系统网络管理说明02PyTorch机器学习实现液态神经网络03【HarmonyOS】HUAWEI DevEco Studio 下载地址汇总04玄机平台应急响应—webshell查杀05Coze扣子平台完整体验和实践（附国内和国际版对比）06Ubuntu 20.04使用Livox mid 360 测试 FAST_LIO07【目标跟踪】相机运动补偿08Unity中PICO实现 隔空取物 和 接触抓取物体09RAG 实践- Ollama+RagFlow 部署本地知识库10量化方法怎么选？如何评估量化后的大模型LLM？