ZooKeeper集群部署(容器)

神奇的海马体2025-04-07 8:02

文章目录

一、ZooKeeper基本概念

ZooKeeper是一个分布式且开源的分布式应用程序的协调服务(管理分布式服务)

ZooKeeper提供的主要功能包括：

  • 配置管理
  • 分布式锁
  • 集群管理

二、ZooKeeper集群部署

1、前置环境准备

1.1 关闭防火墙等限制

bash 复制代码 
systemctl disable firewalld --now
setenforce 0
sed  -i -r 's/SELINUX=[ep].*/SELINUX=disabled/g' /etc/selinux/config

1.2 安装docker环境

（1）安装docker

bash 复制代码 
curl -o /etc/yum.repos.d/CentOS-Base.repo https://mirrors.aliyun.com/repo/Centos-7.repo
wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo
yum makecache

# yum-utils软件用于提供yum-config-manager程序
yum install -y yum-utils

# 使用yum-config-manager创建docker阿里存储库
yum-config-manager --add-repo http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo

yum install docker-ce-20.10.6 docker-ce-cli-20.10.6 -y

（2）配置docker国内加速器

bash 复制代码 
mkdir /etc/docker
cat <<EOF > /etc/docker/daemon.json
{
 "registry-mirrors": [
"https://vm1wbfhf.mirror.aliyuncs.com",
"http://f1361db2.m.daocloud.io",
"https://hub-mirror.c.163.com",
"https://docker.mirrors.ustc.edu.cn",
"https://mirror.baidubce.com",
"https://ustc-edu-cn.mirror.aliyuncs.com",
"https://registry.cn-hangzhou.aliyuncs.com",
"https://ccr.ccs.tencentyun.com",
"https://hub.daocloud.io",
"https://docker.shootchat.top",
"https://do.nark.eu.org",
"https://dockerproxy.com",
"https://docker.m.daocloud.io",
"https://dockerhub.timeweb.cloud",
"https://docker.shootchat.top",
"https://do.nark.eu.org"],
"exec-opts": ["native.cgroupdriver=systemd"]
}
EOF

（3）启动docker并设置开机自启

bash 复制代码 
systemctl enable docker --now
systemctl status docker

1.3 安装docker-compose环境

bash 复制代码 
DOCKER_COMPOSE_VERSION="v2.27.0"
sudo curl -L "https://github.com/docker/compose/releases/download/${DOCKER_COMPOSE_VERSION}/docker-compose-$(uname -s)-$(uname -m)" \
  -o /usr/local/bin/docker-compose
  
chmod +x /usr/local/bin/docker-compose

2、ZooKeeper伪集群部署(可选)

ZooKeeper伪集群指的是，将集群部署到同一台服务器中

2.1 创建目录，添加docker-compose文件

bash 复制代码 
mkdir /data/software/zookeeper-cluster -p
cd /data/software/zookeeper-cluster
vim docker-compose.yml

version: '3.4'

services:
  zk1:
    image: zookeeper:3.4.14
    restart: always
    hostname: zk1
    container_name: zk1
    ports:
    - 2181:2181
    - 2888:2888
    - 3888:3888
    volumes:
    - "./data/zk1-data:/data"
    - "./datalog/zk1-datalog:/datalog"
    - "./logs/zk1-logs:/logs"
    environment:
      ZOO_MY_ID: 1
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    networks:
      - zookeeper-net

  zk2:
    image: zookeeper:3.4.14
    restart: always
    hostname: zk2
    container_name: zk2
    ports:
    - 22181:2181
    - 22888:2888
    - 23888:3888
    volumes:
    - "./data/zk2-data:/data"
    - "./datalog/zk2-datalog:/datalog"
    - "./logs/zk2-logs:/logs"
    environment:
      ZOO_MY_ID: 2
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    networks:
      - zookeeper-net

  zk3:
    image: zookeeper:3.4.14
    restart: always
    hostname: zk3
    container_name: zk3
    ports:
    - 32181:2181
    - 32888:2888
    - 33888:3888
    volumes:
    - "./data/zk3-data:/data"
    - "./datalog/zk3-datalog:/datalog"
    - "./logs/zk3-logs:/logs"
    environment:
      ZOO_MY_ID: 3
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    networks:
      - zookeeper-net
networks:
  zookeeper-net:
    driver: bridge

2.2 启动zk集群：

bash 复制代码 
cd /data/software/zookeeper-cluster
docker-compose up -d
docker-compose logs -f

3、ZooKeeper集群部署(可选)

3.1 集群环境说明

序号 IP地址 主机名称
1 16.32.15.116 zk1
2 16.32.15.200 zk2
3 16.32.15.201 zk3

3.2 zk1主机相关操作

（1）创建目录，添加docker-compose文件

bash 复制代码 
mkdir /data/software/zookeeper -p
cd /data/software/zookeeper
vim docker-compose.yml

version: '3.4'

services:
  zk1:                                  # 三个节点对应不同名称 [ zk2 | zk3 ]
    image: zookeeper:3.4.14
    restart: always
    hostname: zk1                       # 三个节点对应不同名称 [ zk2 | zk3 ]
    container_name: zk1                 # 三个节点对应不同名称 [ zk2 | zk3 ]
    network_mode: "host"
    volumes:
      - "./data:/data"
      - "./datalog:/datalog"
      - "./logs:/logs"
    environment:
      ZOO_MY_ID: 1                      # 三个节点对应不同ID [ 2 | 3 ]
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
      JVMFLAGS: "-Xmx1024m -Xms521m"
    extra_hosts:                        # 设置容器hosts为宿主机IP地址
      - "zk1:16.32.15.116"
      - "zk2:16.32.15.200"
      - "zk3:16.32.15.201"
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    mem_limit: 2g                         # 内存硬限制
    mem_reservation: 1500m                # 内存软限制
    logging:                              # 日志大小限制
      driver: json-file
      options:
        max-size: "50m"
        max-file: "10"

（2）启动zk1容器：

bash 复制代码 
cd /data/software/zookeeper
docker-compose up -d
docker-compose logs -f

3.3 zk2主机相关操作

（1）创建目录，添加docker-compose文件

bash 复制代码 
mkdir /data/software/zookeeper -p
cd /data/software/zookeeper
vim docker-compose.yml

version: '3.4'

services:
  zk2:
    image: zookeeper:3.4.14
    restart: always
    hostname: zk2
    container_name: zk2
    network_mode: "host"
    volumes:
      - "./data:/data"
      - "./datalog:/datalog"
      - "./logs:/logs"
    environment:
      ZOO_MY_ID: 2
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
      JVMFLAGS: "-Xmx1024m -Xms521m"
    extra_hosts:                        # 设置容器hosts为宿主机IP地址
      - "zk1:16.32.15.116"
      - "zk2:16.32.15.200"
      - "zk3:16.32.15.201"
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    mem_limit: 2g                         # 内存硬限制
    mem_reservation: 1500m                # 内存软限制
    logging:                              # 日志大小限制
      driver: json-file
      options:
        max-size: "50m"
        max-file: "10"

（2）启动zk2容器：

bash 复制代码 
cd /data/software/zookeeper
docker-compose up -d
docker-compose logs -f

3.4 zk3主机相关操作

（1）创建目录，添加docker-compose文件

bash 复制代码 
mkdir /data/software/zookeeper -p
cd /data/software/zookeeper
vim docker-compose.yml

version: '3.4'

services:
  zk3:
    image: zookeeper:3.4.14
    restart: always
    hostname: zk3
    container_name: zk3
    network_mode: "host"
    volumes:
      - "./data:/data"
      - "./datalog:/datalog"
      - "./logs:/logs"
    environment:
      ZOO_MY_ID: 3
      ZOO_SERVERS: server.1=zk1:2888:3888 server.2=zk2:2888:3888 server.3=zk3:2888:3888
      TZ: Asia/Shanghai
      JVMFLAGS: "-Xmx1024m -Xms521m"
    extra_hosts:                        # 设置容器hosts为宿主机IP地址
      - "zk1:16.32.15.116"
      - "zk2:16.32.15.200"
      - "zk3:16.32.15.201"
    healthcheck:
      test: ["CMD", "sh", "-c", "nc -z 127.0.0.1 2181"]
      interval: 10s
      timeout: 5s
      retries: 3
    mem_limit: 2g                         # 内存硬限制
    mem_reservation: 1500m                # 内存软限制
    logging:                              # 日志大小限制
      driver: json-file
      options:
        max-size: "50m"
        max-file: "10"

（2）启动zk3容器：

bash 复制代码 
cd /data/software/zookeeper
docker-compose up -d
docker-compose logs -f

三、ZooKeeper集群验证

1、查看集群角色

bash 复制代码 
yum -y install nc
zkList=(16.32.15.116 16.32.15.200 16.32.15.201)
for zkhost in ${zkList[@]};do zkMode=$(echo stat | nc ${zkhost} 2181 | grep Mode);echo [${zkhost}] ${zkMode};done

2、数据同步测试

bash 复制代码 
# zk1主机创建数据
docker exec -it zk1 bin/zkCli.sh
create /test "QIN TEST 666...."

# zk2主机查看数据
docker exec -it zk2 bin/zkCli.sh
get /test

3、选举leader测试

  1. 查看leader主机IP地址
bash 复制代码 
zkList=(16.32.15.116 16.32.15.200 16.32.15.201)
for zkhost in ${zkList[@]};do zkMode=$(echo stat | nc ${zkhost} 2181 | grep Mode);echo [${zkhost}] ${zkMode};done
  1. 将leader主机停止掉模仿服务器宕机
bash 复制代码 
# leader主机操作(zk2)
cd /data/software/zookeeper
docker-compose down
  1. 查看选举出新的leader主机
bash 复制代码 
zkList=(16.32.15.116 16.32.15.200 16.32.15.201)
for zkhost in ${zkList[@]};do zkMode=$(echo stat | nc ${zkhost} 2181 | grep Mode);echo [${zkhost}] ${zkMode};done
相关推荐
程序员阿超的博客4 小时前
云原生核心技术 (7/12): K8s 核心概念白话解读(上)：Pod 和 Deployment 究竟是什么？
云原生·容器·kubernetes
炎码工坊5 小时前
云原生微服务通信安全之JWT：从零到实践
网络安全·微服务·云原生·系统安全·安全架构
程序员阿超的博客5 小时前
云原生核心技术 (2/12): Docker 入门指南——什么是容器？为什么它比虚拟机更香？
docker·云原生·容器
上海运维Q先生6 小时前
Cilium动手实验室: 精通之旅---19.Golden Signals with Hubble and Grafana
云原生·k8s·grafana·cilium
嫄码9 小时前
kafka快速入门与知识汇总
java·大数据·分布式·中间件·kafka·linq
车载诊断技术12 小时前
软件定义汽车的转型之路已然开启
分布式·汽车·电子电气架构·电气电子架构开发的应对策略·什么是功能架构？
程序员阿超的博客12 小时前
云原生核心技术 (6/12): K8s 从零到一：使用 Minikube/kind 在本地搭建你的第一个 K8s 集群
云原生·kubernetes·kind
qq_4639448613 小时前
【Spark征服之路-2.5-Spark-Core编程（一）】
大数据·分布式·spark
下雨不打伞码农13 小时前
mkdir: Cannot create directory /spark/jars. Name node is in safe mode
大数据·分布式·spark
Brian Xia13 小时前
Jaeger开源分布式追踪平台深度剖析（三）Jaeger默认存储Badger原理剖析
分布式·go·lsm-tree
热门推荐
01DeepSeek各版本说明与优缺点分析02【图像处理与机器视觉】XJTU期末考点03KGG转MP3工具|非KGM文件|解密音频04海康Visionmaster-常见问题排查方法-启动阶段05从零安装 LLaMA-Factory 微调 Qwen 大模型成功及所有的坑06YOLOv8入门 | 重要性能衡量指标、训练结果评价及分析及影响mAP的因素【发论文关注的指标】07Trae AI 开发工具使用手册08Coze扣子平台完整体验和实践（附国内和国际版对比）09【SpeedAI科研小助手】2分钟极速解决知网维普重复率、AIGC率过高，一键全文降！文件格式不变，公式都保留的！10零代码入门 | Coze——让大模型接入自己的数据库