在数字化时代，数据存储与管理变得尤为重要，尤其是对于非结构化数据如日志文件的处理。MinIO，作为一个高性能、可扩展的分布式对象存储系统，以其对Amazon S3的全面兼容性和轻量级设计，成为了众多企业和开发者存储大量数据的首选。本文将带你深入了解MinIO的配置方法
部署MinIO
集群节点规划
| 节点信息 | 服务 | 数据盘 |
|---|---|---|
| 192.168.1.10 | minio server | /data/minio_data/{data1,data2} |
| 192.168.1.11 | minio server | /data/minio_data/{data1,data2} |
| 192.168.1.12 | minio server | /data/minio_data/{data1,data2} |
| 192.168.1.13 | minio server | /data/minio_data/{data1,data2} |
| 192.168.1.14 | nginx |
依赖：Ansible，docker，nginx，具体参考资料在文末
集群基础环境准备
创建minio节点 配置文件minio.hosts
[minio]
192.168.1.10
192.168.1.11
192.168.1.12
192.168.1.13
初始化环境
关闭防火墙
# 关闭防火墙
systemctl stop firewalld
systemctl disable firewalld
systemctl status firewalld
修改系统最大文件数
ulimit -n #查看最大连接数
ulimit -a
echo "* soft nofile 65535" >> /etc/security/limits.conf
echo "* hard nofile 65535" >> /etc/security/limits.conf
sysctl -p
reboot
创建启动脚本/配置文件/数据目录
# 创建启动脚本目录
ansible -i minio.hosts minio -m file -a 'path=/usr/local/app/minio/bin state=directory mode=0755'
# 创建配置文件目录
ansible -i minio.hosts minio -m file -a 'path=/etc/minio state=directory mode=0755'
# 创建数据目录
ansible -i minio.hosts minio -m file -a 'path=/data/minio_data/data1 state=directory mode=0755'
ansible -i minio.hosts minio -m file -a 'path=/data/minio_data/data2 state=directory mode=0755'
安装包准备
下载minio
# 下载minio
cd /data/minio/bin && wget https://dl.min.io/server/minio/release/linux-amd64/minio
推送安装包
# 推送minio到所有节点
ansible -i minio.hosts minio -m copy -a 'src=/usr/local/app/minio/bin/minio dest=/usr/local/app/minio/bin/minio mode=0755'
启动脚本准备
脚本名称：run.sh
#!/bin/bash
export MINIO_ROOT_USER=minio #访问密钥，用于身份验证。根据自身情况进行修改
export MINIO_ROOT_PASSWORD=123456 # 秘密密钥，用于身份验证，根据自身情况进行修改。
/usr/local/app/minio/bin/minio server --config-dir /etc/minio --address ":9000" --console-address ":9001" \
http://192.168.1.36/data/minio_data/data1 http://192.168.1.36/data/minio_data/data2 \
http://192.168.1.91/data/minio_data/data1 http://192.168.1.91/data/minio_data/data2 \
http://192.168.1.92/data/minio_data/data1 http://192.168.1.92/data/minio_data/data2 \
http://192.168.1.110/data/minio_data/data1 http://192.168.1.110/data/minio_data/data2
部署
推送启动脚本到所有节点
ansible -i minio.hosts minio -m copy -a 'src=/usr/local/app/minio/bin/run.sh dest=/usr/local/app/minio/bin/run.sh mode=0755'
创建systemd配置文件minio.service
/usr/lib/systemd/system/minio.service
[Unit]
Description=Minio service
Documentation=https://docs.minio.io/
[Service]
WorkingDirectory=/usr/local/app/minio/bin/
ExecStart=/usr/local/app/minio/bin/run.sh
Restart=on-failure
RestartSec=5
[Install]
WantedBy=multi-user.target
推送启动minio.service到所有节点
ansible -i minio.hosts minio -m copy -a 'src=/usr/lib/systemd/system/minio.service dest=/usr/lib/systemd/system/minio.service mode=0755'
启动minio
# 启动minio
ansible -i minio.hosts minio -m shell -a 'systemctl daemon-reload'
ansible -i minio.hosts minio -m shell -a 'systemctl enable minio'
ansible -i minio.hosts minio -m shell -a 'systemctl start minio'
ansible -i minio.hosts minio -m shell -a 'systemctl status minio'
检查(查看到running)
systemctl status minio
● minio.service - Minio service
Loaded: loaded (/usr/lib/systemd/system/minio.service; enabled; vendor preset: disabled)
Active: active (running) since Wed 2024-04-03 16:45:15 CST; 1 months 2 days ago
Docs: https://docs.minio.io/
Main PID: 38640 (run.sh)
Tasks: 30
Memory: 1.7G
CGroup: /system.slice/minio.service
访问
浏览器输入集群任意节点地址+9000端口，即可访问minio，可创建"bucket"并上传文件测试
输入账户minio密码123456即可访问
Nginx代理
# 搭建nginx 参考https://zhuanlan.zhihu.com/p/639039219
# 由于测试主机80端口被占，nginx这里使用8080端口
docker run -p 8080:80 -p 8081:81 --name nginx-prod --restart=always -v /opt/docker/nginx/conf:/etc/nginx -v /opt/docker/nginx/html:/usr/share/nginx/html -v /var/log/nginx:/var/log/nginx -d nginx:1.25.1
#映射下面目录到宿主机
/opt/docker/nginx/conf # nginx 配置文件目录
/opt/docker/nginx/html # Nginx默认站点目录
/var/log/nginx #Nginx日志目录
nginx配置minio
打开 /opt/docker/nginx/conf/conf.d/minio.conf，编辑
推荐配置
（ MinIO Server listening 和 MinIO Console listening分开）
upstream minio {
least_conn;
server 192.168.1.10:9000;
server 192.168.1.11:9000;
server 192.168.1.12:9000;
server 192.168.1.13:9000;
}
upstream minio_console {
least_conn;
server 192.168.1.10:9001;
server 192.168.1.11:9001;
server 192.168.1.12:9001;
server 192.168.1.13:9001;
}
server {
listen 80;
server_name minio;
location / {
proxy_pass http://minio;
proxy_set_header Host $http_host;
#client_max_body_size 1000m;
#添加了websocket支持，解决object browser loading 问题
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
location /minio/ui/ {
rewrite ^/minio/ui/(.*) /$1 break;
proxy_pass http://minio_console;
proxy_set_header Host $http_host;
#client_max_body_size 1000m;
#添加了websocket支持，解决object browser loading 问题
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
}
nginx 启停
# 查看配置文件是否正确
docker exec -i nginx-prod /sbin/nginx -t
# 重新加载配置
docker exec -i nginx-prod /sbin/nginx -c /etc/nginx/nginx.conf -s reload
# 重启nginx
docker exec -i nginx-prod /sbin/nginx -c /etc/nginx/nginx.conf -s reopen
访问
输入账户minio密码123456即可访问