Clickhouse监控_使用Prometheus+Grafana来监控Clickhouse服务和性能指标

官方文档https://clickhouse.com/docs/zh/operations/monitoring

建议使用Prometheus+Grafana组合监控Clickhouse服务和性能指标

1、把prometheus的clickhouse_exporter下载到Clickhouse服务器,查找prometheus的clickhouse_exporter参见https://prometheus.io/docs/instrumenting/exporters/#databases,查看clickhouse_exporter的git信息可以登陆到https://github.com/ClickHouse/clickhouse_exporter上面查看

bash 复制代码
root@DAILACHDBUD002:~# git clone https://github.com/ClickHouse/clickhouse_exporter.git
Cloning into 'clickhouse_exporter'...
remote: Enumerating objects: 1185, done.
remote: Counting objects: 100% (306/306), done.
remote: Compressing objects: 100% (162/162), done.
remote: Total 1185 (delta 179), reused 164 (delta 138), pack-reused 879
Receiving objects: 100% (1185/1185), 1.36 MiB | 5.99 MiB/s, done.
Resolving deltas: 100% (359/359), done.

2、进入下载后的clickhouse_exporter目录,对其进行编译,由于https://github.com/ClickHouse/clickhouse_exporter上看到clickhouse_exporter相关信息是golang,所以安装是golang再编译

bash 复制代码
root@DAILACHDBUD002:~# cd clickhouse_exporter/
root@DAILACHDBUD002:~/clickhouse_exporter# ll clickhouse_exporter
ls: cannot access 'clickhouse_exporter': No such file or directory
root@DAILACHDBUD002:~/clickhouse_exporter# apt install golang-go
root@DAILACHDBUD002:~/clickhouse_exporter# go build clickhouse_exporter.go
root@DAILACHDBUD002:~/clickhouse_exporter# ll clickhouse_exporter
-rwxr-xr-x 1 root root 12591899 Dec 21 07:04 clickhouse_exporter*

3、编译好clickhouse_exporter后,配置clickhouse_exporter开机启动,其中/root/clickhouse_exporter/clickhouse_exporter -scrape_uri=http://default:W123@localhost:8123/ &此处必须加上后缀&,否则后面的systemctl start clickhouse_exporter会一直无法正常启然后systemctl status clickhouse_exporter会看到一直处于Active: activating (start)启动的状态而不是正常的Active: active (running)

bash 复制代码
root@DAILACHDBUD002:~# cat /root/script/clickhouse_exporter.sh
#/bin/sh
/root/clickhouse_exporter/clickhouse_exporter -scrape_uri=http://default:W123@localhost:8123/ &
bash 复制代码
root@DAILACHDBUD002:~# cat /usr/lib/systemd/system/clickhouse_exporter.service
[Unit]
Description=clickhouse_exporter
After=network.target

[Service]
User=root
Group=root
Type=forking
ExecStart=/bin/bash /root/script/clickhouse_exporter.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target
bash 复制代码
root@DAILACHDBUD002:~# systemctl enable clickhouse_exporter
Created symlink /etc/systemd/system/multi-user.target.wants/clickhouse_exporter.service → /lib/systemd/system/clickhouse_exporter.service.

root@DAILACHDBUD002:~# systemctl start clickhouse_exporter

root@DAILACHDBUD002:~# systemctl status clickhouse_exporter
● clickhouse_exporter.service - clickhouse_exporter
     Loaded: loaded (/lib/systemd/system/clickhouse_exporter.service; enabled; vendor preset: enabled)
     Active: active (running) since Thu 2023-12-21 07:22:30 UTC; 3s ago

4、登陆Prometheus所在服务器,打开Prometheus配置文件vim /prometheus/prometheus-2.32.1/prometheus.yml,增加如下配置

bash 复制代码
 - job_name: "clickhouse_exporter"
    scrape_timeout: 10s
    metrics_path: /metrics
    static_configs:
      - targets: ['172.22.137.132:9116']
      - targets: ['172.22.137.133:9116']
      - targets: ['172.22.137.134:9116']
      - targets: ['172.22.137.136:9116']

5、在https://grafana.com/grafana/dashboards/中查找Clickhouse的模板,在Grafana监控配置页面导入Clickhouse的模板https://grafana.com/grafana/dashboards/882-clickhouse/或https://grafana.com/grafana/dashboards/14432-clickhouse-metrics-on-settings/,然后在Grafana监控配置页面的数据源选项中选择Prometheus

相关推荐
曲幽1 天前
FastAPI服务半夜又挂了?先别急着重启,查查你的数据库连接池“池子”是不是漏了
python·prometheus·fastapi·web·async·sqlalchemy·connection·pool
Dontla3 天前
高基数(High Cardinality)问题介绍(Prometheus、高基数字段、低基数字段)
前端·数据库·prometheus
川石课堂软件测试3 天前
requests接口自动化测试
数据库·python·功能测试·测试工具·单元测试·grafana·prometheus
自不量力的A同学3 天前
Grafana 13.0.1 发布
grafana
没有口袋啦3 天前
基于 Prometheus + Grafana 的云原生立体化监控体系构建
grafana·prometheus
Dontla4 天前
Prometheus介绍(开源系统监控与告警工具)(时间序列数据库TSDB、标签化label-based多维分析、Pull模型、PromQL查询语言)
数据库·开源·prometheus
数据雕塑家5 天前
数据库 + Grafana 可视化配置指南:从数据源连接到第一个仪表盘
数据库·grafana
yunson_Liu5 天前
记一次logrotate.service处理过程
prometheus
TechWJ6 天前
Ansible 跨千台机器批量部署,Node Exporter 监控实现 Prometheus 统一采集
ansible·prometheus