Clickhouse监控_使用Prometheus+Grafana来监控Clickhouse服务和性能指标

官方文档https://clickhouse.com/docs/zh/operations/monitoring

建议使用Prometheus+Grafana组合监控Clickhouse服务和性能指标

1、把prometheus的clickhouse_exporter下载到Clickhouse服务器,查找prometheus的clickhouse_exporter参见https://prometheus.io/docs/instrumenting/exporters/#databases,查看clickhouse_exporter的git信息可以登陆到https://github.com/ClickHouse/clickhouse_exporter上面查看

bash 复制代码
root@DAILACHDBUD002:~# git clone https://github.com/ClickHouse/clickhouse_exporter.git
Cloning into 'clickhouse_exporter'...
remote: Enumerating objects: 1185, done.
remote: Counting objects: 100% (306/306), done.
remote: Compressing objects: 100% (162/162), done.
remote: Total 1185 (delta 179), reused 164 (delta 138), pack-reused 879
Receiving objects: 100% (1185/1185), 1.36 MiB | 5.99 MiB/s, done.
Resolving deltas: 100% (359/359), done.

2、进入下载后的clickhouse_exporter目录,对其进行编译,由于https://github.com/ClickHouse/clickhouse_exporter上看到clickhouse_exporter相关信息是golang,所以安装是golang再编译

bash 复制代码
root@DAILACHDBUD002:~# cd clickhouse_exporter/
root@DAILACHDBUD002:~/clickhouse_exporter# ll clickhouse_exporter
ls: cannot access 'clickhouse_exporter': No such file or directory
root@DAILACHDBUD002:~/clickhouse_exporter# apt install golang-go
root@DAILACHDBUD002:~/clickhouse_exporter# go build clickhouse_exporter.go
root@DAILACHDBUD002:~/clickhouse_exporter# ll clickhouse_exporter
-rwxr-xr-x 1 root root 12591899 Dec 21 07:04 clickhouse_exporter*

3、编译好clickhouse_exporter后,配置clickhouse_exporter开机启动,其中/root/clickhouse_exporter/clickhouse_exporter -scrape_uri=http://default:W123@localhost:8123/ &此处必须加上后缀&,否则后面的systemctl start clickhouse_exporter会一直无法正常启然后systemctl status clickhouse_exporter会看到一直处于Active: activating (start)启动的状态而不是正常的Active: active (running)

bash 复制代码
root@DAILACHDBUD002:~# cat /root/script/clickhouse_exporter.sh
#/bin/sh
/root/clickhouse_exporter/clickhouse_exporter -scrape_uri=http://default:W123@localhost:8123/ &
bash 复制代码
root@DAILACHDBUD002:~# cat /usr/lib/systemd/system/clickhouse_exporter.service
[Unit]
Description=clickhouse_exporter
After=network.target

[Service]
User=root
Group=root
Type=forking
ExecStart=/bin/bash /root/script/clickhouse_exporter.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target
bash 复制代码
root@DAILACHDBUD002:~# systemctl enable clickhouse_exporter
Created symlink /etc/systemd/system/multi-user.target.wants/clickhouse_exporter.service → /lib/systemd/system/clickhouse_exporter.service.

root@DAILACHDBUD002:~# systemctl start clickhouse_exporter

root@DAILACHDBUD002:~# systemctl status clickhouse_exporter
● clickhouse_exporter.service - clickhouse_exporter
     Loaded: loaded (/lib/systemd/system/clickhouse_exporter.service; enabled; vendor preset: enabled)
     Active: active (running) since Thu 2023-12-21 07:22:30 UTC; 3s ago

4、登陆Prometheus所在服务器,打开Prometheus配置文件vim /prometheus/prometheus-2.32.1/prometheus.yml,增加如下配置

bash 复制代码
 - job_name: "clickhouse_exporter"
    scrape_timeout: 10s
    metrics_path: /metrics
    static_configs:
      - targets: ['172.22.137.132:9116']
      - targets: ['172.22.137.133:9116']
      - targets: ['172.22.137.134:9116']
      - targets: ['172.22.137.136:9116']

5、在https://grafana.com/grafana/dashboards/中查找Clickhouse的模板,在Grafana监控配置页面导入Clickhouse的模板https://grafana.com/grafana/dashboards/882-clickhouse/或https://grafana.com/grafana/dashboards/14432-clickhouse-metrics-on-settings/,然后在Grafana监控配置页面的数据源选项中选择Prometheus

相关推荐
这儿有个昵称44 分钟前
互联网大厂Java面试场景:从Spring框架到微服务架构的提问解析
java·spring boot·微服务·kafka·grafana·prometheus·数据库优化
·云扬·4 小时前
3台机器搭建ClickHouse环形复制集群实践
clickhouse
·云扬·1 天前
使用Prometheus+Grafana实现Elasticsearch监控的完整实践
elasticsearch·grafana·prometheus
一路向北⁢1 天前
APP企业级业务数据埋点系统(基于 Spring Boot & ClickHouse)
spring boot·后端·clickhouse·统计分析·埋点·pu·vu
忍冬行者2 天前
prometheus通过VMware_explorter监控VMware虚拟化集群
云原生·云计算·grafana·prometheus
温暖小土2 天前
ClickHouse vs Apache Doris:2026年实时OLAP数据库选型深度解析
数据库·数据仓库·clickhouse·apache
海边的椰子树2 天前
非常方便的MySQL迁移数据ClickHouse工具
数据库·mysql·clickhouse·迁移
JZC_xiaozhong2 天前
分析型数据库 ClickHouse 在数据中台中的集成
大数据·数据库·clickhouse·架构·数据一致性·数据孤岛解决方案·数据集成与应用集成
·云扬·2 天前
ClickHouse数据备份与恢复实战:从基础操作到工具应用
android·java·clickhouse
L1624763 天前
Prometheus、Cadvisor和Grafana体系完整学习手册
学习·grafana·prometheus