sql_exporter通过sql收集业务数据并通过prometheus+grafana展示

下载并解压安装sql_exporter

bash 复制代码
wget https://github.com/free/sql_exporter/releases/download/0.5/sql_exporter-0.5.linux-amd64.tar.gz
#解压
tar xvf sql_exporter-0.5.linux-amd64.tar.gz -C /usr/local/

修改主配置文件

bash 复制代码
cd /usr/local/
mv sql_exporter-0.5.linux-amd64 sql_exporter
cd /usr/local/sql_exporter
cat /usr/local/sql_exporter/config.yml
yml 复制代码
# Global defaults.
global:
  # Subtracted from Prometheus' scrape_timeout to give us some headroom and prevent Prometheus from timing out first.
  scrape_timeout_offset: 500ms
  # Minimum interval between collector runs: by default (0s) collectors are executed on every scrape.
  min_interval: 0s
  # Maximum number of open connections to any one target. Metric queries will run concurrently on multiple connections,
  # as will concurrent scrapes.
  max_connections: 3
  # Maximum number of idle connections to any one target. Unless you use very long collection intervals, this should
  # always be the same as max_connections.
  max_idle_connections: 3
  # Maximum number of maximum amount of time a connection may be reused. Expired connections may be closed lazily before reuse.
  # If 0, connections are not closed due to a connection's age.
  max_connection_lifetime: 5m

# The target to monitor and the collectors to execute on it.
target:
  # Data source name always has a URI schema that matches the driver name. In some cases (e.g. MySQL)
  # the schema gets dropped or replaced to match the driver expected DSN format.
  data_source_name: 'mysql://prometheus_user:prometheus_password@dbIP:3306/DBname'

  # Collectors (referenced by name) to execute on the target.
  # Glob patterns are supported (see <https://pkg.go.dev/path/filepath#Match> for syntax).
  collectors: [DBname*]

# Collector files specifies a list of globs. One collector definition is read from each matching file.
# Glob patterns are supported (see <https://pkg.go.dev/path/filepath#Match> for syntax).
collector_files: 
  - "/usr/local/sql_exporter/DBname_tables.yml"

编写sql查询配置文件

yml 复制代码
cat /usr/local/sql_exporter/DBname_tables.yml

collector_name: DBname_tables
metrics:
- metric_name: member_register_count_today
  type: gauge
  help: '当日会员注册数'
  values: [member_register_count_today]
  query: |
        SELECT COUNT(0) as 'member_register_count_today' FROM manage_member WHERE DATE(create_time)=CURDATE()

编写启动脚本并启动

bash 复制代码
cat > /usr/lib/systemd/system/sql-exporter-DBname.service <<EOF
[Unit]
Description=sql_exporter

[Service]
ExecStart=/usr/local/sql_exporter/sql_exporter -config.file /usr/local/sql_exporter/config.yml  -web.listen-address 0.0.0.0:9501
Restart=on-failure

[Install]
WantedBy=multi-user.target
EOF
systemctl daemon-reload
systemctl enable sql-exporter-DBname.service --now

接入prometheus

yaml 复制代码
  - job_name: 'sql'
    scrape_interval: 1m
    scrape_timeout: 50s
    static_configs:
      - targets:
        - 'localhost:9501'

prometheus热加载生效

curl -X POST http://localhost:9090/-/reload

prometheus查看监控指标是否收集

curl http://localhost:9501/metrics

grafana配置监控面板

配置会员注册趋势

复制代码
#当日
floor(delta(member_register_count_today[$__rate_interval]))>0 or (member_register_count_today*0)
昨日
floor(delta(member_register_count_today[$__rate_interval] offset 1d)) > 0 or (member_register_count_today*0)
相关推荐
晚安code8 小时前
MySQL 开发规范清单:建表、索引、SQL、ORM 四块一次讲透
数据库·sql·mysql
weixin_727535629 小时前
mysql高频八股问答200
sql·mysql
凤山老林9 小时前
可观测性落地:Spring Boot 3.x + Actuator + Prometheus + Grafana 监控体系搭建
spring boot·grafana·prometheus
Yan_chen66610 小时前
CTFHub SQL 布尔盲注实战攻略
数据库·sql·实战·布尔盲注·ctfhub闯关
Csvn10 小时前
📊 SQL 入门 Day 16:数据插入技巧
后端·sql
vHelios12 小时前
【电商项目】商品服务模块的问题解决与代码逻辑思考
java·sql·mybatis
让头发掉下来1 天前
Flink SQL 中两个频繁变化 Topic 的 Join 行为分析
大数据·数据库·sql·flink
vHelios1 天前
【电商项目】测试 授权功能 遇到的问题与解决方案
java·spring boot·sql
johnny2331 天前
用SQL查MQ:Trino、PGMQ、KsqlDB、Proton、OpenLooKeng、KarelDB
sql
l1t1 天前
用李红艳先生的DuckDB luajit插件批量计算数独
数据库·sql·lua·duckdb