sql_exporter通过sql收集业务数据并通过prometheus+grafana展示

下载并解压安装sql_exporter

bash 复制代码
wget https://github.com/free/sql_exporter/releases/download/0.5/sql_exporter-0.5.linux-amd64.tar.gz
#解压
tar xvf sql_exporter-0.5.linux-amd64.tar.gz -C /usr/local/

修改主配置文件

bash 复制代码
cd /usr/local/
mv sql_exporter-0.5.linux-amd64 sql_exporter
cd /usr/local/sql_exporter
cat /usr/local/sql_exporter/config.yml
yml 复制代码
# Global defaults.
global:
  # Subtracted from Prometheus' scrape_timeout to give us some headroom and prevent Prometheus from timing out first.
  scrape_timeout_offset: 500ms
  # Minimum interval between collector runs: by default (0s) collectors are executed on every scrape.
  min_interval: 0s
  # Maximum number of open connections to any one target. Metric queries will run concurrently on multiple connections,
  # as will concurrent scrapes.
  max_connections: 3
  # Maximum number of idle connections to any one target. Unless you use very long collection intervals, this should
  # always be the same as max_connections.
  max_idle_connections: 3
  # Maximum number of maximum amount of time a connection may be reused. Expired connections may be closed lazily before reuse.
  # If 0, connections are not closed due to a connection's age.
  max_connection_lifetime: 5m

# The target to monitor and the collectors to execute on it.
target:
  # Data source name always has a URI schema that matches the driver name. In some cases (e.g. MySQL)
  # the schema gets dropped or replaced to match the driver expected DSN format.
  data_source_name: 'mysql://prometheus_user:prometheus_password@dbIP:3306/DBname'

  # Collectors (referenced by name) to execute on the target.
  # Glob patterns are supported (see <https://pkg.go.dev/path/filepath#Match> for syntax).
  collectors: [DBname*]

# Collector files specifies a list of globs. One collector definition is read from each matching file.
# Glob patterns are supported (see <https://pkg.go.dev/path/filepath#Match> for syntax).
collector_files: 
  - "/usr/local/sql_exporter/DBname_tables.yml"

编写sql查询配置文件

yml 复制代码
cat /usr/local/sql_exporter/DBname_tables.yml

collector_name: DBname_tables
metrics:
- metric_name: member_register_count_today
  type: gauge
  help: '当日会员注册数'
  values: [member_register_count_today]
  query: |
        SELECT COUNT(0) as 'member_register_count_today' FROM manage_member WHERE DATE(create_time)=CURDATE()

编写启动脚本并启动

bash 复制代码
cat > /usr/lib/systemd/system/sql-exporter-DBname.service <<EOF
[Unit]
Description=sql_exporter

[Service]
ExecStart=/usr/local/sql_exporter/sql_exporter -config.file /usr/local/sql_exporter/config.yml  -web.listen-address 0.0.0.0:9501
Restart=on-failure

[Install]
WantedBy=multi-user.target
EOF
systemctl daemon-reload
systemctl enable sql-exporter-DBname.service --now

接入prometheus

yaml 复制代码
  - job_name: 'sql'
    scrape_interval: 1m
    scrape_timeout: 50s
    static_configs:
      - targets:
        - 'localhost:9501'

prometheus热加载生效

curl -X POST http://localhost:9090/-/reload

prometheus查看监控指标是否收集

curl http://localhost:9501/metrics

grafana配置监控面板

配置会员注册趋势

复制代码
#当日
floor(delta(member_register_count_today[$__rate_interval]))>0 or (member_register_count_today*0)
昨日
floor(delta(member_register_count_today[$__rate_interval] offset 1d)) > 0 or (member_register_count_today*0)
相关推荐
Decay__1 小时前
12_MySQL InnoDB 内存与锁调优 —— Buffer Pool、redo log、隔离级别与锁等待
运维·数据库·sql·mysql·架构
Decay__13 小时前
14_MySQL 高可用与容灾架构 —— MGR / InnoDB Cluster / Keepalived+VIP / 双主 / 读写分离 / 两地三中心
运维·数据库·sql·mysql·架构
freejackman13 小时前
【实战三】撕开脱敏盲区:深度解析 CASE WHEN 与窗口函数血缘
大数据·数据库·sql
codigger15 小时前
线上数据库连接池打满:从应急止损到架构根治的完整方案
数据库·sql·程序员
挖掘狂人16 小时前
线上数据库连接池打满:从应急止损到架构根治的完整方案
数据库·sql·程序员
Thanks_ks16 小时前
MySQL 的索引是什么?用图书馆的目录讲明白
数据库·sql·mysql·索引·联合索引·explain·慢查询优化
freejackman1 天前
【实战二】字段级血缘追踪:拆解 AST 迷局,精准穿透函数链与子查询
大数据·数据库·sql
骑着蜗牛撵大象3272 天前
MySQL 8.0 迁移后 SQL 变慢:执行计划里 3 类被忽略的成本差异
android·数据库·sql·mysql·优化器·执行计划
zhengfei6112 天前
Go-fastdfs /reload 未授权访问: 有效PoC
数据库·sql
大维3 天前
DBX 实测:从 SQLite 查询到 MiniMax-M3 自然语言生成 SQL
数据库·sql·sqlite