MinIO存储桶通知 - Kafka小测

概述

公司的某个项目需要用上这玩意,所以在本地搭建测试环境,经过一番折腾,测试通过,博文记录,用以备忘

MinIO安装

该节不做说明,网络有很多现成的帖子,自行搜索去

配置步骤

控制台添加事件通知



将具体存储桶和事件通知关联起来

点击"Save"保存即可。

注意:

  1. evtest是我预先创建的存储桶,具体你们根据实际场景变更
  2. 填写了桶文件的前后缀,当桶路径匹配不上的时候,不会发送事件通知

事件通知内容样例

PUT

bash 复制代码
{
	"EventName": "s3:ObjectCreated:Put",
	"Key": "evtest/111.conf",
	"Records": [
		{
			"eventVersion": "2.0",
			"eventSource": "minio:s3",
			"awsRegion": "",
			"eventTime": "2024-07-22T01:31:23.190Z",
			"eventName": "s3:ObjectCreated:Put",
			"userIdentity": {
				"principalId": "admin"
			},
			"requestParameters": {
				"principalId": "admin",
				"region": "",
				"sourceIPAddress": "192.168.64.1"
			},
			"responseElements": {
				"x-amz-id-2": "dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8",
				"x-amz-request-id": "17E464E2E26B8A25",
				"x-minio-deployment-id": "3f95da32-9ae8-4983-9622-df88df89410d",
				"x-minio-origin-endpoint": "http://192.168.64.136:9000"
			},
			"s3": {
				"s3SchemaVersion": "1.0",
				"configurationId": "Config",
				"bucket": {
					"name": "evtest",
					"ownerIdentity": {
						"principalId": "admin"
					},
					"arn": "arn:aws:s3:::evtest"
				},
				"object": {
					"key": "111.conf",
					"size": 4763,
					"eTag": "15c4659f418b62e001f7d597dedaf51c",
					"contentType": "application/octet-stream",
					"userMetadata": {
						"content-type": "application/octet-stream"
					},
					"sequencer": "17E464E2E272AAA7"
				}
			},
			"source": {
				"host": "192.168.64.1",
				"port": "",
				"userAgent": "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)"
			}
		}
	]
}

DELETE

bash 复制代码
{
	"EventName": "s3:ObjectRemoved:Delete",
	"Key": "evtest/111.conf",
	"Records": [
		{
			"eventVersion": "2.0",
			"eventSource": "minio:s3",
			"awsRegion": "",
			"eventTime": "2024-07-22T01:56:53.672Z",
			"eventName": "s3:ObjectRemoved:Delete",
			"userIdentity": {
				"principalId": "admin"
			},
			"requestParameters": {
				"principalId": "admin",
				"region": "",
				"sourceIPAddress": "192.168.64.1"
			},
			"responseElements": {
				"content-length": "154",
				"x-amz-id-2": "dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8",
				"x-amz-request-id": "17E466473A6E11BB",
				"x-minio-deployment-id": "3f95da32-9ae8-4983-9622-df88df89410d",
				"x-minio-origin-endpoint": "http://192.168.64.136:9000"
			},
			"s3": {
				"s3SchemaVersion": "1.0",
				"configurationId": "Config",
				"bucket": {
					"name": "evtest",
					"ownerIdentity": {
						"principalId": "admin"
					},
					"arn": "arn:aws:s3:::evtest"
				},
				"object": {
					"key": "111.conf",
					"sequencer": "17E466473A7E072B"
				}
			},
			"source": {
				"host": "192.168.64.1",
				"port": "",
				"userAgent": "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)"
			}
		}
	]
}
bash 复制代码
{
	"EventName": "s3:ObjectAccessed:Head",
	"Key": "evtest/111.conf",
	"Records": [
		{
			"eventVersion": "2.0",
			"eventSource": "minio:s3",
			"awsRegion": "",
			"eventTime": "2024-07-22T01:56:46.230Z",
			"eventName": "s3:ObjectAccessed:Head",
			"userIdentity": {
				"principalId": "admin"
			},
			"requestParameters": {
				"principalId": "admin",
				"region": "",
				"sourceIPAddress": "192.168.64.1"
			},
			"responseElements": {
				"content-length": "4763",
				"x-amz-id-2": "dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8",
				"x-amz-request-id": "17E466457ED88843",
				"x-minio-deployment-id": "3f95da32-9ae8-4983-9622-df88df89410d",
				"x-minio-origin-endpoint": "http://192.168.64.136:9000"
			},
			"s3": {
				"s3SchemaVersion": "1.0",
				"configurationId": "Config",
				"bucket": {
					"name": "evtest",
					"ownerIdentity": {
						"principalId": "admin"
					},
					"arn": "arn:aws:s3:::evtest"
				},
				"object": {
					"key": "111.conf",
					"size": 4763,
					"eTag": "15c4659f418b62e001f7d597dedaf51c",
					"contentType": "application/octet-stream",
					"userMetadata": {
						"content-type": "application/octet-stream"
					},
					"sequencer": "17E464E2E272AAA7"
				}
			},
			"source": {
				"host": "192.168.64.1",
				"port": "",
				"userAgent": "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)"
			}
		}
	]
}

以上通知样例都是通过MinIO Console操作,然后从Kafka接收到的具体内容

参考链接

Minio Bucket 通知试用&&说明
MinIO存储桶通知指南
发布事件到Kafka

相关推荐
半桶水专家2 小时前
Kafka 4.0.1 KRaft 模式完整部署指南
分布式·kafka·linq
Arthas2172 小时前
互联网大厂Java面试实录:谢飞机的电商微服务之旅 - Spring Boot/Cloud/Redis/Kafka实战
spring boot·redis·spring cloud·微服务·kafka·java面试·电商
huohuopro6 小时前
HBase 伪分布式环境安装指南
数据库·分布式·hbase
程序员阿伦6 小时前
谢飞机面Java大厂:音视频场景下的Spring Boot + Kafka + Redis实战三连问
spring boot·redis·kafka·java面试·音视频架构·微服务容错
一只大袋鼠7 小时前
高并发系统架构优化(下):突破带宽瓶颈,迈向分布式集群
分布式·系统架构
路小雨~7 小时前
RabbitMQ 全面学习资料
分布式·学习·rabbitmq
heimeiyingwang7 小时前
【架构实战】分布式事务解决方案
分布式·架构
2401_840192277 小时前
监控的作用
分布式·kubernetes
hf2000127 小时前
零成本迁移,原地加速,成本降低60%:火花思维基于云器Lakehouse升级实践
大数据·分布式·spark·lakehouse