SeaTunnel 社区月报
2025-02期
"
各位热爱 Apache SeaTunnel 的小伙伴们，SeaTunnel 社区月报来啦！"
SeaTunnel 正在迅猛发展，这将有利于提升数据同步的高可扩展性、高性能及高可靠性。
SeaTunnel Monthly Merge Stars
感谢以下小伙伴上个月为 Apache SeaTunnel 做的精彩贡献（排名不分先后）：
| @hawk9821 | @fcb-xiaobo | @akulabs8 |
|---|---|---|
| @realcpf | @lyne7-sc | @litiliu |
| @uniding | @mickeyzzm | @MyeoungDev |
| @thakralgarvit | @xiaochen-zhou | @zhangshenghang |
| @remones | @Gemini147258 | @Scorpio777888 |
| @lm-ylj | @joyCurry30 | @hailin0 |
| @CosmosNi | @duzhendi | @jw-itq |
| @wuchunfu | @liunaijie | @corgy-w |
| @wattt3 | @Hisoka-X | @SplitfireUptown |
| @quicklyfast | @wgzhao | @liugddx |
近期修复和改进
修复内容
- [Fix][Connector-File]解决冲突的
file_format_type需求 @litiliu - [Fix]修复SourceSplitEnumerator实现类中的错误日志名称 @fcb-xiaobo
- [Fix][Doc]修复S3文件文档 @litiliu
- [Fix][Connector-V2]修复解析SqlServer JDBC URL错误 @Hisoka-X
- [Fix][Connector-V2]修复连接器中CUSTOM_SQL的描述 @xiaochen-zhou
- [Bugfix]修复ExceptionUtil的ClassCastException @hailin0
- [Fix][E2e]优化后的POM文件名称标签 @corgy-w
- [Fix][Connector-V2]修复在 request_tablet_size 小于 BUCKETS 数量的场景中可能的数据丢失问题 @xiaochen-zhou
- [Fix][Connector-v2]将DateMilliConvertor添加到将DateMilliVector转换为默认时区 @xiaochen-zhou
- [Fix][Transform]修复FieldMapper转换时丢失字段约束信息 @quicklyfast
- [Bugfix][Canal]修复运河序列化为json @hailin0
- [Fix][Connector-V2]修复JDBC Sink语句缓冲区错误的时间清除问题 @Hisoka-X
- [Fix][Connector-V2]修复无法读取空字符串的文件阅读问题 @corgy-w
- [Fix][transform-v2]大型语言模型转换提供者切换案例缺少中断 @realcpf
- [Fix][Connector-v2][DorisIT]修复DorisIT无法运行本地的问题 @zhangshenghang
- [Fix][transform-v2]SQL转换支持最大/最小函数 @CosmosNi
- [hotfix][doc]HdfsFile 文档 @wgzhao
- [Fix][Plugin]优化插件发现机制 @corgy-w
- [Fix][MySQL-CDC]修复因binlog删除导致的恢复任务失败 @lm-ylj
improve
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Vertica.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SqlServer.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SelectDB-Cloud.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/S3File.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/FtpFile.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/FakeSource.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Snowflake.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SftpFile.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Easysearch.md]系统 @Scorpio777888
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/DB2.md]系统 @Scorpio777888
- [Improve][Redis]优化的Redis连接参数 @fcb-xiaobo
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/S3-Redshift.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/RocketMQ.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OssJindoFile.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OssFile.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Oracle.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OceanBase.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/ObsFile.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/CosFile.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Clickhouse.md]系统 @Gemini147258
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Mysql.md]系统 @Gemini147258
- [Improve][Jdbc]删除无用的工具。 @joyCurry30
- [Feature][Transform-v2]在嵌入模块和LLM模块中添加对智谱AI的支持 @xiaochen-zhou
- [Feature][Connector-V2]为读写文件功能添加
filename_extension参数。 @Hisoka-X - [Improve][Zeta]默认禁用RESTful API v1 @Hisoka-X
- [improve]更新ClickHouse连接器配置选项 @lyne7-sc
- [Improve][connector][activemq]移除重复的依赖项 @wuchunfu
- [Improve][Connector-V2]改进兽人阅读错误信息 @Hisoka-X
- [improve]德瑞选项 @liunaijie
- [improve]数据枢纽接收选项 @liunaijie
- [improve]控制台接收选项 @liunaijie
- [improve]钉钉接收器选项 @liunaijie
- [improve]重新组织Zeta引擎配置选项 @liunaijie
- [improve]RabbitMQ 选项 @liunaijie
- [Feature][Config]支持自定义配置键用于加密/解密 @remones
- [improve]Slack连接器选项 @akulabs8
- [Improve][Connector-V2]为RocketMQ连接器添加可选标志，以跳过解析错误而不是失败 @xiaochen-zhou
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Tablestore.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Socket.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Milvus.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Kudu.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/IoTDB.md]系统 @duzhendi
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Phoenix.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/OpenMldb.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Maxcompute.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/GoogleSheets.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Cassandra.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/AmazonSqs.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Slack.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/CosFile.md]系统 @mickeyzzm
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/AmazonDynamoDB.md]系统 @mickeyzzm
- [Improve][Doc]更新文档中的旧链接 @thakralgarvit
- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Sentry.md]#8497 @mickeyzzm
- [improve]更新Kafka源默认模式从 content<ROW> 到 content @liunaijie
- [Improve][dist]减少Docker镜像的大小 @quicklyfast
- [Improve][Connector-v2][Paimon]派蒙目录关闭错误信息更新 @uniding
- [improve]添加StarRocks选项 @fcb-xiaobo
- [Improve]重构连接器通用选项 @liunaijie
- [improve]更新Redis连接器配置选项 @akulabs8
- [Improve][e2e]移除重复的依赖项 @wuchunfu
- [Improve][Jdbc]支持在OpenGauss中使用upsert @hailin0
- [Improve][Jdbc]改进目录连接缓存 @hailin0
- [improve]添加Elasticsearch选项 @fcb-xiaobo
- [Improve][Zeta]作业主中的类加载器拆分 @Hisoka-X
- [improve]添加断言选项 @liunaijie
- [improve]Kafka连接器选项 @wattt3
- [improve]更新S3File连接器配置选项 @litiliu
- [improve]Cassandra连接器选项 @liunaijie
- [improve]亚马逊SQS连接器更新 @liunaijie
- [improve]更新 Amazon DynamoDB 连接器 @liunaijie
- [improve]添加连接器选项类存在检查 @liunaijie
- [improve]更新Druid连接器配置选项 @akulabs8
- [Doc][Improve]翻译与Redis/派蒙相关的中文文档 @lyne7-sc
- [Feature][Connector-V2]支持多表的MaxCompute源 @Hisoka-X
- [improve]更新ActiveMQ连接器配置选项 @liunaijie
- [Feature][transform-v2]JSONPath 支持 Map 数组类型 @CosmosNi
others
- [Doc][FTP]修复FTP文档中的死链接。 @joyCurry30
- [Doc]添加 Milvus 源中文文档 @mickeyzzm
-
\[Docs\]\[S3File\]"Orc 数据类型" 应在文档中更正为 "Parquet 数据类型" \]( https://github.com/apache/seatunnel/pull/8705 " \[Docs\]\[S3File\]"Orc 数据类型" 应在文档中更正为 "Parquet 数据类型" ") @MyeoungDev
apache/seatunnel
fix
- [Fix][Connector-V2]用户选择CSV字符串模式 @corgy-w
- [Fix][mysql-cdc]在启动时修复GTID以正确从检查点恢复 @jw-itq
- [Fix][connector-http]当帖子包含参数时进行修复 @CosmosNi
improve
- [Improve][CDC]过滤心跳事件 @hailin0
- [Feature][Transforms-V2]处理大型语言模型非标准格式响应 @SplitfireUptown
- [Feature][Jdbc]支持达梦数据库的sink DDL @hawk9821
- [Feature][Core]增加槽位分配策略 @zhangshenghang
apache/seatunnel-website
improve
- [Improve][Team]添加名为张东浩的新提交者 @hawk9821
- [Improve]更新提交代码指南 @Hisoka-X