apache seatunnel 2.3.12 Changelog

Docs

$Doc\] Added deepwiki to README.md [#9354](https://github.com/apache/seatunnel/issues/9354 "#9354") ([#9356](https://github.com/apache/seatunnel/pull/9356 "#9356"))$
$Doc\]\[Improve\] update projection supported in Paimon ([#9425](https://github.com/apache/seatunnel/pull/9425 "#9425"))$
$doc\]The link in the document is 404 ([#9561](https://github.com/apache/seatunnel/pull/9561 "#9561"))$
$Docs\]\[Connector-Iceberg\] Update Iceberg doc with support S3 Tables rest catalogs ([#9686](https://github.com/apache/seatunnel/pull/9686 "#9686"))$
$Fix\]\[Doc\] Fix transform-v2 TableFilter title ([#9528](https://github.com/apache/seatunnel/pull/9528 "#9528"))$
$Fix\]\[Doc\] Update StarRocks doc change schema necessity to true ([#9656](https://github.com/apache/seatunnel/pull/9656 "#9656"))$
$Improve\]\[Doc\] Add multimodal support description to docs ([#9652](https://github.com/apache/seatunnel/pull/9652 "#9652"))$
$Improve\]\[Doc\] Fix formatting of parameter types ([#9753](https://github.com/apache/seatunnel/pull/9753 "#9753"))$

Bug Fix

$Bug\] \[Connector-V2\] Fix the issue of writing the ORC format Iceberg report "Illegal provider-class name" ([#6754](https://github.com/apache/seatunnel/issues/6754 "#6754")) ([#9588](https://github.com/apache/seatunnel/pull/9588 "#9588"))$
$Bug\] \[seatunnel-connector-http-base\] An NPE (NullPointerException) will occur when the pageField is null ([#9498](https://github.com/apache/seatunnel/pull/9498 "#9498"))$
$Bug\]\[Connector-V2\] fix NPE when decimal type precision is incompatible for Paimon ([#9452](https://github.com/apache/seatunnel/pull/9452 "#9452"))$
$bug\]\[dist\]fix the release packaging exception ([#9436](https://github.com/apache/seatunnel/pull/9436 "#9436"))$
$Fix\] \[connector-jdbc\] prevent precision loss in Float to BigDecimal conversion ([#9670](https://github.com/apache/seatunnel/pull/9670 "#9670"))$
$Fix\]\[CI\] Update iris docker version to fix ci ([#9360](https://github.com/apache/seatunnel/pull/9360 "#9360"))$
$Fix\]\[Connector-clickhouse\] Fix SeaTunnelRow tableId set error ([#9585](https://github.com/apache/seatunnel/pull/9585 "#9585"))$
$Fix\]\[Connector-HTTP\] Add default content-type when user not set ([#9497](https://github.com/apache/seatunnel/pull/9497 "#9497"))$
$Fix\]\[connector-http\] fix parsing httpjson, the number of two fields is inconsistent with the import failure ([#9103](https://github.com/apache/seatunnel/pull/9103 "#9103"))$
$Fix\]\[Connector-Jdbc\] Supports reading and writing Postgres network dress types ([#9618](https://github.com/apache/seatunnel/pull/9618 "#9618"))$
$Fix\]\[connector-rabbitmq\] Set default value for durable, exclusive and auto-delete ([#9631](https://github.com/apache/seatunnel/pull/9631 "#9631"))$
$Fix\]\[Connector-V2\] ArrowToSeatunnelRowReader convertSeatunnelRowValue add handle Second TIMESTAMP type ([#9393](https://github.com/apache/seatunnel/pull/9393 "#9393"))$
$Fix\]\[Connector-V2\] Fix misleading parameter name in DorisStreamLoad ([#9685](https://github.com/apache/seatunnel/pull/9685 "#9685"))$
$Fix\]\[Connector-V2\] Fix prometheus check time can not parse double value ([#9311](https://github.com/apache/seatunnel/pull/9311 "#9311"))$
$Fix\]\[Connector-V2\] Optimize Paimon DECIMAL type check to prevent precision loss ([#9480](https://github.com/apache/seatunnel/pull/9480 "#9480"))$
$Fix\]\[Connector-V2\] Oracle cdc not update transaction commit when LOB enabled ([#9412](https://github.com/apache/seatunnel/pull/9412 "#9412"))$
$Fix\]\[Connector-V2\] Update catalog table schema of debezium json ([#9525](https://github.com/apache/seatunnel/pull/9525 "#9525"))$
$Fix\]\[Connector-V2\] Update waitCompaction value for batch mode and writeonly ([#9479](https://github.com/apache/seatunnel/pull/9479 "#9479"))$
$Fix\]\[Connectors-v2\] fix dynamic bucket for paimon sink ([#9595](https://github.com/apache/seatunnel/pull/9595 "#9595"))$
$Fix\]\[Core\]fix kotlin jar conflict ([#9683](https://github.com/apache/seatunnel/pull/9683 "#9683"))$
$Fix\]\[engine-server\] Fix the issue of garbled characters in log output ([#9594](https://github.com/apache/seatunnel/pull/9594 "#9594"))$
$Fix\]\[paimon-e2e\] e2e test error ([#9467](https://github.com/apache/seatunnel/pull/9467 "#9467"))$
$Fix\]\[seatunnel-dist\]fix duplicate dependency ([#9458](https://github.com/apache/seatunnel/pull/9458 "#9458"))$
$Fix\]\[Transform-V2\] correct handling of 'T' in date format strings ([#9406](https://github.com/apache/seatunnel/pull/9406 "#9406"))$
$Fix\]\[Transform-V2\] Reduce embedding precision from double to float ([#9635](https://github.com/apache/seatunnel/pull/9635 "#9635"))$
$Fix\]\[Zeta\] Avoid redundant checkpoint reads when disabled checkpoint ([#9552](https://github.com/apache/seatunnel/pull/9552 "#9552"))$
$Fix\]\[Zeta\] Enhance job state display by including pending jobs in status retrieval ([#9489](https://github.com/apache/seatunnel/pull/9489 "#9489"))$
$Fix\]\[Zeta\] Fix local mode can not finish ([#9549](https://github.com/apache/seatunnel/pull/9549 "#9549"))$
$Fix\]\[Zeta\] Use dynamic port allocation for HTTP in `RestApiHttpsForTruststoreTest` and update Prometheus image ([#9792](https://github.com/apache/seatunnel/pull/9792 "#9792"))$
$Fix\]\[Core\] Fix the placeholders cannot pass parameters when using complex config ([#9800](https://github.com/apache/seatunnel/pull/9800 "#9800"))$
$HotFix\]\[CI\] The Some CI subtasks are not executed ([#9684](https://github.com/apache/seatunnel/pull/9684 "#9684"))$
$Hotfix\]\[Transform-V2\] Fix some model return number of dimensions ([#9644](https://github.com/apache/seatunnel/pull/9644 "#9644"))$

Feature

$Chore\] fix typos filed -\> field ([#9757](https://github.com/apache/seatunnel/pull/9757 "#9757"))$
$Feature\] \[connector-file\] Add configurable sheet_max_rows support for Excel sink connector ([#9668](https://github.com/apache/seatunnel/pull/9668 "#9668"))$
$Feature\]\[Connector-Clickhouse\] Support Clickhouse multi table source read ([#9704](https://github.com/apache/seatunnel/pull/9704 "#9704"))$
$Feature\]\[connector-hive\] hive sink connector support overwrite mode [#7843](https://github.com/apache/seatunnel/issues/7843 "#7843") ([#7891](https://github.com/apache/seatunnel/pull/7891 "#7891"))$
$Feature\]\[connector-paimon\] Paimon connector supports paimon privilege ([#9722](https://github.com/apache/seatunnel/pull/9722 "#9722"))$
$Feature\]\[connector-v2\] Add Sensorsdata Connector Support [#9323](https://github.com/apache/seatunnel/issues/9323 "#9323") ([#9432](https://github.com/apache/seatunnel/pull/9432 "#9432"))$
$Feature\]\[Connector-V2\] Support databend source/sink connector ([#9331](https://github.com/apache/seatunnel/pull/9331 "#9331"))$
$Feature\]\[Connector-v2\] Support multi paimon source ([#9759](https://github.com/apache/seatunnel/pull/9759 "#9759"))$
$Feature\]\[Connectors-v2\] Optimize the size of CDC JAR Files ([#9546](https://github.com/apache/seatunnel/pull/9546 "#9546"))$
$feature\]\[connectors-v2\] Support in predicate pushdown in paimon ([#9379](https://github.com/apache/seatunnel/pull/9379 "#9379"))$
$Feature\]\[Connectors-V2\]\[Elasticsearch\] Support vector transformation sink ([#9330](https://github.com/apache/seatunnel/pull/9330 "#9330"))$
$Feature\]\[Core\] Add plugin directory support for each connector ([#9650](https://github.com/apache/seatunnel/pull/9650 "#9650"))$
$Feature\]\[elasticsearch-connector\] Add API key authentication support ([#9610](https://github.com/apache/seatunnel/pull/9610 "#9610"))$
$Feature\]\[Jdbc\] Support read multiple tables by regular expressions ([#9380](https://github.com/apache/seatunnel/pull/9380 "#9380"))$
$Feature\]\[Redis\] Add redis key into the result record ([#9574](https://github.com/apache/seatunnel/pull/9574 "#9574"))$
$Feature\]\[SQL function\] Enhance SQL Transform COALESCE functions to support type cast ([#9299](https://github.com/apache/seatunnel/pull/9299 "#9299"))$
$Feature\]\[Transform-V2\] Add `TRIM_SCALE` function for sql transform ([#9700](https://github.com/apache/seatunnel/pull/9700 "#9700"))$
$Feature\]\[transform-v2\] sql transform support multi_if function ([#9154](https://github.com/apache/seatunnel/pull/9154 "#9154"))$
$Feature\]\[Transform-V2\] Support vector series sql function ([#9765](https://github.com/apache/seatunnel/pull/9765 "#9765"))$
$Feature\]\[Transform\] Support single/batch mode vectorization using Amazon Titan \& cohere embedding model ([#9120](https://github.com/apache/seatunnel/pull/9120 "#9120"))$
$Feature\]\[Transform V2\] Add vector dimension reduction transform ([#9783](https://github.com/apache/seatunnel/pull/9783 "#9783"))$
$Feature\]\[Zeta\] Add startTime to the job info ([#9400](https://github.com/apache/seatunnel/pull/9400 "#9400"))$
$Feature\]\[Zeta\] Support SQL format in REST API ([#9802](https://github.com/apache/seatunnel/pull/9802 "#9802"))$
$Improve\] JdbcInputFormat nextRecord Exception throw TableId ([#9374](https://github.com/apache/seatunnel/pull/9374 "#9374"))$
$improve\] rocketmq options ([#9251](https://github.com/apache/seatunnel/pull/9251 "#9251"))$
$improve\] socket options ([#9517](https://github.com/apache/seatunnel/pull/9517 "#9517"))$
$improve\] tdengine options ([#9399](https://github.com/apache/seatunnel/pull/9399 "#9399"))$
$Improve\]\[API\] Add metadata schema into catalog table ([#9586](https://github.com/apache/seatunnel/pull/9586 "#9586"))$
$Improve\]\[CI\] Disable close stable issue and JdbcVerticaIT ([#9742](https://github.com/apache/seatunnel/pull/9742 "#9742"))$
$Improve\]\[connector-clickhouse\] Clickhouse support parallelism reading schema ([#9446](https://github.com/apache/seatunnel/pull/9446 "#9446"))$
$Improve\]\[Connector-Hudi\] Add pre-combine field option for hudi sink ([#9496](https://github.com/apache/seatunnel/pull/9496 "#9496"))$
$Improve\]\[Connector-milvus\]update milvus-sdk-java to 2.5.11 ([#9710](https://github.com/apache/seatunnel/pull/9710 "#9710"))$
$Improve\]\[Connector-V2\] Add customizable row delimiter support for text file processing ([#9608](https://github.com/apache/seatunnel/pull/9608 "#9608"))$
$improve\]\[Connector-V2\] delete jdbc param support_upsert_by_query_primary_key_exist ([#9408](https://github.com/apache/seatunnel/pull/9408 "#9408"))$
$Improve\]\[Connector-V2\] Replace deprecated createDownloadSession by buildDownloadSession ([#9555](https://github.com/apache/seatunnel/pull/9555 "#9555"))$
$Improve\]\[Connector-V2\] Support maxcompute sink writer upsert/delete action with upsert session mode ([#9462](https://github.com/apache/seatunnel/pull/9462 "#9462"))$
$Improve\]\[Connector-V2\] Use key_field_name option when reading Redis hash data ([#9642](https://github.com/apache/seatunnel/pull/9642 "#9642"))$
$Improve\]\[Core\] Unify the aws-sdk-v2 version to 2.31.30 ([#9698](https://github.com/apache/seatunnel/pull/9698 "#9698"))$
$Improve\]\[Csv\] support configurable CSV delimiter in file connector ([#9660](https://github.com/apache/seatunnel/pull/9660 "#9660"))$
$Improve\]\[E2E\] Optimize iceberg E2E Cases ([#9769](https://github.com/apache/seatunnel/pull/9769 "#9769"))$
$Improve\]\[Transform-V2\] Improve sql transform exception to locate error expression ([#9227](https://github.com/apache/seatunnel/pull/9227 "#9227"))$
$Improve\]\[Transform-V2\] SQL transform EXTRACT function support more fields ([#9342](https://github.com/apache/seatunnel/pull/9342 "#9342"))$
$Improve\]\[Zeta\] Add verification for Env options ([#9569](https://github.com/apache/seatunnel/pull/9569 "#9569"))$
$Improve\]\[Zeta\] Make sure the pending job schedule always works ([#9532](https://github.com/apache/seatunnel/pull/9532 "#9532"))$
$Improve\]\[Zeta\] Remove distributed lock when store metrics imap ([#9776](https://github.com/apache/seatunnel/pull/9776 "#9776"))$
$improve\]improve FE node failover logging for better observability ([#9657](https://github.com/apache/seatunnel/pull/9657 "#9657"))$