October Recap | Apache SeaTunnel Community Updates and Progress

Hello, Community! Here’s the October monthly report from our community—enjoy the updates!

This monthly update captures the latest developments and progress from the Apache SeaTunnel community. Stay tuned for more!

SeaTunnel Monthly Merge Stars

Thanks to the following contributors for their outstanding contributions to Apache SeaTunnel last month (in no particular order):

“@arshadmohammad,@YOMO-Lee,@prclin,@chl-wxp,@Hisoka-X,@shashwatsai,@wuchunfu,@hailin0,@XenosK,@Asura7969,@dependabot[bot],@JohnTeslaa,@xxsc0529,@lm-ylj,@happyboy1024,@corgy-w,@hawk9821,@BilwaST,@dailai,@czshh0628,@luckyLJY,@liunaijie,@JeremyXin,@jiamin13579,@QiaoJ-Chen,@zhilinli123,@nianliuu,@TyrantLucifer,@CosmosNi,@liugddx,@zhangshenghang”

apache/seatunnel

fix

• [Fix][Connector-V2]Fix cdc use default value when value is null @Hisoka-X
• [Bug][Core]Local mode cancel running JobStatusRunner @zhangshenghang
• [Fix][Connector-V2]Fix file binary format sync convert directory to file @zhangshenghang
• [Fix][CI]Fix CI error caused by set classloader-cache-mode to true @Hisoka-X
• [Fix][Connector-V2]Fixed clickhouse connectors cannot stop under multiple parallelism @YOMO-Lee
• [Hotfix][CDC]Fix occasional database connection leak when read snapshot split @hailin0
• [Fix][Connector-V2]Fix hana type loss of precision @Hisoka-X
• [Fix] [Flink/Spark]Fix flink/spark transform stream choose wrong when not configure source_table_name @CosmosNi
• [Fix][Doc]Correct hive-jdbc config useKerberos to use_kerberos @czshh0628
• [Hotfix][Config]Fix configuration key sort disorder @hailin0
• [Fix][Doc]Fix jetty doc error @zhangshenghang
• [Fix][Doc]Fix zh doc build error @Hisoka-X
• [Fix][connector-v2]Fix Paimon table connector Error log information. @luckyLJY
• [Fix][Connector-V2][connector-file-base-hadoop]Fixed HdfsFile source load the krb5_path configuration @JeremyXin
• [Fix][Connector-V2][FTP]Fix FTP connector connection_mode is not effective @zhangshenghang
• [Fix][Zeta]Fix worker node metrics acquisition @corgy-w
• [Fix][Connector-V2]Fix kafka format_error_handle_way not work @Hisoka-X
• [Fix][Connector-V2]Oceanbase vector database is added as the source server @xxsc0529
• [Bug] [connectors-v2]The Hadoop Source/Sink fails with Unable to find valid Kerberos Ticket. @shashwatsai
• [bugfix][core]Fix the problem of incorrect association between metrics and nodes @liugddx
• [Fix][Connector-V2]Fix When reading Excel data, string and date type conversion errors @CosmosNi
• [Hotfix][Zeta]Fix hazelcast client should overwrite cluster address by system env @liunaijie
• [Fix][Connector-V2]Fix AbstractSingleSplitReader lock useless when do checkpoint @CosmosNi
• [Hotfix][Core][Flink]SeaTunnel flink engine support application mode on yarn @TyrantLucifer

improve

• [Improve][Doc]Fix chinese doc miss grafana dashborad config @corgy-w
• [Improve]update clickhouse connector, use factory to create source/sink @liunaijie
• [Improve][Doc]Add some connector icons @zhangshenghang
• [Improve][Zeta]Make the default value of classloader-cache-mode is true @dailai
• [Improve][Iceberg]Support table comment for catalog @hailin0
• [Feature][Zeta]Add COS support for checkpoint storage @lm-ylj
• [Improve][Doc]Add file_filter_pattern example to doc @YOMO-Lee
• [Improve][RestApi]Unify the code logic of REST API V1 and V2 @liugddx
• [Improve][Rest api]add verifyHtmlResponse test case @liugddx
• [Improve][Connector-V2]Improve jdbc merge table from path and query when type is decimal @Hisoka-X
• [Improve][Connector-V2][FTP]delete duplicated code @zhangshenghang
• [Improve][Core]Add protobuf transform test case @zhangshenghang
• [Improve][Core]Refactor common options of column/row @Hisoka-X
• [Improve][Zeta]Jetty server enable dynamic port @corgy-w
• [Feature][Doris]Support multi-table source read @happyboy1024
• [Improve][Connector-V2]Redis support custom key and value @lm-ylj
• [Feature] [connector-milvus]update milvus connector to support dynamic schema, failed retry, etc. @nianliuu
• [Feature][Transform-SQL]Support sql transform to generate UUID @zhilinli123
• [Improve][E2E]modify the method of obtaining JobId @hawk9821
• [Feature][Connector-V2]Jdbc DB2 support upsert SQL @shashwatsai
• [Improve][Example]Improve zeta local/cluster example @hailin0
• [Improve][Example]Add log config for job mdc @hailin0
• [Improve][Jdbc]Optimize index name conflicts when create table for postgresql @hailin0
• [Improve][Doc]Correcting typo errors in logging @Hisoka-X
• [Improve]Move AlterTableNameEvent parent @hailin0
• [Improve]Update snapshot version to 2.3.9 @liunaijie
• [Improve][Connector-V2]Add doris/starrocks create table with comment @Hisoka-X
• [Feature][Connector-V2]Support write cdc changelog event into hudi sink @happyboy1024
• [Improve]Update snapshot version to 2.3.9 @liunaijie
• [Improve][Formats]Support not primary-key table for debezium format @hailin0
• [Improve][Connector-v2]Use checkpointId as the commit's identifier instead of the hash for streaming write of paimon sink @dailai
• [Feature][Connector-V2]Piamon Sink supports changelog-procuder is lookup and full-compaction mode @hawk9821
• [Improve][Sls]Add sls sink connector、e2e、doc @XenosK
• [Improve][Connector-V2]Change File Read/WriteStrategy setSeaTunnelRowTypeInfo to setCatalogTable @Hisoka-X
• [Improve][Doc]Updated telemetry doc @corgy-w
• [Improve][api]Improve inheritance relationship of AlterTableColumnEvent @hailin0
• [Feature][Connector-V2]Sftp file source support multiple table @chl-wxp
• [Improve][Fake]Improve memory usage when split size is large @hailin0
• [Improve][Jdbc]Support postgresql inet type. @CosmosNi
• [Feature][Zeta][Core]Support api get logs @zhangshenghang
• [Improve][Docs]Edit the description about startup.mode for Opengauss-CDC @dailai
• [Improve][Jdbc]Support save mode for the sink of jdbc-dm @dailai
• [Improve][PostgreSQL CDC]-PostgresSourceOptions description error @Asura7969
• [Improve][rest api]improve rest-api doc @liugddx
• [Improve][Doc]Correction to docker doc for get container ip @Hisoka-X
• [Improve][RestApi]Update context-path to / as default path @liugddx
• [Feature][Connector-V2]Ftp file source support multiple table @chl-wxp
• [Improve][Api]Supports simultaneous config of conditions and optional options @corgy-w
• [Feature][Restapi]Allow metrics information to be associated to logical plan nodes @liugddx
• [Improve][Transform]Add LLM model provider microsoft @corgy-w
• [Improve][doc]Improve startrocks source doc @jiamin13579
• [Feature][transforms-v2]Support append only stream from cdc source @hawk9821
• [Feature][Zeta]Submit job scheduling support pending @zhangshenghang
• [Feature][Rest api]Use jetty to replace Hazelcast native rest api @liugddx
• [Feature][connector-v2]Support opengauss jdbc connnector using opengauss driver. @luckyLJY
• [Feature][Engine UI]partial pages of the engine @QiaoJ-Chen
• [Feature][Connector-V2]Add prometheus source and sink @CosmosNi

others

• Bump commons-io:commons-io from 2.11.0 to 2.14.0 in /seatunnel-connectors-v2/connector-clickhouse @dependabot[bot]
• [Improvment][Build]Provide option to disable source jar creation. @arshadmohammad

apache/seatunnel-website

improve

• [Improve][Team]Add new committer named Mohammad Arshad @arshadmohammad
• [Improve]Update sitemap to improve search result @Hisoka-X
• [Improve][Team]Add new committer named Lai Dai @dailai
• [Improve]Add matomo integration for website analytics @Hisoka-X

others

• Seatunnel-Web 1.0.2 Release Update @arshadmohammad
• update release process document @liunaijie
• Update deployment.md @prclin
• Add release docs 2.3.8 @liunaijie

apache/seatunnel-web

fix

• [Bug] [Seatunnel-web]Tasks pagination is not working @BilwaST
• [Bug][Seatunnel-web][Addendum]Escape seatunnel-web placeholders @arshadmohammad
• [Bug][Seatunnel-web]download_datasource.sh fails due to missing mvnw command @arshadmohammad
• [Bug][Seatunnel-web]Escape seatunnel-web placeholders @arshadmohammad
• [Bug] [Seatunnel-web]HiveJDBC should not be used as a sink datasource @arshadmohammad
• [Bug][Seatunnel-web][Hive]Filter system databases @arshadmohammad
• [Bug] [Seatunnel-web] [HiveJDBC]Duplicate columns are displayed in source @arshadmohammad

improve

• [Improve][Doc]Add compatibility in doc @Hisoka-X
• [Improve]use generate_sink_sql=true for db2 upsert @shashwatsai
• [Improvement] [Seatunnel-web]Add support to provide reason for job f… @BilwaST
• [Improvement][Seatunnel-web]Document Placeholder feature @arshadmohammad
• [Improve][SeaTunnel-Web]Update README_CN.md for version 2.3.8 @wuchunfu
• [Improvement][Seatunnel-web]Bump seatunnel version from 2.3.7 to 2.3.8 @arshadmohammad

others

• [Build]Update snapshot version to 1.0.3 @arshadmohammad
• [Doc]init deploy readme optimize @JohnTeslaa