Hello to all the Apache SeaTunnel enthusiasts! The April edition of the monthly report is here, documenting the key updates from the SeaTunnel community. Stay tuned and keep up with the latest project developments!
Among this month's many updates, the most notable new feature is support for TDengine's multi-table sink functionality, contributed by @jia17. This marks a significant step forward in SeaTunnel’s capabilities for writing data to time-series databases.
In industrial IoT, smart energy, intelligent manufacturing, and other scenarios, sensor data is often distributed across multiple logical tables. The previous single-table sink model clearly fell short of meeting the complex requirements for data persistence in such cases. This update introduces dynamic multi-table writing support for TDengine, enabling users to flexibly route data to different target tables based on business logic. This greatly improves both the flexibility and efficiency of data ingestion.
More importantly, the feature design thoughtfully handles schema parsing, field matching, and exception handling, demonstrating strong engineering practicality. It also lays a solid foundation for extending multi-table write support to more connectors in the future.
SeaTunnel continues to strengthen its integration capabilities with mainstream data systems. This update is a powerful response to real-world business needs.
SeaTunnel Monthly Merge Stars
Thanks to the following contributors for their outstanding contributions to Apache SeaTunnel last month (in no particular order):
“@hawk9821,@eyys,@liunaijie,@corgy-w,@CosmosNi,@FrommyMind,@maozhen520,@Hisoka-X,@litiliu,@JeremyXin,@Alberne,@rbowen,@mrtisttt,@RongHaa,@misi1987107,@kehan-zhou,@ocean-zhc,@qifanlili,@jia17,@xxsc0529,@hailin0”
apache/seatunnel
fix
- [Bugfix][CI]Fix transform check @hailin0
- [Fix][CI]Release file resources in testcase @CosmosNi
- [Fix][Config]Fix invalid telemetry-log config in seatunnel.yaml @mrtisttt
- [Fix][Zeta]Fix premature closure of the checkpoint thread pool causes abnormal task status @Hisoka-X
-
[Fix][Core]Fix config parse with
\"\"
error @Hisoka-X - [Bugifx][kafka]Fix kafka enumerator assign split NPE @hailin0
- [Fix][Doc]Delete space before _test and _sink @kehan-zhou
- [Fix][Connector-V2]Fix kafka database name @corgy-w
- [Fix][Zeta]Fix double-checked locking without volatile in HdfsStorage @maozhen520
- [Fix][Serialize]prevent scientific notation for decimal numbers in JSON output @misi1987107
- [Fix][CI]Upgrade action job runner host version @Hisoka-X
- [Fix][Doc]Adjust the description of the explode function @CosmosNi
- [Fix][Connector-V2]Fix NullPointerException when column or tag contains null value in TDengine sink @jia17
- [Fix][connector-file-base]fix parquet int32 convert error @JeremyXin
- [Fix][Connector-V2]Fixed missing timestamp accuracy of starrocks connector @corgy-w
- [Fix][Zeta]Adjust the timing of invoking the enumerator open method @Hisoka-X
- [Fix][Connector-V2]Fix maxcompute write with multi parallelism @Hisoka-X
- [Fix][Connector-V2][OceanBase]oceanbase vector support simple vector index @xxsc0529
-
[Fix][API]Fixed not invoke the
SinkAggregatedCommitter
's init method @Hisoka-X - [Bugfix][Elasticsearch]Fix add column event @hailin0
- [Bugfix][Csv]Fix csv format delimiter @hailin0
- [Fix][Connector-V2]Fix postgres cdc with debezium_json format can not parse number without scale @FrommyMind
-
[Fix]Fix
DateUtils
can not parse datetime string with local timezone @Hisoka-X - [Fix][Connector-V2]Fix SqlServer create table when database with dot @Hisoka-X
- [Fix][MongoDB]The Long type cannot handle string values in scientific notation @qifanlili
improve
- [improve]qdrant options @liunaijie
- [Feature][Connector-V2]Make some sink parameters optional for DataHub @jia17
- [Improve][connector-iceberg]fix schema change event @CosmosNi
- [Feature][Connector-V2]Support multi-table sink feature for TDengine @jia17
- [Feature][Connector-V2]Datahub support multi-table sink @jia17
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Cloudberry.md] @jia17
- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Github.md] @jia17
- [Improve][Zeta]Add log to print the each task execute location @CosmosNi
- [Feature][Transform]Add table filter transform @hailin0
- [Feature][doc]Repair md document format @CosmosNi
- [Feature][Zeta]Support basic authentication for web ui @CosmosNi
- [improve]paimon options @liunaijie
- [improve]openmldb options @liunaijie
- [improve]milvus options @liunaijie
- [improve]neo4j options @liunaijie
- [Improve]maxcompute options @liunaijie
- [Improve]kudu options @liunaijie
- [Improve][Doc]Unify the header format and fix some documents with abnormal formats @Hisoka-X
- [Feature][connector-elasticsearch]elasticsearch source support PIT @CosmosNi
- [Feature][Zeta]Format exception messages on task running management page @ocean-zhc
- [Improve][Doc]Adjust description of trim series sql function @Hisoka-X
- [Improve][Connector-V2][Http]Supports Cursor-based Pagination (#9109) @Alberne
- [Feature][Transform]support boolean type for sql transform @hawk9821
- [Feature][Checkpoint]Add check script for source/sink state class serialVersionUID missing @CosmosNi
- [Feature][Transform]Support define sink column type @hailin0
- [Improve][connector-doris]Improved doris source enumerator splits allocation algorithm for subtasks @JeremyXin
- [Improve][seatunnel-engine-ui]improve sorting of Running Jobs and Finished Jobs @ocean-zhc
- [Improve][Transform]Update MetadataTransformConfig extends @hailin0
- [Improve][Zeta]Support restore execute savemode @hailin0
- [improve]update file connectors config @misi1987107
- [Improve][Doc]Update kerberos part of kafka doc @Hisoka-X
- [Improve][Transform-V2]support try_cast expressions @corgy-w
- [Feature][Connector-V2]Support GraphQL Connector (#8557) @eyys
- [Improve][Connector-V2]Optimize dialect selection in jdbc @corgy-w
others
- [Doc][zh-CN]Add Jira connector Chinese documentation @RongHaa
- [Feat][Connector-v2][Iceberg]support filter conditions in iceberg source @litiliu
- [Chore]Upgrade actions/cache@v2 to actions/cache@v4 @hailin0 # apache/seatunnel-website
Top comments (0)