Apache DolphinScheduler September Update: Workflow Fixes, Task Stability, and Performance Boosts

Dear community, the September monthly report has finally arrived!

This month, the focus was on bug fixes and performance optimization — addressing key issues such as workflow schedule settings and HDFS storage startup, while optimizing database indexes and Quartz data source configurations to further improve performance.

A total of 11 contributors submitted multiple PRs this month, ensuring the system runs with greater stability and efficiency.

Monthly Merge Stars

We’d like to extend our gratitude to the following contributors for their outstanding work on Apache DolphinScheduler last month (in no particular order):

“@unigof,@LourierL,@ruanwenjun,@Gallardot,@Mrhs121,@shangeyao,@EricGao888,@njnu-seafish,@Zzih96,@SbloodyS,@abzymeatsjtu”

apache/dolphinscheduler

fix

• [Fix-17548] [Api]Sub WorkFlow Set Schedule Failed @shangeyao
• [Fix-17370][FOLLOWUP]Fix worker server start failed when using hdfs storage type @Mrhs121
• [Fix-17520][TaskExecutor]fix not clear task exec path when set development.state=false in common.properties @LourierL
• [Fix-17370]Fix worker server start failed when using hdfs storage type @SbloodyS
• [Fix-17413][DataSource][Hive&Spark]Principal field is not displayed and not used correctly in kerberos env @njnu-seafish
• [Fix-17477]Fix workflow can be deleted which contains failover instance @ruanwenjun
• [Fix-17473] [Task Plugin]Fix Aliyun SS task final state @EricGao888
• [Fix-17469]Fix threadLocal will not clean if exception occur in LoginHandlerInterceptor @njnu-seafish
• [Fix-17453]Fix TASK_ONLY strategy cannot work @ruanwenjun
• [Fix-17406]Fix Parameter passing feature is unavailable in SQL Task @Zzih96
• [Fix-17436][Workflow]Task timeout kill throw exception @njnu-seafish

improve

• [Improvement-17506][dao]Add index on column workflow_definition_code for table t_ds_schedules to reduce time cost when access db @unigof
• [Improvement-17485][Master]Change batchTriggerAcquisitionMaxCount default value equals to threadCount @ruanwenjun
• [Improvement-16994][TaskPlugin]support retry for every api call for serverless spark @abzymeatsjtu
• [Improvement-17467][Master]Support set a separate dataSource for quartz @ruanwenjun

others

• [Chore]fix k8s e2e @Gallardot
• [Chore]Hotfix CI error @SbloodyS
• [Chore]Prevent NPE when handling zk connection events @Mrhs121
• [Chore]Remove unused zt-zip lib @ruanwenjun
• [Chore]Try to fix ci dead link check 429 @SbloodyS
• [Chore]Optimize pom, make dolphinscheduler-spi provided @ruanwenjun
• [Doc-17490]Deployment doc improvement @SbloodyS
• [Chore][CI]Fix flaky ci @SbloodyS
• [Chore]Fix zk repo @Gallardot
• [Chore]Fix doc deadlink error @SbloodyS