Digdag Workflow engine link collection.

Official pages

• Digdag in 5 minutes
• Official site SIMPLE, OPEN SOURCE, MULTI-CLOUD WORKFLOW ENGINE
• Documentation
• GitHub

Third party operators.

• digdag-slack
• retz-digdag-plugin
• digdag-plugin-ssh
• digdag-hangouts-chat
• digdag-plugin-mysql
• digdag-plugin-dfs_wait
• k8s_job
• digdag-operator-emr_fleet
• digdag-operator-athena
• digdag-plugin-shresult (Blog(Use Google translate))
• digdag-operator-cost_explorer
• digdag-operator-param
• digdag-operator-ecs_task
• digdag-plugin-azure
• digdag-plugin-mssql
• digdag-operator-livy
• digdag-plugin-sshresult
• digdag-plugin-s3-touch
• digdag-plugin-datadog
• digdag-plugin-glue
• digdag-operator-pg_lock It enables control _parallel size, locks a specific resource and avoids duplicate execution. Blog
• digdag-plugin-myjdbc Use custom JDBC(ex. PureData) library operator.
• digdag-operator-gke gke> operator for the Google Kubernetes Engine.
• digdag-operator-store_gke_config An operator for store a GKE configuration.
• digdag-operator-bq-wait
• digdag-plugin-glue
• digdag-operator-aws-appconfig Digdag operator to store parameter from AWS AppConfig
• digdag-plugin-sentry A Digdag plugin for sending errors to Sentry
• digdag_operator_snowflake Digdag snow> operator plugin to execute a query Snowflake.

Extensions

• digdag-basic-auth-mt Multi tenant basic-auth plugin for Digdag

Tools

• digdag-worker-crd A horizontal pod autoscaler for digdag worker

Third party digdag client

• mog Go
• digdag_client Ruby
• tdworkflow Python

Presentations

Date	Title	Event
2016/11/29	Automating Workflows for Analytics Pipelines(Sadayuki Furuhashi)(📊🎥)	AWS re:Invent 2016
2017/06/01	Automating Workflows for Analytics Pipelines(Sadayuki Furuhashi)📊	Open Source Summit

Blogs

• Scott Arbeitman @ Medium

  • In Praise of Digdag, an Alternative to Airflow

• Thejesh GN

  • 2019-11-15 Managing Secrets in Digdag
  • 2019-10-30 Seven Useful DigDag Tips and Tricks
  • 2019-10-15 How to use DigDag Restful APIs to Trigger a Job
  • 2019-12-03 How to Use Docker to run Workflows in Digdag

• Democratizing Data

  • 2019-10-06 How to test a new Docker image for digdag workflow on CircleCI?
  • 2020-02-05 py> operator development guide for Python users

• dev.to

  • Shubham Kadam
    • 2020-02-15 DigDag - Schedule a Job(workflow) multiple times on same day