DEV Community

Cover image for The Pipeline🛠️Repos Showdown⚔️: Python 🐍 Edition

The Pipeline🛠️Repos Showdown⚔️: Python 🐍 Edition

Marine on December 11, 2023

TL;DR In the data engineering and automation ever-evolving landscape, Python has seen several worflow orchestrators emerge. In this arti...
Collapse
 
rym_michaut profile image
Rym Taipy •

Really like this one... didn't know there were that many in the Python data orchestration world.

Save it for later, thank you!

Collapse
 
aleajactaest78 profile image
AleaJactaEst •

Oh, I discovered some of them for the first time! Thanks for the list!

Collapse
 
matijasos profile image
Matija Sosic •

A good one, this series keeps getting better and better :)

Collapse
 
marisogo profile image
Marine •

Thanks for the pressure haha 😉

Collapse
 
nevodavid profile image
Nevo David Taipy •

Great list!
Thank you for posting!

Collapse
 
biplobsd profile image
Biplob Sutradhar •

👍 list

Collapse
 
fernandezbaptiste profile image
Bap •

Saved it!

Collapse
 
srbhr profile image
𝚂𝚊𝚞𝚛𝚊𝚋𝚑 𝚁𝚊𝚒 •

Python data processing and orchestration pipelines are on the rise!!

Collapse
 
mosenturm profile image
Andreas Kaiser •

Great article. But do not forget mage.ai!

Collapse
 
marisogo profile image
Marine •

Noted! Thanks Andreas

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel •

You bet me to it. I had planned to write the same 😃☺️. Just addition for ML specific pipelines

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel • • Edited

I started my pipeline journey with Airflow, then Dagster and now Kendro. I still love Dagster UI and repository linkage.

We are missing kestra which is unique due to it yaml declarations that looks like GitHub Actions

Thank you 🙏🏾 for sharing