DEV Community

Cover image for The Pipeline🛠️Repos Showdown⚔️: Python 🐍 Edition

The Pipeline🛠️Repos Showdown⚔️: Python 🐍 Edition

Marine on December 11, 2023

TL;DR In the data engineering and automation ever-evolving landscape, Python has seen several worflow orchestrators emerge. In this arti...
Collapse
 
rym_michaut profile image
Rym

Really like this one... didn't know there were that many in the Python data orchestration world.

Save it for later, thank you!

Collapse
 
matijasos profile image
Matija Sosic

A good one, this series keeps getting better and better :)

Collapse
 
marisogo profile image
Marine

Thanks for the pressure haha 😉

Collapse
 
nevodavid profile image
Nevo David

Great list!
Thank you for posting!

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel

You bet me to it. I had planned to write the same 😃☺️. Just addition for ML specific pipelines

Collapse
 
mosenturm profile image
Andreas Kaiser

Great article. But do not forget mage.ai!

Collapse
 
marisogo profile image
Marine

Noted! Thanks Andreas

Collapse
 
fernandezbaptiste profile image
Bap

Saved it!

Collapse
 
biplobsd profile image
Biplob Sutradhar

👍 list

Collapse
 
srbhr profile image
Saurabh Rai

Python data processing and orchestration pipelines are on the rise!!

Collapse
 
aleajactaest78 profile image
AleaJactaEst

Oh, I discovered some of them for the first time! Thanks for the list!

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel • Edited

I started my pipeline journey with Airflow, then Dagster and now Kendro. I still love Dagster UI and repository linkage.

We are missing kestra which is unique due to it yaml declarations that looks like GitHub Actions

Thank you 🙏🏾 for sharing