DEV Community

Cover image for The Pipeline๐Ÿ› ๏ธRepos Showdownโš”๏ธ: Python ๐Ÿ Edition

The Pipeline๐Ÿ› ๏ธRepos Showdownโš”๏ธ: Python ๐Ÿ Edition

Marine on December 11, 2023

TL;DR In the data engineering and automation ever-evolving landscape, Python has seen several worflow orchestrators emerge. In this arti...
Collapse
 
rym_michaut profile image
Rym Taipy

Really like this one... didn't know there were that many in the Python data orchestration world.

Save it for later, thank you!

Collapse
 
aleajactaest78 profile image
AleaJactaEst

Oh, I discovered some of them for the first time! Thanks for the list!

Collapse
 
matijasos profile image
Matija Sosic

A good one, this series keeps getting better and better :)

Collapse
 
marisogo profile image
Marine

Thanks for the pressure haha ๐Ÿ˜‰

Collapse
 
nevodavid profile image
Nevo David Taipy

Great list!
Thank you for posting!

Collapse
 
biplobsd profile image
Biplob Sutradhar

๐Ÿ‘ list

Collapse
 
fernandezbaptiste profile image
Bap

Saved it!

Collapse
 
srbhr profile image
๐š‚๐šŠ๐šž๐š›๐šŠ๐š‹๐š‘ ๐š๐šŠ๐š’

Python data processing and orchestration pipelines are on the rise!!

Collapse
 
mosenturm profile image
Andreas Kaiser

Great article. But do not forget mage.ai!

Collapse
 
marisogo profile image
Marine

Noted! Thanks Andreas

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel

You bet me to it. I had planned to write the same ๐Ÿ˜ƒโ˜บ๏ธ. Just addition for ML specific pipelines

Collapse
 
proteusiq profile image
Prayson Wilfred Daniel • Edited

I started my pipeline journey with Airflow, then Dagster and now Kendro. I still love Dagster UI and repository linkage.

We are missing kestra which is unique due to it yaml declarations that looks like GitHub Actions

Thank you ๐Ÿ™๐Ÿพ for sharing