DEV Community

Cover image for Big data models πŸ“Š vs. Computer memory πŸ’Ύ

Big data models πŸ“Š vs. Computer memory πŸ’Ύ

Marine on November 23, 2023

Data pipelines are the backbone of any data-intensive project. As datasets grow beyond memory size (β€œout-of-core”), handling them efficiently becom...
Collapse
 
matijasos profile image
Matija Sosic

Taipy is a really interesting product! So I can define an ML/Data pipeline and automatically get a GUI on top, is that the idea? Can I import an existing pipeline?

Collapse
 
srbhr profile image
πš‚πšŠπšžπš›πšŠπš‹πš‘ πšπšŠπš’

Taipy surely looks like an exciting product for pipeline orchestration. I've saved it, and will come back to it!

Collapse
 
gosselin profile image
Vincent Gosselin Taipy

Of high interest for those building pipelines with large datasets without the complexity of PySpark!