DEV Community

Okibaba
Okibaba

Posted on

Data Engineering Zoomcamp Week 6 - Streaming Vs Batch Pipelines

Based on class notes and some readings here and there, here's a summary of differences in data engineering pipelines for streaming and batch processing

Image description

References:
https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main
Fundamentals of data engineering by Joe Reis & Matt Housley
Designing Machine Learning Systems by Chip Huyen

Top comments (0)