Based on class notes and some readings here and there, here's a summary of differences in data engineering pipelines for streaming and batch processing
References:
https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main
Fundamentals of data engineering by Joe Reis & Matt Housley
Designing Machine Learning Systems by Chip Huyen
Top comments (0)