Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
Nelson Sammy
Nelson Sammy
Nelson Sammy
Follow
Mar 10 '25
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
#
dataengineering
#
ai
#
kafka
5
 reactions
Comments
Add Comment
5 min read
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
Eric Katumo
Eric Katumo
Eric Katumo
Follow
for
LuxDevHQ
Mar 10 '25
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
#
dataengineering
#
datascience
#
data
6
 reactions
Comments
Add Comment
4 min read
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
Milcah03
Milcah03
Milcah03
Follow
Mar 10 '25
The Ultimate Guide to Apache Kafka: Basics, Architecture, and Core Concepts
#
dataengineering
#
apachekafka
#
python
#
programming
5
 reactions
Comments
Add Comment
4 min read
Streamline data transfer: The ultimate data integration guide SFTP to BigQuery
Mage AI
Mage AI
Mage AI
Follow
Mar 7 '25
Streamline data transfer: The ultimate data integration guide SFTP to BigQuery
#
dataengineering
#
dataintegration
#
bigquery
#
mageai
2
 reactions
Comments
Add Comment
6 min read
Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7
Judith-Data-Processing-Hacks
Judith-Data-Processing-Hacks
Judith-Data-Processing-Hacks
Follow
Mar 5 '25
Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7
#
sql
#
dataengineering
#
opensource
#
esprocspl
7
 reactions
Comments
1
 comment
2 min read
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4 '25
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
#
dataengineering
#
dezoomcamp
#
batchprocessing
#
spark
1
 reaction
Comments
Add Comment
6 min read
Amazon EMR (Elastic MapReduce) Cheat Sheet
Data Tech Bridge
Data Tech Bridge
Data Tech Bridge
Follow
Mar 1 '25
Amazon EMR (Elastic MapReduce) Cheat Sheet
#
aws
#
cloudcomputing
#
dataengineering
Comments
1
 comment
11 min read
Introdução à Engenharia de Dados
Cadu MagalhĂŁes
Cadu MagalhĂŁes
Cadu MagalhĂŁes
Follow
Feb 25 '25
Introdução à Engenharia de Dados
#
braziliandevs
#
dataengineering
10
 reactions
Comments
Add Comment
6 min read
Streaming SQL in Stateful DataFlows
Deb
Deb
Deb
Follow
Feb 22 '25
Streaming SQL in Stateful DataFlows
#
sql
#
rust
#
distributedsystems
#
dataengineering
32
 reactions
Comments
Add Comment
2 min read
Complement a certain average value to ensure that the total sum remains unchanged — From SQL to SPL #3
Judith-Data-Processing-Hacks
Judith-Data-Processing-Hacks
Judith-Data-Processing-Hacks
Follow
Feb 21 '25
Complement a certain average value to ensure that the total sum remains unchanged — From SQL to SPL #3
#
programming
#
opensource
#
sql
#
dataengineering
7
 reactions
Comments
1
 comment
2 min read
Study Notes dlt Workshop: API, Warehouses, Data Lakes
Pizofreude
Pizofreude
Pizofreude
Follow
Feb 17 '25
Study Notes dlt Workshop: API, Warehouses, Data Lakes
#
dataengineering
#
dezoomcamp
#
dlt
#
beginners
Comments
1
 comment
5 min read
Massively Scalable Processing & Massively Parallel Processing
Asanka Boteju
Asanka Boteju
Asanka Boteju
Follow
Jan 11 '25
Massively Scalable Processing & Massively Parallel Processing
#
data
#
analytics
#
dataengineering
Comments
Add Comment
2 min read
Open Source Data Engineering Landscape 2025
Chen Debra
Chen Debra
Chen Debra
Follow
Feb 13 '25
Open Source Data Engineering Landscape 2025
#
dataengineering
#
opensource
#
apacheddolphinscheduler
#
database
18
 reactions
Comments
2
 comments
14 min read
Study Notes: Data Query on S3 Bucket Using Athena
Pizofreude
Pizofreude
Pizofreude
Follow
Feb 11 '25
Study Notes: Data Query on S3 Bucket Using Athena
#
dataengineering
#
dezoomcamp
#
athena
#
aws
Comments
Add Comment
3 min read
Study Notes 3.2.2: BigQuery Internal Architecture
Pizofreude
Pizofreude
Pizofreude
Follow
Feb 11 '25
Study Notes 3.2.2: BigQuery Internal Architecture
#
dataengineering
#
dezoomcamp
#
bigquery
#
architecture
Comments
Add Comment
2 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account