DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)
shagun_khandelwal profile

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

#dataengineering #bigdata #python #ai
Comments
2 min read
Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration
andrey_s profile

Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

#dataengineering #bigdata #database #analytics
1
Comments
9 min read
Apache Kafka in Data Engineering.
kepha_gitau profile

Apache Kafka in Data Engineering.

#dataengineering #kafka
Comments
1 min read
Beginner guide for Apache Kafka
michael_kipkorir_5c3a815b profile

Beginner guide for Apache Kafka

#dataengineering #kafka #python
Comments
1 min read
Apache Kafka in Data Engineering for Beginners
dan_tialila profile

Apache Kafka in Data Engineering for Beginners

#dataengineering #kafka
Comments
1 min read
SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors
seatunnel profile

SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

#seatunnel #opensource #bigdata #dataengineering
Comments
11 min read
Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures
andrey_s profile

Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

#sql #dataengineering #database #analytics
1
Comments
11 min read
Automating Your Local DBT & Snowflake Playground with Python
arunkumar_panneerselvam_2 profile

Automating Your Local DBT & Snowflake Playground with Python

#snowflake #dbt #python #dataengineering
2
Comments
10 min read
15 foundational concepts on Data Engineering
kilemba profile

15 foundational concepts on Data Engineering

#webdev #programming #dataengineering
Comments
6 min read
Apache Arrow dev list digest (Sept 8–12, 2025)
alexmercedcoder profile

Apache Arrow dev list digest (Sept 8–12, 2025)

#data #database #datascience #dataengineering
1
Comments
4 min read
Apache Polaris dev list digest (Sept 8–12, 2025)
alexmercedcoder profile

Apache Polaris dev list digest (Sept 8–12, 2025)

#data #database #datascience #dataengineering
1
Comments
4 min read
Why I’m Switching to Parquet for Data Storage
eric_kahindi_cfbfda3bd0f7 profile

Why I’m Switching to Parquet for Data Storage

#parquet #datalake #dataengineering
Comments
3 min read
Stop Writing Nested Loops for ETL. Compile Them with convtools
westandskif profile

Stop Writing Nested Loops for ETL. Compile Them with convtools

#python #dataengineering #performance #etl
Comments
6 min read
Change Data Capture (CDC) in Data Engineering: Concepts, Tools, and Real-World Implementation Strategies
joy_akinyi_115689d7dff92f profile

Change Data Capture (CDC) in Data Engineering: Concepts, Tools, and Real-World Implementation Strategies

#architecture #database #dataengineering
Comments
8 min read
Data Engineering Core Concepts
prudiec profile

Data Engineering Core Concepts

#dataengineering #kafka #webdev #programming
1
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.