DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Exploring Snowpark While Comparing It with Apache Spark

Exploring Snowpark While Comparing It with Apache Spark

4
Comments
8 min read
Mastering Modern Data Workflows with Docker

Mastering Modern Data Workflows with Docker

1
Comments
3 min read
Building a Threat Hunting Pipeline with Python and Jupyter

Building a Threat Hunting Pipeline with Python and Jupyter

Comments
4 min read
Arrowjet is now a Cross-Database Sync Tool in Python (PG, MySQL, Redshift)

Arrowjet is now a Cross-Database Sync Tool in Python (PG, MySQL, Redshift)

1
Comments
2 min read
How I Finally implemented CI/CD for Microsoft Fabric — And What Nobody Tells You About It

How I Finally implemented CI/CD for Microsoft Fabric — And What Nobody Tells You About It

4
Comments
6 min read
The Blueprint for Modern Data Orchestration

The Blueprint for Modern Data Orchestration

1
Comments
5 min read
Building a PySpark and AWS Glue ETL Pipeline for Search Keyword Revenue Analysis

Building a PySpark and AWS Glue ETL Pipeline for Search Keyword Revenue Analysis

Comments
1 min read
Automating Data Workflows with Apache Airflow

Automating Data Workflows with Apache Airflow

1
Comments
6 min read
Pre-Code Planning Stopped Me From Getting Stuck on a 3-Hour ETL Pipeline

Pre-Code Planning Stopped Me From Getting Stuck on a 3-Hour ETL Pipeline

Comments
2 min read
What Makes Apache Hudi a Game-Changer for Data Engineering

What Makes Apache Hudi a Game-Changer for Data Engineering

Comments
3 min read
Shortcut & Mirroring

Shortcut & Mirroring

Comments
1 min read
Three Ways to Set Up CDC from Postgres to ClickHouse

Three Ways to Set Up CDC from Postgres to ClickHouse

1
Comments
9 min read
Why PostgreSQL EXPLAIN ANALYZE Can Mislead You — and What to Use Instead

Why PostgreSQL EXPLAIN ANALYZE Can Mislead You — and What to Use Instead

Comments
6 min read
HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift

HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift

1
Comments 1
10 min read
Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings

Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.