DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Threat Hunting Pipeline with Python and Jupyter

Building a Threat Hunting Pipeline with Python and Jupyter

Comments
4 min read
Arrowjet is now a Cross-Database Sync Tool in Python (PG, MySQL, Redshift)

Arrowjet is now a Cross-Database Sync Tool in Python (PG, MySQL, Redshift)

1
Comments
2 min read
How I Finally implemented CI/CD for Microsoft Fabric — And What Nobody Tells You About It

How I Finally implemented CI/CD for Microsoft Fabric — And What Nobody Tells You About It

4
Comments
6 min read
The Blueprint for Modern Data Orchestration

The Blueprint for Modern Data Orchestration

1
Comments
5 min read
Building a PySpark and AWS Glue ETL Pipeline for Search Keyword Revenue Analysis

Building a PySpark and AWS Glue ETL Pipeline for Search Keyword Revenue Analysis

Comments
1 min read
Automating Data Workflows with Apache Airflow

Automating Data Workflows with Apache Airflow

1
Comments
6 min read
Pre-Code Planning Stopped Me From Getting Stuck on a 3-Hour ETL Pipeline

Pre-Code Planning Stopped Me From Getting Stuck on a 3-Hour ETL Pipeline

Comments
2 min read
What Makes Apache Hudi a Game-Changer for Data Engineering

What Makes Apache Hudi a Game-Changer for Data Engineering

Comments
3 min read
Shortcut & Mirroring

Shortcut & Mirroring

Comments
1 min read
Three Ways to Set Up CDC from Postgres to ClickHouse

Three Ways to Set Up CDC from Postgres to ClickHouse

1
Comments
9 min read
Why PostgreSQL EXPLAIN ANALYZE Can Mislead You — and What to Use Instead

Why PostgreSQL EXPLAIN ANALYZE Can Mislead You — and What to Use Instead

Comments
6 min read
Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings

Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings

Comments
2 min read
How I Built a Scalable Data Engineering Blog with Next.js & Supabase

How I Built a Scalable Data Engineering Blog with Next.js & Supabase

Comments
1 min read
Netflix Intelligent Lakehouse Solves Iceberg Maintenance — You Can Easily Too

Netflix Intelligent Lakehouse Solves Iceberg Maintenance — You Can Easily Too

1
Comments
8 min read
Load PostgreSQL into Apache Iceberg with Sling

Load PostgreSQL into Apache Iceberg with Sling

2
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.