DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Analyze Sensitive Data Without Uploading It Anywhere

How to Analyze Sensitive Data Without Uploading It Anywhere

Comments
4 min read
Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

1
Comments
16 min read
Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

1
Comments
7 min read
SQL Debezium Kafka Snowflake

SQL Debezium Kafka Snowflake

Comments
4 min read
Apache Data Lakehouse Weekly: February 18–25, 2026

Apache Data Lakehouse Weekly: February 18–25, 2026

1
Comments
5 min read
Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

6
Comments 1
6 min read
What If Table Relationships No Longer Had to Be Mapped by Hand?

What If Table Relationships No Longer Had to Be Mapped by Hand?

4
Comments
3 min read
The NDC Revolution and What It Means for Data Engineers

The NDC Revolution and What It Means for Data Engineers

1
Comments
8 min read
How I built a data quality API that runs at the edge in milliseconds

How I built a data quality API that runs at the edge in milliseconds

Comments
4 min read
Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Comments
1 min read
S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

4
Comments
4 min read
How Linux Is Used in Real-World Data Engineering

How Linux Is Used in Real-World Data Engineering

1
Comments
3 min read
How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

Comments 1
4 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
3 min read
The data engineer's Cortex Code cheat sheet

The data engineer's Cortex Code cheat sheet

126
Comments 10
15 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.