DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
AWS MWAA Serverless: Is It Worth the Switch from Provisioned?

AWS MWAA Serverless: Is It Worth the Switch from Provisioned?

Comments
4 min read
How to Analyze Sensitive Data Without Uploading It Anywhere

How to Analyze Sensitive Data Without Uploading It Anywhere

Comments
4 min read
Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

1
Comments
16 min read
Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

1
Comments
7 min read
SQL Debezium Kafka Snowflake

SQL Debezium Kafka Snowflake

Comments
4 min read
Apache Data Lakehouse Weekly: February 18–25, 2026

Apache Data Lakehouse Weekly: February 18–25, 2026

1
Comments
5 min read
Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

6
Comments 1
6 min read
Why Data Governance Is Not Optional in a Microsoft Fabric Workflow

Why Data Governance Is Not Optional in a Microsoft Fabric Workflow

1
Comments
6 min read
The NDC Revolution and What It Means for Data Engineers

The NDC Revolution and What It Means for Data Engineers

1
Comments
8 min read
How I built a data quality API that runs at the edge in milliseconds

How I built a data quality API that runs at the edge in milliseconds

Comments
4 min read
Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Comments
1 min read
S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

4
Comments
4 min read
How Linux Is Used in Real-World Data Engineering

How Linux Is Used in Real-World Data Engineering

1
Comments
3 min read
How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

Comments 1
4 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.