DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Analyze Sensitive Data Without Uploading It Anywhere

How to Analyze Sensitive Data Without Uploading It Anywhere

Comments
4 min read
Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

1
Comments
16 min read
Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

1
Comments
7 min read
Linux Fundamentals Every Beginner Data Engineer Should Know

Linux Fundamentals Every Beginner Data Engineer Should Know

Comments
4 min read
SQL Debezium Kafka Snowflake

SQL Debezium Kafka Snowflake

Comments
4 min read
Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modelling in Power BI: Joins, Relationships, and Schemas Explained

6
Comments 1
6 min read
Why Data Governance Is Not Optional in a Microsoft Fabric Workflow

Why Data Governance Is Not Optional in a Microsoft Fabric Workflow

1
Comments
6 min read
The NDC Revolution and What It Means for Data Engineers

The NDC Revolution and What It Means for Data Engineers

1
Comments
8 min read
dbt docs: generate, write, and host them

dbt docs: generate, write, and host them

1
Comments
7 min read
How I built a data quality API that runs at the edge in milliseconds

How I built a data quality API that runs at the edge in milliseconds

Comments
4 min read
50 Scala Interview Questions for Spark Developers with Answers

50 Scala Interview Questions for Spark Developers with Answers

1
Comments
10 min read
Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Tech Ecosystem Observatory: How I Built a Cloud-Native Data Pipeline to Track Global Tech Layoffs vs YC Startup Activity

Comments
1 min read
S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

S&OP: Why Your Excel Is Lying to You (and How to Interrogate It with Python)

4
Comments
4 min read
How Linux Is Used in Real-World Data Engineering

How Linux Is Used in Real-World Data Engineering

1
Comments
3 min read
How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.