DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The report says verified. Is the change safe to release?

The report says verified. Is the change safe to release?

Comments
5 min read
Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design

Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design

Comments
6 min read
56 fault-injection tests passed. The one that injected nothing failed.

Negative controls reveal flaky HLL estimators

56 fault-injection tests passed. The one that injected nothing failed.

3
Comments 8
3 min read
Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

Comments
4 min read
Build a Data Lake on S3-Compatible Storage

Build a Data Lake on S3-Compatible Storage

2
Comments
7 min read
97% of Data Engineers Are Burned Out. Here's the Data.

97% of Data Engineers Are Burned Out. Here's the Data.

1
Comments
7 min read
Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data

Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data

1
Comments
4 min read
Nobody Warns You the Data Engineering Interview Isn't About Data Engineering

Nobody Warns You the Data Engineering Interview Isn't About Data Engineering

Comments 3
2 min read
Two domains are 53% of the Databricks Data Engineer Associate exam

Two domains are 53% of the Databricks Data Engineer Associate exam

Comments
4 min read
I built the "anti-Elementary" for dbt data quality and here's why

I built the "anti-Elementary" for dbt data quality and here's why

Comments
5 min read
AI-Enhanced Data Pipelines: Integrating NVIDIA Triton Inference Server into Modern ETL Architectures

AI-Enhanced Data Pipelines: Integrating NVIDIA Triton Inference Server into Modern ETL Architectures

1
Comments
4 min read
Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka

Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka

Comments
10 min read
Agentic AI and big data: what your platform needs before agents are useful

Agentic AI and big data: what your platform needs before agents are useful

Comments
6 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

Comments 1
2 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

Comments 1
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.