Dataengineering

maghsood esmaeili

Dec 16 '25

How to Sync Data from an Oracle Table to Elasticsearch using Kafka Connect

#database #kubernetes #dataengineering #tutorial

1

5 min read

Pradeep Kalluri

Nov 22 '25

From Raw to Refined: Data Pipeline Architecture at Scale

#dataengineering #bigdata #python #dataquality

12 min read

Hoshang Mehta

Nov 24 '25

Agent Cost Optimization: A Data Engineer's Guide

#dataengineering #ai

13 min read

John Wakaba

Nov 24 '25

INTRODUCTION TO DBT(Data Build Tool)

#dataengineering #data #analytics

1

2 min read

Hammad Ahmed 🎩

Dec 27 '25

What's New in dbt 1.10

#dbt #data #datascience #dataengineering

3

12 min read

Karthikeyan Rajasekaran

Dec 26 '25

The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)

#dataengineering #dbt #dagster #data

2

7 min read

Arvind SundaraRajan

Nov 22 '25

Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan

#dataengineering #datascience #architecture #data

2 min read

Shrinivas Vishnupurikar

Dec 26 '25

Snowflake + Postgres: A Small Feature That Signals a Big Shift

#snowflake #postgres #database #dataengineering

6 min read

Pradeep Kalluri

Nov 24 '25

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

#dataengineering #dataquality #bigdata #python

8 min read

Vinicius Fagundes

Dec 5 '25

Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning

#ai #mcp #llm #dataengineering

1

14 min read

Aisalkyn Aidarova

Nov 20 '25

Why We Need Schema Registry in Kafka

#systemdesign #distributedsystems #dataengineering #architecture

2

17 min read

Aisalkyn Aidarova

Nov 20 '25

Introduction to the Confluent REST Proxy

#api #architecture #dataengineering

2

4 min read

David Aronchick

Nov 25 '25

While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?

#dataengineering #devrel #productivity #observability

9 min read

Mohamed Hussain S

Dec 13 '25

Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

#dataengineering #etl #clickhouse #python

2

3 min read

Rutika Khaire

Dec 24 '25

Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches

#dataingestion #medallion #dataengineering #datafactory

2

3 min read

Karthikeyan Rajasekaran

Dec 24 '25

Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)

#dataengineering #dbt #dagster #python

2

6 min read

Aviral Srivastava

Nov 21 '25

Azure Synapse Analytics

#analytics #cloud #dataengineering #azure

5 min read

Steven Hur

Nov 18 '25

Debugging Windows Race Conditions in Dagster

#devjournal #dataengineering #python #opensource

3 min read

Cristian Bergamo

Dec 2 '25

Design Patterns for Data Engineers: Cleaner ETL with the Builder Pattern.

#dataengineering #designpatterns #python

3

2 min read

Vinicius Fagundes

Dec 2 '25

Positional Encodings and Context Window Engineering: Why Token Order Matters

#dataengineering #ai #software

3

12 min read

Yegor Bryzhan

Dec 1 '25

Trying Out Dagster for Data Orchestration

#dataengineering #python #programming

4

9 min read

Sajjad Rahman

Dec 2 '25

🔐 Understanding Governance in Microsoft Fabric

#webdev #microsoft #dataengineering #tutorial

1

3 min read

pawan deore

Dec 12 '25

Day 2: Data Engineering vs Data Science vs Data Analytics

#data #dataengineering #programming #python

2 min read

SHRI VARSHAN R E 23IT049

Nov 19 '25

6 Different Data Formats Commonly Used in Data Analytics

#datascience #analytics #dataengineering #beginners

3 min read

Taro.Matsui

Nov 18 '25

Part 1: Snowflake's Autonomous Future

#snowflake #ai #dataengineering

8 min read

DEV Community

# dataengineering

How to Sync Data from an Oracle Table to Elasticsearch using Kafka Connect

From Raw to Refined: Data Pipeline Architecture at Scale

Agent Cost Optimization: A Data Engineer's Guide

INTRODUCTION TO DBT(Data Build Tool)

What's New in dbt 1.10

The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)

Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan

Snowflake + Postgres: A Small Feature That Signals a Big Shift

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning

Why We Need Schema Registry in Kafka

Introduction to the Confluent REST Proxy

While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?

Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches

Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)

Azure Synapse Analytics

Debugging Windows Race Conditions in Dagster

Design Patterns for Data Engineers: Cleaner ETL with the Builder Pattern.

Positional Encodings and Context Window Engineering: Why Token Order Matters

Trying Out Dagster for Data Orchestration

🔐 Understanding Governance in Microsoft Fabric

Day 2: Data Engineering vs Data Science vs Data Analytics

6 Different Data Formats Commonly Used in Data Analytics

Part 1: Snowflake's Autonomous Future