Dataengineering

Apache Doris

Oct 24

Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search

#clickhouse #dataengineering #olap #database

4

22 min read

Byron Hsieh

Nov 6

From 8 Minutes to 40 Seconds: Solving Data Pipeline Deployment Bottlenecks with Git Sparse Checkout

#git #devops #dataengineering #azure

5 min read

lotanna obianefo

Oct 2

Create a Microsoft Fabric Lakehouse

#database #dataengineering #cloudcomputing #datascience

5

6 min read

Farhan Khan

Oct 2

Core Concepts of Kafka

#architecture #beginners #dataengineering

8 min read

elisha lukalia

Oct 2

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

#dataengineering #automation #tutorial #sql

9 min read

Leanid Herasimau

Oct 3

Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches

#architecture #backend #dataengineering

6 min read

John Kioko

Oct 6

Introduction to Apache Airflow

#dataengineering #beginners #learning #python

1

4 min read

André Paris

Oct 14

Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK

#aws #dataengineering #typescript #postgres

2

8 min read

Lagat Josiah

Nov 4

Real-Time Cryptocurrency Data Pipeline

#cryptocurrency #dataengineering #python #monitoring

12 min read

Kuldeep Paul

Oct 14

Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025

#dataengineering #rag #testing #llm

2

10 min read

Sagara

Oct 1

Personal Picks: Data Product News (October 1, 2025)

#dataengineering #snowflake #databricks

7 min read

David Kershaw

Nov 4

SQL: is there a better way to code this?

#sql #csv #database #dataengineering

1

1 min read

Lakshmi Narayana Rasalay

Oct 4

Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC

#architecture #dataengineering #postgres

5 min read

jelizaveta

Oct 14

How to Convert Excel to CSV in Python using Spire.XLS for Python

#dataengineering #automation #python #tutorial

4 min read

Sajjad Rahman

Nov 4

Building a Sales Database in PostgreSQL — Schema, Data & JOIN Examples

#database #postgres #dataengineering #sql

3

6 min read

Anshul Jangale

Sep 30

Git Integration in Microsoft Fabric

#dataengineering #fabric #microsoft

3

3 min read

wwx516

Nov 3

Beyond the Browser: Crafting a Robust Web Scraping Pipeline for Dynamic Sports Data

#architecture #automation #dataengineering

1

3 min read

Saurabh Mahawar

Sep 29

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

#opensource #queryengine #presto #dataengineering

5 min read

Stack Overflowed

Sep 29

10 Best Platforms to Learn Data Analytics in 2026

#webdev #dataengineering #datascience #learning

1

4 min read

Thiago da Silva Adriano

Sep 28

Apache Zookeeper: O coordenador de sistemas distribuídos

#architecture #dataengineering #systemdesign

8 min read

Zara Johnson

Oct 22

Data Ingestion Types Explained: Finding the Right Model for Your Data Pipeline

#architecture #data #dataengineering

2

3 min read

Thiago da Silva Adriano

Sep 28

Debezium: Capturando mudanças de dados em tempo real

#architecture #database #dataengineering

3 min read

Thiago da Silva Adriano

Sep 28

Change Data Capture (CDC): Capturando mudanças em tempo real

#dataengineering #database #architecture #sql

4 min read

Thiago da Silva Adriano

Sep 28

Streams de Dados: Processamento de Informações em Tempo Real

#architecture #data #dataengineering

3 min read

Romario Da Silva

Oct 29

Designing Data-Intensive Applications — Chapter 1: Reliable, Scalable, and Maintainable Applications

#systemdesign #architecture #dataengineering #database

5

4 min read

DEV Community

# dataengineering

Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search

From 8 Minutes to 40 Seconds: Solving Data Pipeline Deployment Bottlenecks with Git Sparse Checkout

Create a Microsoft Fabric Lakehouse

Core Concepts of Kafka

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches

Introduction to Apache Airflow

Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK

Real-Time Cryptocurrency Data Pipeline

Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025

Personal Picks: Data Product News (October 1, 2025)

SQL: is there a better way to code this?

Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC

How to Convert Excel to CSV in Python using Spire.XLS for Python

Building a Sales Database in PostgreSQL — Schema, Data & JOIN Examples

Git Integration in Microsoft Fabric

Beyond the Browser: Crafting a Robust Web Scraping Pipeline for Dynamic Sports Data

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

10 Best Platforms to Learn Data Analytics in 2026

Apache Zookeeper: O coordenador de sistemas distribuídos

Data Ingestion Types Explained: Finding the Right Model for Your Data Pipeline

Debezium: Capturando mudanças de dados em tempo real

Change Data Capture (CDC): Capturando mudanças em tempo real

Streams de Dados: Processamento de Informações em Tempo Real

Designing Data-Intensive Applications — Chapter 1: Reliable, Scalable, and Maintainable Applications