DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Vectorizing Real-Time Kafka Events

Vectorizing Real-Time Kafka Events

Comments
4 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

Comments
5 min read
Dive Into Containerization, Docker & Docker Compose

Dive Into Containerization, Docker & Docker Compose

2
Comments 1
7 min read
Docker for Data Professionals: From Zero to Containerizing Your First Project

Docker for Data Professionals: From Zero to Containerizing Your First Project

Comments
11 min read
The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog

The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog

Comments
6 min read
Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap

Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap

Comments
7 min read
The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?

The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?

Comments
6 min read
Data Lake Architecture for Data Engineering Interviews

Data Lake Architecture for Data Engineering Interviews

Comments
44 min read
Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

1
Comments
4 min read
Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨

Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨

Comments 1
4 min read
Python 101

Python 101

Comments
7 min read
Python For Data Analytics

Python For Data Analytics

Comments
6 min read
Beyond the SELECT: Mastering Advanced SQL for Surgical BI

Beyond the SELECT: Mastering Advanced SQL for Surgical BI

Comments
2 min read
OLAP vs OLTP: What's the Difference and Why Does It Matter?

OLAP vs OLTP: What's the Difference and Why Does It Matter?

Comments
3 min read
Managed Iceberg: Optimizing a Modern Lakehouse

Managed Iceberg: Optimizing a Modern Lakehouse

Comments
16 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.