DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Querying Germany's Company Register via API: Clean JSON and the new eGbR

Querying Germany's Company Register via API: Clean JSON and the new eGbR

Comments
1 min read
Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

5
Comments
9 min read
Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries

Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries

Comments
5 min read
Understanding Docker for Data Engineering

Understanding Docker for Data Engineering

1
Comments
5 min read
Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Comments
4 min read
Vertica vs VoltDB (Volt Active Data): Key Differences, Use Cases & How to Choose in 2026

Vertica vs VoltDB (Volt Active Data): Key Differences, Use Cases & How to Choose in 2026

Comments
7 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Comments
2 min read
Why Most Sports Betting Projects Fail Before Launch (And It's Not the Algorithm)

Why Most Sports Betting Projects Fail Before Launch (And It's Not the Algorithm)

Comments
2 min read
Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups

Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups

1
Comments
4 min read
AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving

AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving

Comments
12 min read
AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators

AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators

Comments
7 min read
this is scary (day 0 of learning data engineering)

this is scary (day 0 of learning data engineering)

1
Comments
1 min read
Snowflake or Databricks? An Honest Comparison (From 200+ Migrations)

Snowflake or Databricks? An Honest Comparison (From 200+ Migrations)

1
Comments 1
3 min read
Data Engineering Described

Data Engineering Described

Comments
5 min read
Day 15 of #100DaysOfClickHouse: Mastering the ClickHouse Client

Day 15 of #100DaysOfClickHouse: Mastering the ClickHouse Client

2
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.