DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

1
Comments
2 min read
Batch Processing with Apache Spark

Batch Processing with Apache Spark

Comments
1 min read
A Beginner's Guide to SQL Joins and Window Functions

A Beginner's Guide to SQL Joins and Window Functions

1
Comments
6 min read
My Non-Fiction Library: Books on Data Lakehouses, Apache Iceberg, AI, and Beyond

My Non-Fiction Library: Books on Data Lakehouses, Apache Iceberg, AI, and Beyond

Comments
9 min read
S&OP Engineering II: Demand Planning from Guessing to Probability

S&OP Engineering II: Demand Planning from Guessing to Probability

2
Comments
4 min read
How We Generate AI Network Digests for MegaETH at MiniBlocks.io

How We Generate AI Network Digests for MegaETH at MiniBlocks.io

1
Comments
8 min read
Stop Losing Your Medical Records: Build a Multimodal Health RAG with LlamaIndex & Qdrant 🩺

Stop Losing Your Medical Records: Build a Multimodal Health RAG with LlamaIndex & Qdrant 🩺

1
Comments
4 min read
From Scrape to Feed: Building a Google Merchant Center CSV from Zappos Data

From Scrape to Feed: Building a Google Merchant Center CSV from Zappos Data

Comments
4 min read
Data Relationship Analysis at Scale with Arisyn

Data Relationship Analysis at Scale with Arisyn

Comments
3 min read
5 Database Design Mistakes I Keep Seeing (And How to Catch Them Early)

5 Database Design Mistakes I Keep Seeing (And How to Catch Them Early)

1
Comments
7 min read
DAY 6 - Model Training & Tuning

DAY 6 - Model Training & Tuning

Comments
2 min read
How to Use Dremio with Claude Code: Connect, Query, and Build Data Apps

How to Use Dremio with Claude Code: Connect, Query, and Build Data Apps

Comments
13 min read
Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

2
Comments
4 min read
Data Relationship Intelligence Is Infrastructure — Not a Feature

Data Relationship Intelligence Is Infrastructure — Not a Feature

Comments
1 min read
Database Branch Testing: How Isolated Environments Improve QA Confidence

Database Branch Testing: How Isolated Environments Improve QA Confidence

1
Comments
11 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.