DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Performance and Apache Iceberg's Metadata

Performance and Apache Iceberg's Metadata

1
Comments
7 min read
Building NewHomie property analytics tool — Part 1

Building NewHomie property analytics tool — Part 1

Comments
8 min read
Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

Comments
3 min read
AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

Comments
4 min read
DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

Comments
5 min read
ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering

ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering

Comments
16 min read
Apache Data Lakehouse Weekly: May 13-20, 2026

Apache Data Lakehouse Weekly: May 13-20, 2026

1
Comments
18 min read
Data Engineer Skills Companies Want in 2026: 6,877-Posting Analysis

Data Engineer Skills Companies Want in 2026: 6,877-Posting Analysis

1
Comments
17 min read
AI-Powered Digital Transformation Strategies

AI-Powered Digital Transformation Strategies

1
Comments 1
3 min read
Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing

Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing

Comments
10 min read
Backpressure in document pipelines is an architecture problem first

Backpressure in document pipelines is an architecture problem first

Comments
2 min read
Why mixed document packs make extraction pipelines harder to trust

Why mixed document packs make extraction pipelines harder to trust

Comments
2 min read
Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)

Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)

3
Comments
2 min read
Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis

Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis

6
Comments
31 min read
🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

Gemma 4 Challenge: Build With Gemma 4 Submission

🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

9
Comments 4
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.