DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The NDC Revolution and What It Means for Data Engineers in Travel Tech
airtruffle profile

The NDC Revolution and What It Means for Data Engineers in Travel Tech

#ndc #dataengineering #airlinetechnology #traveltech
Comments
6 min read
The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool
hello_arisyn_0dc948aa82b3 profile

The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool

#dataengineering #semanticlayer #datagovernance #naturallanguagequery
Comments
4 min read
Building NewHomie property analytics tool — Part 1
menglinmaker profile

Building NewHomie property analytics tool — Part 1

#dataengineering #aws #softwareengineering #distributedsystems
Comments
8 min read
Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun
wilians_conde_6d4bbc5eed2 profile

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

#dataengineering #mongodb #systemdesign #bigdata
Comments
3 min read
What Spark Interviews Actually Test (Based on 189 Real Interview Reports)
datadriven profile

What Spark Interviews Actually Test (Based on 189 Real Interview Reports)

#dataengineering #interview #career #programming
Comments
7 min read
Why Semantic Layers Need Distributional Validation, Not Just Schema Validation
anthony_etherealogic profile

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

#dataquality #semanticlayer #dataengineering #opensource
Comments
9 min read
AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake
soumyadeep_basu_3101d3ac1 profile

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

#aws #dataengineering #terraform #cloud
Comments
4 min read
DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance
_f751e50d019c73e72371f profile

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

#database #dataengineering #performance #sql
Comments
5 min read
ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering
jim_kinyua_3f7d191b865bed profile

ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering

#dataengineering #etl #database #beginners
Comments
16 min read
AI-Powered Digital Transformation Strategies
vishaluttammane profile

AI-Powered Digital Transformation Strategies

#ai #digitaltransformation #dataengineering #mlops
1
Comments 1
3 min read
Apache Data Lakehouse Weekly: April 9–15, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: April 9–15, 2026

#news #database #dataengineering #opensource
Comments
7 min read
Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing
sagara profile

Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing

#snowflake #dataengineering
Comments
10 min read
How I Built an End-to-End Data Engineering Pipeline for Hong Kong's Public Transport Network
mfarizala profile

How I Built an End-to-End Data Engineering Pipeline for Hong Kong's Public Transport Network

#dataengineering #datazoomcamp #googlecloud #bigquery
Comments
8 min read
Backpressure in document pipelines is an architecture problem first
cy_ong_591 profile

Backpressure in document pipelines is an architecture problem first

#architecture #dataengineering #sre #systemdesign
Comments
2 min read
Why mixed document packs make extraction pipelines harder to trust
cy_ong_591 profile

Why mixed document packs make extraction pipelines harder to trust

#dataengineering #machinelearning #productivity #systemdesign
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.