DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why Semantic Layers Need Distributional Validation, Not Just Schema Validation
anthony_etherealogic profile

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

#dataquality #semanticlayer #dataengineering #opensource
Comments
9 min read
Bypassing the "Pandas RAM Tax": Building a Zero-Copy CSV Extractor in C
nareshcn2 profile

Bypassing the "Pandas RAM Tax": Building a Zero-Copy CSV Extractor in C

#c #python #dataengineering #performance
1
Comments 1
2 min read
Financial Data Integration: A Practical Guide
andrew_tan_layline profile

Financial Data Integration: A Practical Guide

#dataengineering #kafka #eventdriven #fintech
Comments
7 min read
Why Real-Time Data Integration Matters for Modern Applications
andrew_tan_layline profile

Why Real-Time Data Integration Matters for Modern Applications

#data #dataengineering #systemdesign #devops
Comments
5 min read
Scuderia Data Ep.3
wvanheemstra profile

Scuderia Data Ep.3

#azure #adf #dataengineering #pipelines
2
Comments
2 min read
Scuderia Data Ep.2
wvanheemstra profile

Scuderia Data Ep.2

#azure #storage #dataengineering #databricks
1
Comments
3 min read
Scuderia Data Ep.1
wvanheemstra profile

Scuderia Data Ep.1

#azure #databricks #dataengineering #beginners
1
Comments
3 min read
Why My S3 Backup Setup Broke: Buckets, “Folders”, and Scheduling Misconceptions
mohhddhassan profile

Why My S3 Backup Setup Broke: Buckets, “Folders”, and Scheduling Misconceptions

#aws #s3 #cloudstorage #dataengineering
3
Comments
3 min read
Why Your SAP Migration Mapping Layer Shouldn't Live in Spreadsheets
rationalxplorer profile

Why Your SAP Migration Mapping Layer Shouldn't Live in Spreadsheets

#datamigration #sap #dataengineering #opensource
2
Comments
3 min read
How I Built an End-to-End Data Engineering Pipeline for Hong Kong's Public Transport Network
mfarizala profile

How I Built an End-to-End Data Engineering Pipeline for Hong Kong's Public Transport Network

#dataengineering #datazoomcamp #googlecloud #bigquery
1
Comments
8 min read
Debugging a Broken Metrics Pipeline: What Actually Went Wrong
mohhddhassan profile

Debugging a Broken Metrics Pipeline: What Actually Went Wrong

#dataengineering #clickhouse #vector #debugging
3
Comments
3 min read
Building Consistent Data Foundations at Scale
supratipb profile

Building Consistent Data Foundations at Scale

#data #dataengineering #datascience #database
1
Comments 1
5 min read
“Data Quality Nightmares: How Bad Data Quietly Destroys Business Decisions”
ramavala profile

“Data Quality Nightmares: How Bad Data Quietly Destroys Business Decisions”

#dataengineering #dataarchitecture #dataquality #dataobservability
1
Comments
5 min read
Apache DolphinScheduler 3.4.1 Released with Task Dispatch Timeout Detection
seatunnel profile

Apache DolphinScheduler 3.4.1 Released with Task Dispatch Timeout Detection

#news #automation #dataengineering #opensource
2
Comments
4 min read
From Pipelines to Transforms: Making Vector Work with ClickHouse
mohhddhassan profile

From Pipelines to Transforms: Making Vector Work with ClickHouse

#dataengineering #clickhouse #observability #vector
1
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.