DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Fabric Runtime 2.0 is becoming the default. Here is what actually breaks.
firfircelik profile

Fabric Runtime 2.0 is becoming the default. Here is what actually breaks.

#fabric #spark #dataengineering #azure
Comments 2
7 min read
Understanding Data governance principles: A junior data engineer’s perspective
kitchen_code profile

Understanding Data governance principles: A junior data engineer’s perspective

#governance #dataengineering #data
Comments 1
3 min read
Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto.
william_rodriguez_65a5898 profile

Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto.

#dataengineering
Comments 1
1 min read
Upserts reales en un mundo append-only: ReplacingMergeTree y FINAL.
william_rodriguez_65a5898 profile

Upserts reales en un mundo append-only: ReplacingMergeTree y FINAL.

#dataengineering
Comments 1
1 min read
End-to-End Power BI Architecture: Transforming JCars Logistics from Dirty Flat Data to Executive Decision Support
prudence_korir_ profile

End-to-End Power BI Architecture: Transforming JCars Logistics from Dirty Flat Data to Executive Decision Support

#powerfuldevs #dataengineering #dax #businessintelligence
Comments
3 min read
What One Rust Client Can Reach Across Seven Iceberg Catalogs
xbill profile

What One Rust Client Can Reach Across Seven Iceberg Catalogs

#rust #iceberg #lakehouse #dataengineering
Comments
11 min read
Your Kafka cluster is healthy. But the event is still missing
sudeephazra profile

Your Kafka cluster is healthy. But the event is still missing

#dataengineering #kafka #microservices #monitoring
Comments
6 min read
Joining Korean company data: DART codes, LEIs and the limits of name matching
jake_cho_bd1665179f4c45d5 profile

Joining Korean company data: DART codes, LEIs and the limits of name matching

#python #dataengineering #database #tutorial
Comments
3 min read
Asia's Real-Time Markets: An LTAP Architecture with Databricks Lakebase and Lakehouse - Hong Kong Databricks FSI Community Day 2026
martindd profile

Asia's Real-Time Markets: An LTAP Architecture with Databricks Lakebase and Lakehouse - Hong Kong Databricks FSI Community Day 2026

#architecture #database #dataengineering
Comments
3 min read
72% of India's NSE bulk deals are same-day round trips (a 90,000-row analysis)
mohammed_arshadansari_f2 profile

72% of India's NSE bulk deals are same-day round trips (a 90,000-row analysis)

#python #datascience #dataengineering #fintech
Comments
8 min read
AWS Glue Iceberg Optimizer Alternatives for a Data Lakehouse
jonisar profile

AWS Glue Iceberg Optimizer Alternatives for a Data Lakehouse

#iceberg #aws #dataengineering #lakehouse
Comments
29 min read
I put every data engineering lab in CI. Here is what broke.
sarangambekar profile

I put every data engineering lab in CI. Here is what broke.

#dataengineering #apachekafka #opensource #airflow
Comments
5 min read
Follow one row: what ClickHouse does with your INSERT
maksim-gr profile

Follow one row: what ClickHouse does with your INSERT

#clickhouse #database #dataengineering #sql
Comments
13 min read
Apache Iceberg Query Optimization: Production Guide
jonisar profile

Apache Iceberg Query Optimization: Production Guide

#iceberg #dataengineering #snowflake #sql
Comments
40 min read
Procesa 50 millones de filas sin OOM: Query Streaming por bloques.
william_rodriguez_65a5898 profile

Procesa 50 millones de filas sin OOM: Query Streaming por bloques.

#dataengineering
Comments 1
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.