DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your Dashboard Is Lying: The Spend Fan-Out Trap and the Lead I Lost When the API Went Down
emadaed profile

Your Dashboard Is Lying: The Spend Fan-Out Trap and the Lead I Lost When the API Went Down

#n8n #sql #datamodeling #dataengineering
2
Comments 4
3 min read
Switch from zero: ship a human-in-the-loop data quality agent to your team chat
jenniferevangelistade profile

Switch from zero: ship a human-in-the-loop data quality agent to your team chat

#switch #ai #dataengineering #tutorial
2
Comments 3
9 min read
Building an Agentic Data Factory with Parquet, DuckDB, MCP, and Refinement Loops
kyleledbetter profile

Building an Agentic Data Factory with Parquet, DuckDB, MCP, and Refinement Loops

#ai #dataengineering #analytics #factory
Comments
5 min read
Reproducible Payroll Starts With a Versioned Calculation Manifest
sourcebento profile

Reproducible Payroll Starts With a Versioned Calculation Manifest

#architecture #python #dataengineering #ai
Comments
7 min read
From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard
victoria_ndei_07224d0b8db profile

From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard

#powerfuldevs #datascience #dataengineering
Comments
14 min read
Spark Join Strategies on Databricks: Broadcast, Sort-Merge, Shuffle Hash, and What AQE Changes
karanpulyala profile

Spark Join Strategies on Databricks: Broadcast, Sort-Merge, Shuffle Hash, and What AQE Changes

#databricks #pyspark #spark #dataengineering
1
Comments
6 min read
Read Kafka Like a Database
whsoul82 profile

Read Kafka Like a Database

#database #infrastructure #kafka #dataengineering
Comments
12 min read
Your Python Script Works on 1,000 Rows. Then the Real CSV Arrives.
emilywoodsnyc profile

Your Python Script Works on 1,000 Rows. Then the Real CSV Arrives.

#python #dataengineering #programming #interview
Comments 2
8 min read
Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python
william_rodriguez_65a5898 profile

Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python

#dataengineering
Comments
1 min read
Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse
william_rodriguez_65a5898 profile

Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse

#dataengineering
Comments
1 min read
Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance
kaviwrites profile

Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance

#dataengineering #ai #palantir #architecture
Comments
8 min read
Project Sentinel: One Morning Digest for Every Failure in Our Data Stack
gentjan_likaj profile

Project Sentinel: One Morning Digest for Every Failure in Our Data Stack

#dataengineering #airflow #aws #ai
Comments
6 min read
A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.
jigonyoo profile

A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.

#dbt #dataengineering #dataquality #python
Comments
4 min read
Delta Lake Table Maintenance on Databricks: OPTIMIZE, Z-ORDER vs Liquid Clustering, and VACUUM
karanpulyala profile

Delta Lake Table Maintenance on Databricks: OPTIMIZE, Z-ORDER vs Liquid Clustering, and VACUUM

#databricks #deltalake #dataengineering #pyspark
1
Comments
6 min read
North Star KPI Tests
gentjan_likaj profile

North Star KPI Tests

#data #dbt #analytics #dataengineering
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.