DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Stop bad data at the pull request with Great Expectations and GitHub Actions
laura_cristinachicovisd profile

Stop bad data at the pull request with Great Expectations and GitHub Actions

#dataengineering #githubactions #dataquality #python
Comments
4 min read
From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard
victoria_ndei_07224d0b8db profile

From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard

#powerfuldevs #datascience #dataengineering
Comments
14 min read
Reproducible Payroll Starts With a Versioned Calculation Manifest
sourcebento profile

Reproducible Payroll Starts With a Versioned Calculation Manifest

#architecture #python #dataengineering #ai
Comments
7 min read
Read Kafka Like a Database
whsoul82 profile

Read Kafka Like a Database

#database #infrastructure #kafka #dataengineering
Comments
12 min read
What Are the Best Practices for Databricks Medallion Architecture?
vachkov profile

What Are the Best Practices for Databricks Medallion Architecture?

#databricks #dataengineering #tutorial #medallionarchitectur
Comments
11 min read
Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python
william_rodriguez_65a5898 profile

Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python

#dataengineering
Comments
1 min read
Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse
william_rodriguez_65a5898 profile

Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse

#dataengineering
Comments
1 min read
Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance
kaviwrites profile

Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance

#dataengineering #ai #palantir #architecture
Comments
8 min read
Project Sentinel: One Morning Digest for Every Failure in Our Data Stack
gentjan_likaj profile

Project Sentinel: One Morning Digest for Every Failure in Our Data Stack

#dataengineering #airflow #aws #ai
Comments
6 min read
Delta Lake ACID vs Apache Spark DataFrames: What the Databricks Data Engineer Exam Really Tests
palak_mazumdar_f5431445f6 profile

Delta Lake ACID vs Apache Spark DataFrames: What the Databricks Data Engineer Exam Really Tests

#databricks #dataengineering #spark #certification
Comments
5 min read
North Star KPI Tests
gentjan_likaj profile

North Star KPI Tests

#data #dbt #analytics #dataengineering
Comments
4 min read
My scraper returned HTTP 200 and zero rows. Nothing crashed.
bpx13303 profile

My scraper returned HTTP 200 and zero rows. Nothing crashed.

#webscraping #dataengineering #javascript #monitoring
Comments
3 min read
Basta de f-strings caóticos: SQL fluido y seguro para ClickHouse.
william_rodriguez_65a5898 profile

Basta de f-strings caóticos: SQL fluido y seguro para ClickHouse.

#dataengineering
Comments 1
1 min read
Evita que los mensajes tóxicos congelen tu pipeline: Reintentos y DLQ.
william_rodriguez_65a5898 profile

Evita que los mensajes tóxicos congelen tu pipeline: Reintentos y DLQ.

#dataengineering
Comments 1
1 min read
Why Apache Iceberg Needs a Table Management Platform
jonisar profile

Why Apache Iceberg Needs a Table Management Platform

#iceberg #datalakehouse #dataengineering #opensource
Comments 1
29 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.