DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Hello Everyone
ayush_shandilya_dev profile

Hello Everyone

#ai #dataengineering #machinelearning #softwareengineering
Comments
1 min read
Building an Agentic Data Factory with Parquet, DuckDB, MCP, and Refinement Loops
kyleledbetter profile

Building an Agentic Data Factory with Parquet, DuckDB, MCP, and Refinement Loops

#ai #dataengineering #analytics #factory
Comments
5 min read
Reproducible Payroll Starts With a Versioned Calculation Manifest
sourcebento profile

Reproducible Payroll Starts With a Versioned Calculation Manifest

#architecture #python #dataengineering #ai
Comments
7 min read
From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard
victoria_ndei_07224d0b8db profile

From Raw Data to Business Insights: Building a JCars Logistics Power BI Dashboard

#powerfuldevs #datascience #dataengineering
Comments
14 min read
Read Kafka Like a Database
whsoul82 profile

Read Kafka Like a Database

#database #infrastructure #kafka #dataengineering
Comments
12 min read
Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python
william_rodriguez_65a5898 profile

Maximiza el Rendimiento I/O: Consumidores Async/Await en Kafka Python

#dataengineering
Comments
1 min read
Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse
william_rodriguez_65a5898 profile

Sub-Millisecond Analytical APIs: Async ClickHouse for FastAPI in WClickHouse

#dataengineering
Comments
1 min read
5 SQL window-function traps that show up in data engineering interviews (with runnable DuckDB examples)
itcraftsman profile

5 SQL window-function traps that show up in data engineering interviews (with runnable DuckDB examples)

#sql #dataengineering #duckdb #interview
Comments 2
4 min read
Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance
kaviwrites profile

Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance

#dataengineering #ai #palantir #architecture
Comments
8 min read
Project Sentinel: One Morning Digest for Every Failure in Our Data Stack
gentjan_likaj profile

Project Sentinel: One Morning Digest for Every Failure in Our Data Stack

#dataengineering #airflow #aws #ai
Comments
6 min read
A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.
jigonyoo profile

A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.

#dbt #dataengineering #dataquality #python
Comments
4 min read
North Star KPI Tests
gentjan_likaj profile

North Star KPI Tests

#data #dbt #analytics #dataengineering
Comments
4 min read
Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.
firfircelik profile

Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.

#python #dataengineering #performance #security
Comments
16 min read
Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends
yuhehe profile

Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

#data #database #dataengineering #webscraping
Comments 2
3 min read
Evita que los mensajes tĂłxicos congelen tu pipeline: Reintentos y DLQ.
william_rodriguez_65a5898 profile

Evita que los mensajes tĂłxicos congelen tu pipeline: Reintentos y DLQ.

#dataengineering
Comments 1
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.