DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance
kaviwrites profile

Designing a Palantir Foundry Ontology That Holds Up in Production: Object Types, Link Types, and Action Governance

#dataengineering #ai #palantir #architecture
Comments
8 min read
Project Sentinel: One Morning Digest for Every Failure in Our Data Stack
gentjan_likaj profile

Project Sentinel: One Morning Digest for Every Failure in Our Data Stack

#dataengineering #airflow #aws #ai
Comments
6 min read
A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.
jigonyoo profile

A unique + not_null suite stopped 3 of 17 bad batches. Here is what got through.

#dbt #dataengineering #dataquality #python
Comments
4 min read
North Star KPI Tests
gentjan_likaj profile

North Star KPI Tests

#data #dbt #analytics #dataengineering
Comments
4 min read
Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.
firfircelik profile

Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.

#python #dataengineering #performance #security
Comments
16 min read
Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends
yuhehe profile

Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

#data #database #dataengineering #webscraping
Comments 2
3 min read
Basta de f-strings caĂłticos: SQL fluido y seguro para ClickHouse.
william_rodriguez_65a5898 profile

Basta de f-strings caĂłticos: SQL fluido y seguro para ClickHouse.

#dataengineering
Comments 1
1 min read
Evita que los mensajes tĂłxicos congelen tu pipeline: Reintentos y DLQ.
william_rodriguez_65a5898 profile

Evita que los mensajes tĂłxicos congelen tu pipeline: Reintentos y DLQ.

#dataengineering
Comments 1
1 min read
Why Apache Iceberg Needs a Table Management Platform
jonisar profile

Why Apache Iceberg Needs a Table Management Platform

#iceberg #datalakehouse #dataengineering #opensource
Comments 1
29 min read
I built a Claude Skill that inventories legacy SSIS packages before a Fabric migration
bayremhamrouni profile

I built a Claude Skill that inventories legacy SSIS packages before a Fabric migration

#dataengineering #etl #python #microsoftfabric
Comments
3 min read
Fabric Runtime 2.0 is becoming the default. Here is what actually breaks.
firfircelik profile

Fabric Runtime 2.0 is becoming the default. Here is what actually breaks.

#fabric #spark #dataengineering #azure
Comments 2
7 min read
When ClickHouse merges change your query results
maksim-gr profile

When ClickHouse merges change your query results

#clickhouse #database #dataengineering #sql
1
Comments 6
11 min read
Writing a Reconciliation Job in SQL and Python That Proves Two Systems Agree
jayant_chaudhary profile

Writing a Reconciliation Job in SQL and Python That Proves Two Systems Agree

#sql #dataengineering #integration #postgres
2
Comments 2
12 min read
Rebuild It Yourself: Adjusted Prices from Raw Prices, Splits and Dividends
jaroslav_marda_9f25d4d9c profile

Rebuild It Yourself: Adjusted Prices from Raw Prices, Splits and Dividends

#python #datascience #finance #dataengineering
1
Comments 2
8 min read
Understanding Data governance principles: A junior data engineer’s perspective
kitchen_code profile

Understanding Data governance principles: A junior data engineer’s perspective

#governance #dataengineering #data
Comments 1
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.