DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines
nbaubek profile

You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines

#dataengineering #python #dataprivacy #gdpr
Comments
8 min read
I Built a Data Quality Library Because Existing Tools Were Too Slow for My Pipelines
vladislav_koval_f4bed0e76 profile

I Built a Data Quality Library Because Existing Tools Were Too Slow for My Pipelines

#dataengineering #python #dataquality #bigquery
Comments 1
3 min read
Apache Data Lakehouse Weekly: September 3-9, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: September 3-9, 2026

#bigdata #database #dataengineering #rust
Comments 1
25 min read
Avro schemas for Kafka developers: the 10-minute practical guide
yuus_company profile

Avro schemas for Kafka developers: the 10-minute practical guide

#kafka #avro #dataengineering #tutorial
Comments
2 min read
The hardest label in our dataset is the one where nothing happened
inve_money_e95961f8489d28 profile

The hardest label in our dataset is the one where nothing happened

#datascience #dataengineering #analytics #sql
Comments
14 min read
Scraped Data Change Detection: From Snapshots to Reliable Alerts
aqib_javaid profile

Scraped Data Change Detection: From Snapshots to Reliable Alerts

#webscraping #laravel #dataengineering #php
Comments
8 min read
Recursive CTEs, explained from first principles
sophiemwangi profile

Recursive CTEs, explained from first principles

#sql #cte #dataengineering #datascience
3
Comments 2
5 min read
What One Rust Client Can Reach Across Seven Iceberg Catalogs
xbill profile

What One Rust Client Can Reach Across Seven Iceberg Catalogs

#rust #iceberg #lakehouse #dataengineering
8
Comments
11 min read
I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced
adix65 profile

I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced

#ai #opensource #dataengineering #automation
Comments
4 min read
Best Dimensional Data Modeling Tools: erwin Data Modeler Features & Alternatives
rutadbm profile

Best Dimensional Data Modeling Tools: erwin Data Modeler Features & Alternatives

#data #database #dataengineering #tools
Comments
11 min read
SQL DATEDIFF Internals: Why 2 Seconds Can Equal 1 Full Day (Boundary Traps)
arpitmbangre profile

SQL DATEDIFF Internals: Why 2 Seconds Can Equal 1 Full Day (Boundary Traps)

#sql #database #dataengineering #beginners
Comments
2 min read
Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem
anakin_writers profile
Anakin

Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem

#dataengineering #webscraping #postgres #architecture
Comments
4 min read
Dissecting Semantica’s Graph-Native Core: The Missing Layer Between Context and Accountability
james_lin profile

Dissecting Semantica’s Graph-Native Core: The Missing Layer Between Context and Accountability

#python #knowledgegraph #ai #dataengineering
Comments
2 min read
Migrating Petabyte-Scale Parquet to Iceberg Without Dropping a Single Row
aniketsoni profile

Migrating Petabyte-Scale Parquet to Iceberg Without Dropping a Single Row

#dataengineering #iceberg #infrastructure #databricks
1
Comments
4 min read
Scaling beyond visual entropy: Moving from Make to Python orchestration with wpipe
william_rodriguez_65a5898 profile

Scaling beyond visual entropy: Moving from Make to Python orchestration with wpipe

#dataengineering
Comments 1
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.