DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Storix: One Typed Python Filesystem API from Local Development to Cloud Storage
mghalix profile

Storix: One Typed Python Filesystem API from Local Development to Cloud Storage

#showdev #python #cloud #dataengineering
Comments
16 min read
RAG vs. Semantic Layer: Why AI Needs Deterministic Governance
harshit_colrows profile

RAG vs. Semantic Layer: Why AI Needs Deterministic Governance

#dataengineering #database #ai #datascience
Comments
2 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte #postgres #cdc #dataengineering
Comments
5 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte #dataengineering #elt #python
Comments
5 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte #dataengineering #pgvector #rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api #ai #datascience #dataengineering
Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)
ofirnakdai profile

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

#dataengineering #python #docker #architecture
Comments
2 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile

The Most Underused Prompt in Data Engineering

#ai #productivity #dataengineering #learning
Comments
4 min read
AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves
xbill profile

AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves

#aws #iceberg #lakehouse #dataengineering
Comments 1
8 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss #ai #dataengineering #programming
Comments
5 min read
Python Models: dbt and Interlace, Side by Side
5c4989ca297ed profile

Python Models: dbt and Interlace, Side by Side

#python #opensource #sql #dataengineering
Comments
4 min read
Normalize It, Then Break It On Purpose: 3NF to Star Schema, Explained Through Food Delivery
nbaubek profile

Normalize It, Then Break It On Purpose: 3NF to Star Schema, Explained Through Food Delivery

#dataengineering #sql #datamodeling
Comments 2
10 min read
interlace.sh: The IR Is a sqlglot AST
5c4989ca297ed profile

interlace.sh: The IR Is a sqlglot AST

#sql #opensource #python #dataengineering
Comments
4 min read
I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced
adix65 profile

I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced

#ai #opensource #dataengineering #automation
Comments 1
4 min read
I built a hockey analytics pipeline that scrapes, models, and publishes itself every week — no server, no database
agesatony profile

I built a hockey analytics pipeline that scrapes, models, and publishes itself every week — no server, no database

#showdev #python #dataengineering #githubactions
Comments 1
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.