DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
One Bug Hit 11 Rows. Another Hit 36 Million.
arthurtorres profile

One Bug Hit 11 Rows. Another Hit 36 Million.

#dataengineering #python #pandas #datascience
Comments
4 min read
Why CTE vs Subquery Matters More on Redshift Than Anywhere Else
maithreyan11 profile

Why CTE vs Subquery Matters More on Redshift Than Anywhere Else

#redshift #sql #dataengineering #aws
Comments
2 min read
Storix: One Typed Python Filesystem API from Local Development to Cloud Storage
mghalix profile

Storix: One Typed Python Filesystem API from Local Development to Cloud Storage

#showdev #python #cloud #dataengineering
Comments
16 min read
RAG vs. Semantic Layer: Why AI Needs Deterministic Governance
harshit_colrows profile

RAG vs. Semantic Layer: Why AI Needs Deterministic Governance

#dataengineering #database #ai #datascience
Comments
2 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte #dataengineering #elt #python
Comments
5 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte #postgres #cdc #dataengineering
Comments
5 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte #dataengineering #pgvector #rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api #ai #datascience #dataengineering
Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)
ofirnakdai profile

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

#dataengineering #python #docker #architecture
Comments
2 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile

The Most Underused Prompt in Data Engineering

#ai #productivity #dataengineering #learning
Comments
4 min read
AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves
xbill profile

AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves

#aws #iceberg #lakehouse #dataengineering
Comments 1
8 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss #ai #dataengineering #programming
Comments
5 min read
Python Models: dbt and Interlace, Side by Side
5c4989ca297ed profile

Python Models: dbt and Interlace, Side by Side

#python #opensource #sql #dataengineering
Comments
4 min read
Normalize It, Then Break It On Purpose: 3NF to Star Schema, Explained Through Food Delivery
nbaubek profile

Normalize It, Then Break It On Purpose: 3NF to Star Schema, Explained Through Food Delivery

#dataengineering #sql #datamodeling
Comments 2
10 min read
interlace.sh: The IR Is a sqlglot AST
5c4989ca297ed profile

interlace.sh: The IR Is a sqlglot AST

#sql #opensource #python #dataengineering
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.