DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The Embedding Model Invalidation Trap: Why Swapping Models Destroys RAG
asifmiqbal profile

The Embedding Model Invalidation Trap: Why Swapping Models Destroys RAG

#ai #architecture #security #dataengineering
Comments
5 min read
How to Install Dagster: WSL & Native Windows Guide for Beginners (Using pip)
msnmongare profile

How to Install Dagster: WSL & Native Windows Guide for Beginners (Using pip)

#powerplatform #data #dataengineering
Comments
4 min read
How to Build Trust in Airline Schedule Data at Scale: A Data Quality Guide
airtruffle profile

How to Build Trust in Airline Schedule Data at Scale: A Data Quality Guide

#dataquality #airlinedata #dataengineering #traveltechnology
Comments
8 min read
5 SQL window-function traps that show up in data engineering interviews (with runnable DuckDB examples)
itcraftsman profile

5 SQL window-function traps that show up in data engineering interviews (with runnable DuckDB examples)

#sql #dataengineering #duckdb #interview
Comments 3
4 min read
The Hard Truth About Data Engineering Interviews Nobody Tells You
rahmanfrr profile

The Hard Truth About Data Engineering Interviews Nobody Tells You

#dataengineering #interview #career #sql
Comments 1
5 min read
Cleaning Messy Datasets: A Guide to Pandas wide_to_long
samuelhunt profile

Cleaning Messy Datasets: A Guide to Pandas wide_to_long

#python #pandas #tutorial #dataengineering
Comments 1
3 min read
Why Learning Data Engineering Is Still a Smart Bet in 2026 (Even With AI Eating the Easy Parts)
rahmanfrr profile

Why Learning Data Engineering Is Still a Smart Bet in 2026 (Even With AI Eating the Easy Parts)

#dataengineering #career #sql #ai
Comments 1
2 min read
Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level Attribution
aidatalegends profile

Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level Attribution

#costoptimization #dataengineering #databricks #finops
1
Comments 1
3 min read
An AI-Assisted Development Methodology, Earned from Real Incidents
antonio_zhu_e726fd856cd86 profile

An AI-Assisted Development Methodology, Earned from Real Incidents

#vibecoding #softwareengineering #dataengineering
Comments 2
25 min read
Fresh Enough for an AI Agent? The Data Freshness Budget Nobody Defines
andrew_tan_layline profile

Fresh Enough for an AI Agent? The Data Freshness Budget Nobody Defines

#agents #dataengineering
Comments
6 min read
Why Using FLOAT for Financial Pipelines is a Silent $100k Trap (and How PostgreSQL NUMERIC Saves Your Ledger)
arpitmbangre profile

Why Using FLOAT for Financial Pipelines is a Silent $100k Trap (and How PostgreSQL NUMERIC Saves Your Ledger)

#sql #datascience #database #dataengineering
Comments
2 min read
PyArrow, Explained: How Zero-Copy Actually Works, and Why It's Everywhere
nbaubek profile

PyArrow, Explained: How Zero-Copy Actually Works, and Why It's Everywhere

#dataengineering #python #bigdata #pyarrow
Comments
10 min read
Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.
firfircelik profile

Python 3.15 Is Not a Speed Release for Data Teams. It Is an Operations Release.

#python #dataengineering #performance #security
Comments 1
16 min read
Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases.
gacherimutua profile

Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases.

#dataengineering #airflow
Comments
3 min read
Mask, Hash, Tokenize, or Encrypt? Choosing the Right PII Protection for Your Pipeline
nbaubek profile

Mask, Hash, Tokenize, or Encrypt? Choosing the Right PII Protection for Your Pipeline

#dataengineering #security #dataprivacy #gdpr
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.