Dataengineering - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

vsangaraju

Oct 22

The demo works. Production doesn't: what breaks when you put an LLM on your company's data

#googlecloud #ai #dataengineering #llm

4 min read

elliot hutchins

Oct 22

Your AI Agent Probably Belongs in the Data Pipeline

#ai #database #dataengineering #datascience

6 min read

Maksim Grishchenko

Oct 22

Why I am scared of complex nested JSON

#clickhouse #dataengineering #sql #kafka

7 min read

PlantWired

Oct 22

MQTT brokers and UNS plumbing: 8 side-by-side comparisons

#mqtt #iot #industrialautomation #dataengineering

2 min read

Susanth P

Oct 22

Turning Reddit threads into RAG-ready Markdown

#python #dataengineering #rag #tutorial

3 min read

Oct 22

To SQL or to Python; there is another problem

#dataengineering #python #sql

6 min read

Oct 22

A backfill can match row counts and totals while still being wrong

#dataengineering #python #testing

4 min read

Oct 22

A deleted CDC row still needs a version: a Python counterexample

#dataengineering #python #testing

4 min read

Oct 22

An old event timestamp can still leak future information into training data

#dataengineering #sql #machinelearning #python

4 min read

Oct 22

BETWEEN can double-count a fact at an SCD2 version boundary

#sql #dataengineering #sqlite #testing

4 min read

Oct 22

Data platform teams are becoming exception handlers

#career #dataengineering #softwareengineering

7 min read

Damin Mutti for ZeraBooks

Oct 22

Proving a parsed brokerage statement: the cash check and the position check in Python

#python #fintech #dataengineering #accounting

4 min read

Oct 22

Delta Lake Table Maintenance on Databricks: OPTIMIZE, Z-ORDER vs Liquid Clustering, and VACUUM

#databricks #deltalake #dataengineering #pyspark

6 min read

Oct 22

Parsing money in Python: reject bad precision before choosing how to round

#python #dataengineering #testing

4 min read

Oct 22

Replaying payment events: test the second run, not just the first

#dataengineering

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.