DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Data Engineering Dropped DSA. What Replaced It Is Worse.
datadriven profile

Data Engineering Dropped DSA. What Replaced It Is Worse.

#dataengineering #interview #career #beginners
Comments
7 min read
Parsing financial PDFs without chasing 100% accuracy
strelok25dev profile

Parsing financial PDFs without chasing 100% accuracy

#python #pdf #dataengineering #pydantic
3
Comments
4 min read
Synthetic Time Series Data: A Practical Guide META
thiam_lee profile

Synthetic Time Series Data: A Practical Guide META

#ai #database #machinelearning #dataengineering
Comments
6 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough
flarco profile

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

#mysql #dataengineering #etl #database
Comments 1
8 min read
Data Pipelines Explained: Benefits, Types, and Use Cases
sergiiklius profile

Data Pipelines Explained: Benefits, Types, and Use Cases

#dataengineering #datascience #automation #tutorial
Comments
4 min read
The fastest Glue job is the one you never start: removing per-job overhead from a 191-job pipeline
kiran_gunturu_022085015ec profile

The fastest Glue job is the one you never start: removing per-job overhead from a 191-job pipeline

#aws #dataengineering #serverless #performance
Comments
8 min read
dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.
eu_ti_f127c5b5d7535b7174f profile

dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

#dataengineering #sql #python #architecture
Comments
4 min read
Building a real-time price monitoring pipeline that does not poison your data
anakin_writers profile

Building a real-time price monitoring pipeline that does not poison your data

#webdev #dataengineering #scraping #analytics
Comments
4 min read
The AI Loop That Won't Let You Go - Victor Amit
victoramit profile

The AI Loop That Won't Let You Go - Victor Amit

#ai #machinelearning #dataengineering #opensource
1
Comments
20 min read
Building an investing knowledge graph, part 3: same company, seven names
hannune profile

Building an investing knowledge graph, part 3: same company, seven names

#graphdb #knowledgegraph #dataengineering #entityresolution
2
Comments
4 min read
Why a Numaflow watermark wouldn’t move
akarazhev profile

Why a Numaflow watermark wouldn’t move

#dataengineering #distributedsystems #rust #opensource
Comments
7 min read
Your ERP says the job was profitable. Your machines disagree.
trcollinson profile

Your ERP says the job was profitable. Your machines disagree.

#aws #manufacturing #dataengineering #athena
2
Comments 2
16 min read
The Pipeline Worked. Then the Research Outgrew It.
daemonic01 profile

The Pipeline Worked. Then the Research Outgrew It.

#dataengineering #python #programming #productivity
Comments
4 min read
Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained
arpitmbangre profile

Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained

#database #sql #dataengineering #performance
Comments
2 min read
Why Data Reconciliation Matters in AWS Glue: Finding Missing Records with Anti Joins
rahul_r15 profile

Why Data Reconciliation Matters in AWS Glue: Finding Missing Records with Anti Joins

#dataengineering #bigdata #aws #python
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.