DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Migrate Azure Data Factory to Fabric in 2026 (what the built-in tool actually does)
azurepipelinenotes profile

Migrate Azure Data Factory to Fabric in 2026 (what the built-in tool actually does)

#azure #dataengineering #microsoftfabric #cloud
Comments
7 min read
How We Built a Zero-Cost Unchanged Run SEC Enforcement API
stefanoseggio profile

How We Built a Zero-Cost Unchanged Run SEC Enforcement API

#webscraping #python #dataengineering #api
1
Comments
3 min read
The Data Modeling Concepts Nobody Mentions After Star Schema 101
rahmanfrr profile

The Data Modeling Concepts Nobody Mentions After Star Schema 101

#dataengineering #datamodeling #sql #tutorial
1
Comments
6 min read
Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases
adev3loper profile

Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases

#dataengineering #airflow #python #orchestration
Comments
11 min read
A rival's price was nested two dicts deep — and the obvious min() read 20 competitors as free
fetchsmith profile

A rival's price was nested two dicts deep — and the obvious min() read 20 competitors as free

#webscraping #api #javascript #dataengineering
Comments 1
7 min read
The site said 141 listings. I delivered 109. It was 100%.
bpx13303 profile
Hugo.H

The site said 141 listings. I delivered 109. It was 100%.

#webscraping #dataengineering #dataquality #automation
1
Comments 2
3 min read
A cache key ate 99.9% of my records and the pipeline looked green
kyien profile

A cache key ate 99.9% of my records and the pipeline looked green

#dataengineering #python #architecture #sql
Comments
5 min read
SqlJam: Move Tables Across Databases with Schema, Data and All
paganini2008 profile

SqlJam: Move Tables Across Databases with Schema, Data and All

#database #java #sql #dataengineering
Comments
9 min read
Data Engineering Dropped DSA. What Replaced It Is Worse.
datadriven profile

Data Engineering Dropped DSA. What Replaced It Is Worse.

#dataengineering #interview #career #beginners
Comments
7 min read
Parsing financial PDFs without chasing 100% accuracy
strelok25dev profile

Parsing financial PDFs without chasing 100% accuracy

#python #pdf #dataengineering #pydantic
3
Comments
4 min read
Synthetic Time Series Data: A Practical Guide META
thiam_lee profile

Synthetic Time Series Data: A Practical Guide META

#ai #database #machinelearning #dataengineering
Comments
6 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough
flarco profile

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

#mysql #dataengineering #etl #database
Comments 1
8 min read
Data Pipelines Explained: Benefits, Types, and Use Cases
sergiiklius profile

Data Pipelines Explained: Benefits, Types, and Use Cases

#dataengineering #datascience #automation #tutorial
Comments
4 min read
The fastest Glue job is the one you never start: removing per-job overhead from a 191-job pipeline
kiran_gunturu_022085015ec profile

The fastest Glue job is the one you never start: removing per-job overhead from a 191-job pipeline

#aws #dataengineering #serverless #performance
Comments
8 min read
dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.
eu_ti_f127c5b5d7535b7174f profile

dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

#dataengineering #sql #python #architecture
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.