DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I generated 500 messy scraped leads and tried to clean them: what broke
lbishopdev profile

I generated 500 messy scraped leads and tried to clean them: what broke

#webscraping #dataengineering #typescript #apify
1
Comments 4
7 min read
Public Web Data Is Useful When You Treat It Like a Pipeline
anakin_writers profile
Anakin

Public Web Data Is Useful When You Treat It Like a Pipeline

#webscraping #dataengineering #python #automation
Comments
5 min read
Hello World !
chethancr_13 profile

Hello World !

#architecture #backend #dataengineering #systemdesign
Comments
1 min read
SQL Query Execution Order: Why Your Query Doesn't Run Top-to-Bottom
neha_christina_1ac8651819 profile

SQL Query Execution Order: Why Your Query Doesn't Run Top-to-Bottom

#sql #dataengineering #beginners #tutorial
Comments 1
4 min read
Parsing financial statement PDFs: parentheses, comparative columns and subtotal checks
damin_mutti_e213ac1a11bf4 profile

Parsing financial statement PDFs: parentheses, comparative columns and subtotal checks

#python #pdf #dataengineering #accounting
1
Comments 1
6 min read
DuckLake 1.0 and Iceberg 1.11: What a Data Engineer Should Know
datadriven profile

DuckLake 1.0 and Iceberg 1.11: What a Data Engineer Should Know

#dataengineering #database #career #interview
Comments
9 min read
Building Verifiable Blockchain Metrics: The Evidence Architecture Behind Voxonomics
voxonomicshq profile

Building Verifiable Blockchain Metrics: The Evidence Architecture Behind Voxonomics

#blockchain #web3 #dataengineering #fintech
Comments
6 min read
Product Matching Is Mostly About Avoiding Confident Wrong Answers
anakin_writers profile
Anakin

Product Matching Is Mostly About Avoiding Confident Wrong Answers

#ecommerce #python #dataengineering #machinelearning
Comments
5 min read
Como aprendi Apache Spark — Parte 1: Por que o Spark mudou o processamento de Big Data
renanpyd profile

Como aprendi Apache Spark — Parte 1: Por que o Spark mudou o processamento de Big Data

#spark #dataengineering #bigdata #python
1
Comments
7 min read
Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime
kaviwrites profile

Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime

#dataengineering #etl #palantir #python
Comments
9 min read
Three months of sales vanished, and every dbt run was green
vijaykumar13 profile

Three months of sales vanished, and every dbt run was green

#dbt #snowflake #dataengineering #sql
Comments
5 min read
Como aprendi Apache Spark: revisitando uma jornada pela Engenharia de Dados
renanpyd profile

Como aprendi Apache Spark: revisitando uma jornada pela Engenharia de Dados

#spark #bigdata #dataengineering #opensource
1
Comments
4 min read
Your data engineer job description is trying to hire a team
sudeephazra profile

Your data engineer job description is trying to hire a team

#dataengineering #recruitment #interview
Comments
6 min read
Change Data Capture is the modern default for keeping systems in sync — challenged
letusai15 profile

Change Data Capture is the modern default for keeping systems in sync — challenged

#dataengineering #systemdesign #kafka #webdev
Comments
1 min read
How AI can investigate a 12 GB export without reading it into a prompt
jerry_king_d0ee94a9bca82f profile

How AI can investigate a 12 GB export without reading it into a prompt

#dataengineering #sql #ai #parquet
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.