Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Rohit Chaurasia

Oct 6

I scanned 1,152 dbt models for joins that inflate SUM. Here is what I found.

#sql #dbt #dataengineering #opensource

3 min read

dino david

Sep 23

What a Delta table actually is: Parquet files plus a transaction log

#deltalake #databricks #dataengineering #bigdata

3 min read

William Rodriguez

Sep 27

Rastreo forense y resiliencia en pipelines: Reemplazando logs efímeros con checkpoints SQLite

#dataengineering

2 min read

William Rodriguez

Sep 27

Forensic tracking & resiliency in pipelines: Replacing ephemeral logs with SQLite checkpoints

#dataengineering

2 min read

Abdulwahab

Sep 27

Normalizing public job-board data with Python

#python #api #tutorial #dataengineering

12 min read

FetchSmith

Sep 23

We nearly charged our own buyers twice for rows they'd already paid for

#webscraping #dataengineering #api #javascript

4 min read

Cristhian Carlos MAMANI CORI

Oct 26

Building an Automated Weather Data Pipeline with Python, DuckDB, dbt, and GitHub Actions

#dataengineering

5 min read

Khalif Umar

Sep 23

Data Engineering: Pahlawan Tanpa Tanda Jasa di Balik Era Big Data - 22:09

#ai #dataengineering #data

2 min read

Malavnaik

Oct 26

I Built a Tested Data Pipeline for Dublin Bikes, for €0

#dataengineering #dbt #duckdb #python

3 min read

Gowtham Potureddi

Oct 26

Designing a movie ticket booking system: the low-level design interview, explained

#walkin #interview #designsystem #dataengineering

16 min read

certificationmantra

Oct 26

AWS Glue Job Bookmarks Explained: Build Incremental ETL Pipelines with PySpark

#aws #dataengineering #tutorial #python

7 min read

Tae Kim

Sep 22

What Splink actually runs on DuckDB when it scores entity pairs

#entityresolution #duckdb #dataengineering #python

2 min read

Khalif Umar

Sep 22

Masa Depan Manajemen Data: Mengenal Konsep Data Mesh yang Revolusioner

#architecture #data #dataengineering #systemdesign

2 min read

dino david

Sep 21

Databricks classic vs serverless compute: the limitation list decides it

#databrick #azure #dataengineering #cloud

2 min read

Mohamed Said

Sep 21

Spark Is a Smart Engine. So Why Doesn't It Cache Automatically?

#dataengineering #spark #caching

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.