Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

joni sar

Sep 24

Apache Iceberg Query Optimization: Production Guide

#iceberg #dataengineering #snowflake #sql

40 min read

Aztec-code

Sep 23

Bulk YouTube transcript extraction for AI pipelines: what breaks at scale

#youtube #rag #api #dataengineering

4 min read

joni sar

Sep 23

Apache Iceberg Governance: Access Control, Policies, and Audit for Open Lakehouses

#iceberg #dataengineering #governance #lakehouse

19 min read

Anakin

Sep 23

Price matching is a bad default: model the pricing decision instead

#pricing #python #dataengineering #retail

5 min read

dino david

Sep 23

What a Delta table actually is: Parquet files plus a transaction log

#deltalake #databricks #dataengineering #bigdata

3 min read

FetchSmith

Sep 23

We nearly charged our own buyers twice for rows they'd already paid for

#webscraping #dataengineering #api #javascript

4 min read

Khalif Umar

Sep 23

Data Engineering: Pahlawan Tanpa Tanda Jasa di Balik Era Big Data - 22:09

#ai #dataengineering #data

2 min read

Tae Kim

Sep 22

What Splink actually runs on DuckDB when it scores entity pairs

#entityresolution #duckdb #dataengineering #python

2 min read

Khalif Umar

Sep 22

Masa Depan Manajemen Data: Mengenal Konsep Data Mesh yang Revolusioner

#architecture #data #dataengineering #systemdesign

2 min read

dino david

Sep 21

Databricks classic vs serverless compute: the limitation list decides it

#databrick #azure #dataengineering #cloud

2 min read

Mohamed Said

Sep 21

Spark Is a Smart Engine. So Why Doesn't It Cache Automatically?

#dataengineering #spark #caching

3 min read

The Data Nerd

Sep 21

We published our fundraising-prediction model and its misses. Here's what 219 rounds taught us.

#dataengineering #machinelearning #opensource #startup

3 min read

FetchSmith

Sep 21

We timed HTTP-only scraping against a headless browser on the same page. It wasn't close.

#webscraping #dataengineering #api #javascript

4 min read

Bechir Bejaoui

Sep 20

Clean a million rows with Hydra ETL — no database, no Docker

#dataengineering #python #rust #tutorial

6 min read

dino david

Sep 20

Databricks accounts, workspaces and metastores: which layer owns what

#databrick #dataengineering #azure #beginners

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.