Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Part 4 - Airflow Runtime and Shared Config ⚙️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 4 - Airflow Runtime and Shared Config ⚙️
#
architecture
#
automation
#
dataengineering
#
python
Comments
Add Comment
2 min read
Part 9 - dbt Project Setup and Contracts 🧱
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 9 - dbt Project Setup and Contracts 🧱
#
database
#
dataengineering
#
postgres
#
tutorial
Comments
Add Comment
1 min read
Part 2 - Data Sources and Domain Model 📡
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 2 - Data Sources and Domain Model 📡
#
api
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 1 - Introduction and End-to-End Architecture
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 1 - Introduction and End-to-End Architecture
#
architecture
#
data
#
dataengineering
#
tutorial
Comments
Add Comment
2 min read
Part 8 - Staging Load into Postgres 🗃️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 8 - Staging Load into Postgres 🗃️
#
database
#
dataengineering
#
postgres
#
tutorial
Comments
Add Comment
2 min read
Part 3 - Station Sampling and Cache Building 🗂️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 3 - Station Sampling and Cache Building 🗂️
#
api
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
4x Faster Redshift Reads With One Line of Python
abdu masah
abdu masah
abdu masah
Follow
Apr 21
4x Faster Redshift Reads With One Line of Python
#
python
#
aws
#
dataengineering
#
opensource
Comments
Add Comment
3 min read
greatCircleDistance in ClickHouse: Avoiding Full Table Scans
Mohamed Hussain S
Mohamed Hussain S
Mohamed Hussain S
Follow
Apr 20
greatCircleDistance in ClickHouse: Avoiding Full Table Scans
#
clickhouse
#
sql
#
dataengineering
#
performance
2
reactions
Comments
Add Comment
2 min read
What Is Data Downtime and How Do You Measure It?
Blaine Elliott
Blaine Elliott
Blaine Elliott
Follow
Apr 20
What Is Data Downtime and How Do You Measure It?
#
dataengineering
#
dataquality
Comments
Add Comment
15 min read
Kafka Consumer Patterns: What You Actually Need in Production
Sneha Wasankar
Sneha Wasankar
Sneha Wasankar
Follow
Apr 20
Kafka Consumer Patterns: What You Actually Need in Production
#
architecture
#
dataengineering
#
distributedsystems
#
systemdesign
1
reaction
Comments
Add Comment
3 min read
Part 13 - Local Development and Docker Compose 🐳
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 13 - Local Development and Docker Compose 🐳
#
dataengineering
#
devops
#
docker
#
tutorial
Comments
Add Comment
1 min read
Part 10 - Base Model and Data Quality ✅
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 10 - Base Model and Data Quality ✅
#
data
#
dataengineering
#
sql
#
tutorial
Comments
Add Comment
1 min read
Your Serverless Data Lake is Lying to You (Add Observability or Lose Data)
Rocio Baigorria
Rocio Baigorria
Rocio Baigorria
Follow
Apr 20
Your Serverless Data Lake is Lying to You (Add Observability or Lose Data)
#
aws
#
dataengineering
#
serverless
#
observability
Comments
Add Comment
2 min read
Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You
Du Tran
Du Tran
Du Tran
Follow
Apr 20
Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You
#
iceberg
#
dataengineering
#
aws
#
python
Comments
Add Comment
6 min read
ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng
ITPrep
ITPrep
ITPrep
Follow
Apr 20
ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng
#
dataengineering
#
systemdesign
#
ai
#
workflow
Comments
Add Comment
2 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account