Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Part 7 - Spark Transform Local vs Cloud ⚡
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 7 - Spark Transform Local vs Cloud ⚡
#
aws
#
cloud
#
dataengineering
#
tutorial
Comments
Add Comment
2 min read
Part 5 - Ingestion DAG and Raw Storage 📥
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 5 - Ingestion DAG and Raw Storage 📥
#
automation
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 3 - Station Sampling and Cache Building 🗂️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 3 - Station Sampling and Cache Building 🗂️
#
api
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 14 - Cloud Deployment and Lessons Learned ☁️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 14 - Cloud Deployment and Lessons Learned ☁️
#
aws
#
dataengineering
#
devops
#
terraform
Comments
Add Comment
2 min read
Part 12 - Superset Seeding and Dashboards 🎛️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 12 - Superset Seeding and Dashboards 🎛️
#
automation
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
What Is Data Downtime and How Do You Measure It?
Blaine Elliott
Blaine Elliott
Blaine Elliott
Follow
Apr 20
What Is Data Downtime and How Do You Measure It?
#
dataengineering
#
dataquality
Comments
Add Comment
15 min read
Kafka Consumer Patterns: What You Actually Need in Production
Sneha Wasankar
Sneha Wasankar
Sneha Wasankar
Follow
Apr 20
Kafka Consumer Patterns: What You Actually Need in Production
#
architecture
#
dataengineering
#
distributedsystems
#
systemdesign
1
reaction
Comments
Add Comment
3 min read
Part 10 - Base Model and Data Quality ✅
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 10 - Base Model and Data Quality ✅
#
data
#
dataengineering
#
sql
#
tutorial
Comments
Add Comment
1 min read
Part 13 - Local Development and Docker Compose 🐳
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 13 - Local Development and Docker Compose 🐳
#
dataengineering
#
devops
#
docker
#
tutorial
Comments
Add Comment
1 min read
Building a Daily Data Pipeline That Survives Market Holidays
Stock Expert AI
Stock Expert AI
Stock Expert AI
Follow
May 24
Building a Daily Data Pipeline That Survives Market Holidays
#
automation
#
dataengineering
#
python
#
tutorial
1
reaction
Comments
Add Comment
2 min read
Deeper into Dataform 2: Other API features
Ben Watson
Ben Watson
Ben Watson
Follow
May 24
Deeper into Dataform 2: Other API features
#
dataform
#
dataengineering
#
gcp
#
bigquery
1
reaction
Comments
Add Comment
1 min read
Deeper into Dataform 1: Exploring the API
Ben Watson
Ben Watson
Ben Watson
Follow
May 24
Deeper into Dataform 1: Exploring the API
#
dataform
#
dataengineering
#
gcp
#
bigquery
Comments
Add Comment
3 min read
Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You
Du Tran
Du Tran
Du Tran
Follow
Apr 20
Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You
#
iceberg
#
dataengineering
#
aws
#
python
Comments
Add Comment
6 min read
ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng
ITPrep
ITPrep
ITPrep
Follow
Apr 20
ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng
#
dataengineering
#
systemdesign
#
ai
#
workflow
Comments
Add Comment
2 min read
FSx for ONTAP S3 Access Points Lakehouse — What Works, What Doesn't, and Why
Yoshiki Fujiwara(藤原 善基)@AWS Community Builder
Yoshiki Fujiwara(藤原 善基)@AWS Community Builder
Yoshiki Fujiwara(藤原 善基)@AWS Community Builder
Follow
for
AWS Community Builders
May 24
FSx for ONTAP S3 Access Points Lakehouse — What Works, What Doesn't, and Why
#
aws
#
amazonfsxfornetappontap
#
lakehouse
#
dataengineering
Comments
Add Comment
16 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account