DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar
ctrix profile

Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar

#postgres #dataengineering #docker #devops
2
Comments
3 min read
đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)
narayan_f8f2c91c99dfd33e6 profile

đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)

#dataengineering #rust #python #performance
1
Comments
2 min read
Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK
andreparis profile

Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK

#aws #dataengineering #typescript #postgres
Comments
8 min read
(â…ˇ) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle
seatunnel profile

(â…ˇ) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle

#datascience #bigdata #datawarehouse #dataengineering
Comments
6 min read
Building Distributed Systems with Ray—Just Like Running a Restaurant
n451m profile

Building Distributed Systems with Ray—Just Like Running a Restaurant

#dataengineering #architecture #tutorial #ray
1
Comments
7 min read
The State of Apache Iceberg v4 - October 2025 Edition
alexmercedcoder profile

The State of Apache Iceberg v4 - October 2025 Edition

#dataengineering #architecture #opensource #database
1
Comments
6 min read
Data Automation: A Deep Dive
amit_c1055f9bc58d1019c6c3 profile

Data Automation: A Deep Dive

#bigdata #dataengineering #data #automation
1
Comments
5 min read
TikTok Data Engineer Full 3-Round Interview
net_programhelp_e160eef28 profile

TikTok Data Engineer Full 3-Round Interview

#interview #dataengineering #tutorial #career
Comments
4 min read
Why Data Partitioning Is Harder Than It Looks
dct_technology profile

Why Data Partitioning Is Harder Than It Looks

#webdev #database #programming #dataengineering
1
Comments
2 min read
Part 2: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake
Comments
8 min read
Collecting Africa’s Energy Insights:
evlyn_njagi_a32f3ab6c984 profile

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python
3
Comments
4 min read
Making JSON Compression Searchable — SEE (Schema-Aware Encoding)
kodomonocch1 profile

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression
1
Comments
2 min read
Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose
eric_kahindi_cfbfda3bd0f7 profile

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

#dataengineering #containers #tutorial #docker
Comments
5 min read
Apache Iceberg Dev List Digest (Sept 15–19, 2025)
alexmercedcoder profile

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

#dataengineering #data #opensource #learning
Comments
3 min read
Data Engineering with Docker: A Hands-On Guide to Containerization
aineahsimiyu profile

Data Engineering with Docker: A Hands-On Guide to Containerization

#docker #containers #dataengineering #automation
7
Comments 2
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.