DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar
ctrix profile

Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar

#postgres #dataengineering #docker #devops
1
Comments
3 min read
đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)
narayan_f8f2c91c99dfd33e6 profile

đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)

#dataengineering #rust #python #performance
Comments
2 min read
Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK
andreparis profile

Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK

#aws #dataengineering #typescript #postgres
Comments
8 min read
Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025
kuldeep_paul profile

Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025

#dataengineering #rag #testing #llm
Comments
10 min read
The State of Apache Iceberg v4 - October 2025 Edition
alexmercedcoder profile

The State of Apache Iceberg v4 - October 2025 Edition

#dataengineering #architecture #opensource #database
1
Comments
6 min read
Data Automation: A Deep Dive
amit_c1055f9bc58d1019c6c3 profile

Data Automation: A Deep Dive

#bigdata #dataengineering #data #automation
Comments
5 min read
TikTok Data Engineer Full 3-Round Interview
net_programhelp_e160eef28 profile

TikTok Data Engineer Full 3-Round Interview

#interview #dataengineering #tutorial #career
Comments
4 min read
Why Data Partitioning Is Harder Than It Looks
dct_technology profile

Why Data Partitioning Is Harder Than It Looks

#webdev #database #programming #dataengineering
1
Comments
2 min read
Part 2: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake
Comments
8 min read
Collecting Africa’s Energy Insights:
evlyn_njagi_a32f3ab6c984 profile

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python
4
Comments
4 min read
Making JSON Compression Searchable — SEE (Schema-Aware Encoding)
kodomonocch1 profile

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression
1
Comments
2 min read
Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose
eric_kahindi_cfbfda3bd0f7 profile

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

#dataengineering #containers #tutorial #docker
Comments
5 min read
Data Engineering with Docker: A Hands-On Guide to Containerization
aineahsimiyu profile

Data Engineering with Docker: A Hands-On Guide to Containerization

#docker #containers #dataengineering #automation
7
Comments 2
3 min read
Understanding the Basics of Linux Operating System
eden_wetende profile

Understanding the Basics of Linux Operating System

#linux #dataengineering #basic
Comments
1 min read
Why you need to learn Apache Airflow - right now
eric_kahindi_cfbfda3bd0f7 profile

Why you need to learn Apache Airflow - right now

#dataengineering #airflow #python
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.