DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why Data Partitioning Is Harder Than It Looks
dct_technology profile

Why Data Partitioning Is Harder Than It Looks

#webdev #database #programming #dataengineering
1
Comments
2 min read
Part 2: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake
Comments
8 min read
Collecting Africa’s Energy Insights:
evlyn_njagi_a32f3ab6c984 profile

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python
4
Comments
4 min read
Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose
eric_kahindi_cfbfda3bd0f7 profile

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

#dataengineering #containers #tutorial #docker
Comments
5 min read
Making JSON Compression Searchable — SEE (Schema-Aware Encoding)
kodomonocch1 profile

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression
1
Comments
2 min read
Data Engineering with Docker: A Hands-On Guide to Containerization
aineahsimiyu profile

Data Engineering with Docker: A Hands-On Guide to Containerization

#docker #containers #dataengineering #automation
7
Comments 2
3 min read
Understanding the Basics of Linux Operating System
eden_wetende profile

Understanding the Basics of Linux Operating System

#linux #dataengineering #basic
Comments
1 min read
Why you need to learn Apache Airflow - right now
eric_kahindi_cfbfda3bd0f7 profile

Why you need to learn Apache Airflow - right now

#dataengineering #airflow #python
Comments
3 min read
Lessons Learned from Building Product Dashboards That Drive Real Decisions
yashraj_2001 profile

Lessons Learned from Building Product Dashboards That Drive Real Decisions

#dataengineering #techleadership #architecture #ai
19
Comments 1
4 min read
Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery
gurudev_prasadteketi profile

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

#dataengineering #analytics #architecture #aws
1
Comments
8 min read
Apache Kafka Deep Dive: Concepts, Applications, and Production
walnold profile

Apache Kafka Deep Dive: Concepts, Applications, and Production

#kafka #eventdriven #zookeeper #dataengineering
Comments
4 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines
harsh9410 profile

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

#ai #kafka #automation #dataengineering
2
Comments 1
4 min read
A Dive into Apache Iceberg™'s Metadata
thedanicafine profile

A Dive into Apache Iceberg™'s Metadata

#dataengineering #iceberg #database #architecture
Comments 1
4 min read
Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana
oliver_samuel_028c6f65ad6 profile

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python
7
Comments
5 min read
When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis
fagundesv profile

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

#datascience #dataengineering #ai
2
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.