DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Lessons Learned from Building Product Dashboards That Drive Real Decisions
yashraj_2001 profile

Lessons Learned from Building Product Dashboards That Drive Real Decisions

#dataengineering #techleadership #architecture #ai
19
Comments 1
4 min read
Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery
gurudev_prasadteketi profile

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

#dataengineering #analytics #architecture #aws
1
Comments
8 min read
Apache Kafka Deep Dive: Concepts, Applications, and Production
walnold profile

Apache Kafka Deep Dive: Concepts, Applications, and Production

#kafka #eventdriven #zookeeper #dataengineering
Comments
4 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines
harsh9410 profile

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

#ai #kafka #automation #dataengineering
1
Comments
4 min read
A Dive into Apache Iceberg™'s Metadata
thedanicafine profile

A Dive into Apache Iceberg™'s Metadata

#dataengineering #iceberg #database #architecture
Comments 1
4 min read
Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana
oliver_samuel_028c6f65ad6 profile

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python
7
Comments
5 min read
Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer
alexmercedcoder profile

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

#dataengineering #analytics #architecture #ai
1
Comments
3 min read
When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis
qvfagundes profile

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

#datascience #dataengineering #ai
2
Comments
4 min read
đź“Š Understanding 6 Common Data Formats in Data Analytics
rethan_kumarcv_c7864238f profile

đź“Š Understanding 6 Common Data Formats in Data Analytics

#dataengineering #analytics #datascience #database
Comments
4 min read
⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast
leosuky profile

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

#dataengineering #webscraping #python #webdev
2
Comments 1
3 min read
Introduction to Apache Kafka for Beginners
mutindakioko profile

Introduction to Apache Kafka for Beginners

#kafka #dataengineering #tutorial #beginners
1
Comments
5 min read
Introduction to Apache Airflow
mutindakioko profile

Introduction to Apache Airflow

#dataengineering #beginners #learning #python
2
Comments
4 min read
Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices
kemboijebby profile

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

#dataengineering #programming #ai
1
Comments
4 min read
Apache Iceberg Dev List Digest August 25-29
alexmercedcoder profile

Apache Iceberg Dev List Digest August 25-29

#database #datascience #dataengineering
Comments
5 min read
How I Built a MongoDB Archiving System for Crawled Data
pradippanjiyar profile

How I Built a MongoDB Archiving System for Crawled Data

#dataengineering #database #architecture #mongodb
1
Comments 2
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.