DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Data in the Cloud: 6 Common Formats for Data Analytics
harish_b_0079384348ed66e9 profile

Data in the Cloud: 6 Common Formats for Data Analytics

#dataanalytics #python #dataengineering #bigdata
Comments
3 min read
Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT
devcorner profile

Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT

#architecture #dataengineering #systemdesign
Comments
11 min read
Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana
oliver_samuel_028c6f65ad6 profile

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python
Comments
5 min read
Data Formats Used in Data Analytics
hindu_narmatha_132a576713 profile

Data Formats Used in Data Analytics

#python #dataengineering
Comments
3 min read
Day 1 Internship Report
navashub profile

Day 1 Internship Report

#showdev #dataengineering #mongodb
Comments
4 min read
⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast
leosuky profile

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

#dataengineering #webscraping #python #webdev
Comments
3 min read
When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis
qvfagundes profile

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

#datascience #dataengineering #ai
Comments
4 min read
Self-Adapting Data Pipelines: The Intelligent Future of Data Engineering
devnotes profile

Self-Adapting Data Pipelines: The Intelligent Future of Data Engineering

#ai #architecture #dataengineering
Comments
17 min read
Understanding Data Formats in Cloud & Data Analytics
prakalya_sambathkumar_54e profile

Understanding Data Formats in Cloud & Data Analytics

#cloud #dataengineering #datascience
Comments
3 min read
Data in Cloud
sugithaa_k profile

Data in Cloud

#cloud #data #dataengineering
Comments
4 min read
📊 Understanding 6 Common Data Formats in Data Analytics
rethan_kumarcv_c7864238f profile

📊 Understanding 6 Common Data Formats in Data Analytics

#dataengineering #analytics #datascience #database
5
Comments
4 min read
How I Used AWS Glue and Athena for Serverless Data Analytics
nidhi_0105 profile

How I Used AWS Glue and Athena for Serverless Data Analytics

#dataengineering #analytics #serverless #aws
2
Comments
2 min read
Dockerized Spark and Kafka: YouTube Data Pipeline Implementation
lagat_josiah_f024a2c855bc profile

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

#dataengineering #architecture #docker #tutorial
Comments
7 min read
# Data Ingestion & Vector Store #llmszoomcamp
abdelrahman_adnan profile

# Data Ingestion & Vector Store #llmszoomcamp

#python #dataengineering #rag #llm
Comments
2 min read
Database Fundamentals
gilbert_korir profile

Database Fundamentals

#postgressql #sql #nosql #dataengineering
Comments
3 min read
🧑‍💻 Apache Kafka CLI – Detailed Course
nk_sk_6f24fdd730188b284bf profile
nk sk

🧑‍💻 Apache Kafka CLI – Detailed Course

#cli #dataengineering #tutorial
Comments
2 min read
Create a Microsoft Fabric Lakehouse
lotanna_obianefo profile

Create a Microsoft Fabric Lakehouse

#database #dataengineering #cloudcomputing #datascience
5
Comments
6 min read
Core Concepts of Kafka
farhan_khan_41ec7ff11ac1d profile

Core Concepts of Kafka

#architecture #beginners #dataengineering
Comments
8 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.
elisha_lukalia_f382f081a0 profile

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

#dataengineering #automation #tutorial #sql
Comments
9 min read
Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches
herasimau profile

Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches

#architecture #backend #dataengineering
Comments
6 min read
Introduction to Apache Kafka for Beginners
mutindakioko profile

Introduction to Apache Kafka for Beginners

#kafka #dataengineering #tutorial #beginners
Comments
5 min read
Introduction to Apache Airflow
mutindakioko profile

Introduction to Apache Airflow

#dataengineering #beginners #learning #python
1
Comments
4 min read
Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries
roel_peters_8b77a70a08fdb profile

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

#postgres #database #fullstack #dataengineering
Comments
7 min read
Personal Picks: Data Product News (October 1, 2025)
sagara profile
Sagara

Personal Picks: Data Product News (October 1, 2025)

#dataengineering #snowflake #databricks
Comments
7 min read
Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC
lakshminarayan_r_6f07f9c0 profile

Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC

#architecture #dataengineering #postgres
Comments
5 min read
loading...