DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
RIP Amazon Data Firehose Change Data Capture
psantus profile

RIP Amazon Data Firehose Change Data Capture

#dataengineering #aws #cloud #firehose
7
Comments 3
4 min read
Event-Driven Architectures on AWS: Beyond Lambda
nidhi_0105 profile

Event-Driven Architectures on AWS: Beyond Lambda

#blog #aws #dataengineering #lambda
4
Comments
2 min read
YouTube Data Processing Pipeline
lagat_josiah_f024a2c855bc profile

YouTube Data Processing Pipeline

#postgres #python #dataengineering #architecture
3
Comments 1
4 min read
🔄 ETL vs ELT: What’s the Difference and Why It Matters?
shagun_khandelwal profile

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

#dataengineering #python #sql #datawarehouse
Comments
2 min read
CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium
tsypuk profile

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

#dataengineering #mysql #aws #kafka
1
Comments
5 min read
LLPY-03: ExtracciĂłn y Procesamiento Inteligente de Datos Legales
jesus_oviedoriquelme_084 profile

LLPY-03: ExtracciĂłn y Procesamiento Inteligente de Datos Legales

#dataengineering #spanish #rag #llm
Comments
21 min read
Create a Microsoft Fabric Lakehouse
lotanna_obianefo profile

Create a Microsoft Fabric Lakehouse

#database #dataengineering #cloudcomputing #datascience
5
Comments
6 min read
🏗️ The Role of a Data Engineer: Beyond Pipelines
parth_maniar_3012 profile

🏗️ The Role of a Data Engineer: Beyond Pipelines

#datascience #dataengineering #bigdata #career
Comments
2 min read
Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries
roel_peters_8b77a70a08fdb profile

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

#postgres #database #fullstack #dataengineering
2
Comments
7 min read
Personal Picks: Data Product News (October 1, 2025)
sagara profile

Personal Picks: Data Product News (October 1, 2025)

#dataengineering #snowflake #databricks
Comments
7 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks
kepha_m profile

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

#dataengineering #automation #tutorial #sql
4
Comments 1
10 min read
Git Integration in Microsoft Fabric
anshul_02 profile

Git Integration in Microsoft Fabric

#dataengineering #fabric #microsoft
4
Comments
3 min read
🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank
fagundesv profile

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

#data #dataengineering #ai
Comments
5 min read
Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.
saurabhmahawar profile

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

#opensource #queryengine #presto #dataengineering
Comments
5 min read
Automating NASA’s Astronomy Picture of the Day with Airflow
oliver_samuel_028c6f65ad6 profile

Automating NASA’s Astronomy Picture of the Day with Airflow

#postgres #dataengineering #tutorial #architecture
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.