DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
RIP Amazon Data Firehose Change Data Capture
psantus profile

RIP Amazon Data Firehose Change Data Capture

#dataengineering #aws #cloud #firehose
7
Comments 3
4 min read
Event-Driven Architectures on AWS: Beyond Lambda
nidhi_0105 profile

Event-Driven Architectures on AWS: Beyond Lambda

#blog #aws #dataengineering #lambda
4
Comments
2 min read
YouTube Data Processing Pipeline
lagat_josiah_f024a2c855bc profile

YouTube Data Processing Pipeline

#postgres #python #dataengineering #architecture
2
Comments 1
4 min read
🔄 ETL vs ELT: What’s the Difference and Why It Matters?
shagun_khandelwal profile

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

#dataengineering #python #sql #datawarehouse
Comments
2 min read
CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium
tsypuk profile

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

#dataengineering #mysql #aws #kafka
1
Comments
5 min read
LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales
jesus_oviedoriquelme_084 profile

LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

#dataengineering #spanish #rag #llm
Comments
21 min read
🏗️ The Role of a Data Engineer: Beyond Pipelines
parth_maniar_3012 profile

🏗️ The Role of a Data Engineer: Beyond Pipelines

#datascience #dataengineering #bigdata #career
Comments
2 min read
Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries
roel_peters_8b77a70a08fdb profile

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

#postgres #database #fullstack #dataengineering
2
Comments
7 min read
🌍 The Journey of Data: From Raw Logs to Insights
shagun_khandelwal profile

🌍 The Journey of Data: From Raw Logs to Insights

#dataengineering #bigdata #etl #python
Comments
2 min read
Git Integration in Microsoft Fabric
anshul_02 profile

Git Integration in Microsoft Fabric

#dataengineering #fabric #microsoft
4
Comments
3 min read
🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank
qvfagundes profile

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

#data #dataengineering #ai
Comments
5 min read
Why Apache Iceberg is needed?
minwook profile

Why Apache Iceberg is needed?

#dataengineering #ai #programming #robotics
1
Comments
6 min read
International SaaS Nightmare: Timezone Edge Cases (And How to Solve Them Once and For All)
tomjstone profile

International SaaS Nightmare: Timezone Edge Cases (And How to Solve Them Once and For All)

#api #saas #timezone #dataengineering
Comments
2 min read
Automating NASA’s Astronomy Picture of the Day with Airflow
oliver_samuel_028c6f65ad6 profile

Automating NASA’s Astronomy Picture of the Day with Airflow

#postgres #dataengineering #tutorial #architecture
Comments
6 min read
📘 Foundation Phase Completed - Starting Phase 2 of My Journey
ramyakaruturi profile

📘 Foundation Phase Completed - Starting Phase 2 of My Journey

#dataengineering #learning #linux #cloudcomputing
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.