DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Real-Time Data Platform with Kubernetes (Kind) - A Complete Local Setup Guide
vijaya_bhaskarv_ba95adf9 profile

Building a Real-Time Data Platform with Kubernetes (Kind) - A Complete Local Setup Guide

#tutorial #iot #dataengineering #kubernetes
2
Comments
8 min read
Building a Task Manager with Apache NiFi: From Custom Scheduler to Distributed Workflows
mbessarab profile

Building a Task Manager with Apache NiFi: From Custom Scheduler to Distributed Workflows

#architecture #automation #dataengineering
Comments
9 min read
Azure Data Factory (ADF) - A Beginner's Guide to Cloud Data Integration
arunkumar_panneerselvam_2 profile

Azure Data Factory (ADF) - A Beginner's Guide to Cloud Data Integration

#dataengineering #cloud #beginners #azure
2
Comments
4 min read
Real-Time Crypto Data Pipeline
lagat_josiah_f024a2c855bc profile

Real-Time Crypto Data Pipeline

#cryptocurrency #dataengineering #architecture #database
2
Comments
3 min read
Another Data Nerd Guide to re:Invent 2025
elliott_cordo profile

Another Data Nerd Guide to re:Invent 2025

#aws #dataengineering #genai #cloud
2
Comments
3 min read
Real-Time Cryptocurrency Data Pipeline
lagat_josiah_f024a2c855bc profile

Real-Time Cryptocurrency Data Pipeline

#cryptocurrency #dataengineering #performance #architecture
Comments
5 min read
“𝗘𝗧𝗟 𝗶𝘀 𝗘𝘃𝗼𝗹𝘃𝗶𝗻𝗴 — 𝗔𝗿𝗲 𝗬𝗼𝘂?”
supraja_tangella_b7f0738e profile

“𝗘𝗧𝗟 𝗶𝘀 𝗘𝘃𝗼𝗹𝘃𝗶𝗻𝗴 — 𝗔𝗿𝗲 𝗬𝗼𝘂?”

#dataengineering #etl #elt #azure
5
Comments
1 min read
From OLTP to OLAP: Streaming Databases into MotherDuck with Estuary
techsourabh profile

From OLTP to OLAP: Streaming Databases into MotherDuck with Estuary

#duckdb #dataengineering #motherduck #database
1
Comments
7 min read
Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search
apachedoris profile

Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search

#clickhouse #dataengineering #olap #database
5
Comments
22 min read
Crypto Real-Time Data Pipeline
lagat_josiah_f024a2c855bc profile

Crypto Real-Time Data Pipeline

#cryptocurrency #docker #dataengineering #architecture
Comments
4 min read
Cryptocurrency Data Pipeline Project
lagat_josiah_f024a2c855bc profile

Cryptocurrency Data Pipeline Project

#cryptocurrency #docker #dataengineering #architecture
Comments
4 min read
Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data
leonardkachi profile

Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

#dataengineering #architecture #opensource #aws
1
Comments
4 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide
thetechguru-ssh profile

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

#oracle #azure #cloud #dataengineering
Comments
3 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide
thetechguru-ssh profile

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

#oracle #azure #cloud #dataengineering
Comments
3 min read
Real-Time Crypto Data Pipeline
lagat_josiah_f024a2c855bc profile

Real-Time Crypto Data Pipeline

#cryptocurrency #dataengineering #python #architecture
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.