DEV Community

# dataengineering

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Simulating An Event-Driven Python Shopping App with Kafka on AWS For Real-Time Processing.
dteimuno profile

Simulating An Event-Driven Python Shopping App with Kafka on AWS For Real-Time Processing.

#dataengineering #python #aws #architecture
5
Comments 2
8 min read
Real-Time Data Streaming Platform: How We Built a Self-Hosted Platform with 90% Cost Reduction vs AWS Managed Services
vijaya_bhaskarv_ba95adf9 profile

Real-Time Data Streaming Platform: How We Built a Self-Hosted Platform with 90% Cost Reduction vs AWS Managed Services

#dataengineering #performance #architecture #aws
1
Comments
6 min read
Real-Time Data Streaming Platform: From 140K to 1 Million Messages/Sec - A Flink Performance Tuning Journey
vijaya_bhaskarv_ba95adf9 profile

Real-Time Data Streaming Platform: From 140K to 1 Million Messages/Sec - A Flink Performance Tuning Journey

#kubernetes #dataengineering #performance #aws
Comments
10 min read
Building a Real-Time Data Platform with Kubernetes (Kind) - A Complete Local Setup Guide
vijaya_bhaskarv_ba95adf9 profile

Building a Real-Time Data Platform with Kubernetes (Kind) - A Complete Local Setup Guide

#tutorial #iot #dataengineering #kubernetes
2
Comments
8 min read
Building a Task Manager with Apache NiFi: From Custom Scheduler to Distributed Workflows
mbessarab profile

Building a Task Manager with Apache NiFi: From Custom Scheduler to Distributed Workflows

#architecture #automation #dataengineering
Comments
9 min read
Azure Data Factory (ADF) - A Beginner's Guide to Cloud Data Integration
arunkumar_panneerselvam_2 profile

Azure Data Factory (ADF) - A Beginner's Guide to Cloud Data Integration

#dataengineering #cloud #beginners #azure
2
Comments
4 min read
Real-Time Crypto Data Pipeline
lagat_josiah_f024a2c855bc profile

Real-Time Crypto Data Pipeline

#cryptocurrency #dataengineering #architecture #database
Comments
3 min read
Another Data Nerd Guide to re:Invent 2025
elliott_cordo profile

Another Data Nerd Guide to re:Invent 2025

#aws #dataengineering #genai #cloud
2
Comments
3 min read
Real-Time Cryptocurrency Data Pipeline
lagat_josiah_f024a2c855bc profile

Real-Time Cryptocurrency Data Pipeline

#cryptocurrency #dataengineering #performance #architecture
Comments
5 min read
โ€œ๐—˜๐—ง๐—Ÿ ๐—ถ๐˜€ ๐—˜๐˜ƒ๐—ผ๐—น๐˜ƒ๐—ถ๐—ป๐—ด โ€” ๐—”๐—ฟ๐—ฒ ๐—ฌ๐—ผ๐˜‚?โ€
supraja_tangella_b7f0738e profile

โ€œ๐—˜๐—ง๐—Ÿ ๐—ถ๐˜€ ๐—˜๐˜ƒ๐—ผ๐—น๐˜ƒ๐—ถ๐—ป๐—ด โ€” ๐—”๐—ฟ๐—ฒ ๐—ฌ๐—ผ๐˜‚?โ€

#dataengineering #etl #elt #azure
5
Comments
1 min read
Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search
apachedoris profile

Apache Doris 4.0: One Engine for Analytics, Full-Text Search, and Vector Search

#clickhouse #dataengineering #olap #database
5
Comments
22 min read
Crypto Real-Time Data Pipeline
lagat_josiah_f024a2c855bc profile

Crypto Real-Time Data Pipeline

#cryptocurrency #docker #dataengineering #architecture
Comments
4 min read
Cryptocurrency Data Pipeline Project
lagat_josiah_f024a2c855bc profile

Cryptocurrency Data Pipeline Project

#cryptocurrency #docker #dataengineering #architecture
Comments
4 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide
thetechguru-ssh profile

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

#oracle #azure #cloud #dataengineering
Comments
3 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide
thetechguru-ssh profile

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

#oracle #azure #cloud #dataengineering
Comments
3 min read
๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.