DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
eric_kahindi_cfbfda3bd0f7 profile

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

#architecture #dataengineering #microservices
Comments 1
6 min read
(I) Principles of Data Model Architecture: Four Layers and Seven Stages
seatunnel profile

(I) Principles of Data Model Architecture: Four Layers and Seven Stages

#bigdata #dataengineering #programming #datawarehouse
5
Comments
7 min read
Revamping Real-Time Data Ingestion for Scalable Media Intelligence
capestart profile

Revamping Real-Time Data Ingestion for Scalable Media Intelligence

#dataengineering #mediaintelligence #microservices #aienabler
Comments
4 min read
Two Years of Microsoft Fabric: Game Changer or Still Leveling Up? 🚀
narayan_f8f2c91c99dfd33e6 profile

Two Years of Microsoft Fabric: Game Changer or Still Leveling Up? 🚀

#azure #dataengineering #cloud #microsoftfabric
Comments
2 min read
Scraping the Schema of NetSuite
rfarnell profile

Scraping the Schema of NetSuite

#netsuite #dataengineering
Comments
2 min read
Docker for Data Engineers: The Complete Beginner’s Guide
dkkinyua profile

Docker for Data Engineers: The Complete Beginner’s Guide

#docker #python #dataengineering #bigdata
3
Comments
6 min read
Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #dataengineering #duckdb #iceberg
6
Comments 4
4 min read
🚀 The Future of Data Engineering: How AI and Automation are Changing the Game
shagun_khandelwal profile

🚀 The Future of Data Engineering: How AI and Automation are Changing the Game

#dataengineering #python #ai #machinelearning
Comments
2 min read
The Blueprint of a Data Team: Roles, Responsibilities, and Specializations
andrey_s profile

The Blueprint of a Data Team: Roles, Responsibilities, and Specializations

#datamanagement #dataengineering #bigdata #datagovernance
2
Comments
10 min read
Building an End-to-End Data Engineering Pipeline with DuckDB and Python
satyam_gupta profile

Building an End-to-End Data Engineering Pipeline with DuckDB and Python

#dataengineering #python #sql #tutorial
Comments
5 min read
Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture
moubarakmohame4 profile

Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture

#kafka #algorithms #dataengineering #programming
1
Comments
4 min read
The Case for Apache Airflow and Kafka in Data Engineering
milcah03 profile

The Case for Apache Airflow and Kafka in Data Engineering

#airflow #kafka #dataengineering #ai
1
Comments
2 min read
🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨
ashish_kesari_16f55bdc4e2 profile

🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨

#dataengineering #aws #awschallenge #ashishkesari
Comments
2 min read
What is the Modern Data Stack?
24mwangi profile

What is the Modern Data Stack?

#dataops #dataengineering #sql
Comments
3 min read
Real-Time Fraud Detection Using Kafka and Machine Learning
karthik_parameswaran_5251 profile

Real-Time Fraud Detection Using Kafka and Machine Learning

#etl #kafka #dataengineering #programming
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.