DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #dataengineering #duckdb #iceberg
6
Comments 4
4 min read
🚀 The Future of Data Engineering: How AI and Automation are Changing the Game
shagun_khandelwal profile

🚀 The Future of Data Engineering: How AI and Automation are Changing the Game

#dataengineering #python #ai #machinelearning
Comments
2 min read
The Blueprint of a Data Team: Roles, Responsibilities, and Specializations
andrey_s profile

The Blueprint of a Data Team: Roles, Responsibilities, and Specializations

#datamanagement #dataengineering #bigdata #datagovernance
2
Comments
10 min read
Building an End-to-End Data Engineering Pipeline with DuckDB and Python
satyam_gupta profile

Building an End-to-End Data Engineering Pipeline with DuckDB and Python

#dataengineering #python #sql #tutorial
Comments 1
5 min read
Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture
moubarakmohame4 profile

Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture

#kafka #algorithms #dataengineering #programming
1
Comments
4 min read
The Case for Apache Airflow and Kafka in Data Engineering
milcah03 profile

The Case for Apache Airflow and Kafka in Data Engineering

#airflow #kafka #dataengineering #ai
1
Comments
2 min read
🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨
ashish_kesari_16f55bdc4e2 profile

🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨

#dataengineering #aws #awschallenge #ashishkesari
Comments
2 min read
What is the Modern Data Stack?
24mwangi profile

What is the Modern Data Stack?

#dataops #dataengineering #sql
Comments
3 min read
Real-Time Fraud Detection Using Kafka and Machine Learning
karthik_parameswaran_5251 profile

Real-Time Fraud Detection Using Kafka and Machine Learning

#etl #kafka #dataengineering #programming
Comments
5 min read
🔄 ETL vs ELT: The Backbone of Data Engineering
parth_maniar_3012 profile

🔄 ETL vs ELT: The Backbone of Data Engineering

#dataengineering #datascience #etl #elt
1
Comments
1 min read
đź•’ Cumulative Data Without the Pain: PostgreSQL Rollups with Time Buckets
kushpranjale profile

đź•’ Cumulative Data Without the Pain: PostgreSQL Rollups with Time Buckets

#postgressql #backend #performance #dataengineering
Comments
3 min read
Check Out 3 Awesome Open Source Tabular Data Wrangling Apps
david_kershaw_b6916404da6 profile

Check Out 3 Awesome Open Source Tabular Data Wrangling Apps

#dataengineering #csv #python #opensource
1
Comments
3 min read
15 Core Concepts of Data Engineering
kephercyber profile

15 Core Concepts of Data Engineering

#data #dataengineering
Comments
9 min read
Building a Food Price & Inflation Analysis Pipeline in Kenya (2006–2024)
nick_kahihu_ profile

Building a Food Price & Inflation Analysis Pipeline in Kenya (2006–2024)

#database #dataengineering #sql
Comments
3 min read
Understanding Data Warehousing for Retail Analytics: A Comprehensive Guide
hilary_wambwa_dd49d0404fa profile

Understanding Data Warehousing for Retail Analytics: A Comprehensive Guide

#dataengineering #datawarehouse #retailanalytics
1
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.