DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Realtime Data Streaming Platform: Building a Unified Monitoring Stack
vijaya_bhaskarv_ba95adf9 profile

Realtime Data Streaming Platform: Building a Unified Monitoring Stack

#tutorial #dataengineering #monitoring #devops
3
Comments
8 min read
The State of Apache Iceberg, Polaris, and Arrow: October–November 2025
alexmercedcoder profile

The State of Apache Iceberg, Polaris, and Arrow: October–November 2025

#news #dataengineering #database #opensource
2
Comments
7 min read
Real-Time Streaming Platform with Pulsar, Flink & ClickHouse
vijaya_bhaskarv_ba95adf9 profile

Real-Time Streaming Platform with Pulsar, Flink & ClickHouse

#analytics #dataengineering #performance #architecture
4
Comments
6 min read
Why Parquet Is Everywhere - And What Makes It Actually Fast?
mohhddhassan profile

Why Parquet Is Everywhere - And What Makes It Actually Fast?

#dataengineering #parquet #bigdata #dataarchitecture
2
Comments
3 min read
🎓 Building a Smart LMS Assistant: RAG System with Pinecone for Multi-Source Learning Data
qvfagundes profile

🎓 Building a Smart LMS Assistant: RAG System with Pinecone for Multi-Source Learning Data

#vectordatabase #ai #dataengineering
Comments
3 min read
Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)
datapenguin profile

Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

#aws #iceberg #deltalake #dataengineering
4
Comments
4 min read
Big Data Processing (Hadoop, Spark)
godofgeeks profile

Big Data Processing (Hadoop, Spark)

#dataengineering #datascience #opensource
2
Comments
5 min read
Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)
anangwemike profile

Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)

#dataengineering #analytics #data #mongodb
Comments
1 min read
Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach
zenithai profile

Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach

#dataengineering #warehouse #snowflake #duckdb
5
Comments
14 min read
From APIs to Aquifers: A Developer's Guide to Smart Water Management Data
rachellovestowrite profile

From APIs to Aquifers: A Developer's Guide to Smart Water Management Data

#bigdata #iot #dataengineering
Comments
7 min read
Data in the Cloud: Understanding 6 Common Data Formats in Analytics
aishwarya_m23it007_c5d8e profile

Data in the Cloud: Understanding 6 Common Data Formats in Analytics

#dataengineering #analytics #data #cloud
Comments
3 min read
A real-world example of CsvPath schemas
david_kershaw_b6916404da6 profile

A real-world example of CsvPath schemas

#data #dataengineering #csv #csvpath
Comments
5 min read
Guia arquitetônico de ponta para a construção de uma plataforma de dados
_richardson_ profile

Guia arquitetônico de ponta para a construção de uma plataforma de dados

#dataengineering #data #architecture #googlecloud
Comments
6 min read
Inside the Edge: How Real-Time Data Pipelines Power Connected Devices
abdul_shamim profile

Inside the Edge: How Real-Time Data Pipelines Power Connected Devices

#dataengineering #iot #architecture #performance
1
Comments
3 min read
Python For Data Engineering
gilbert_korir profile

Python For Data Engineering

#python #dataengineering #etl
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.