DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The State of Apache Iceberg, Polaris, and Arrow: October–November 2025
alexmercedcoder profile

The State of Apache Iceberg, Polaris, and Arrow: October–November 2025

#news #dataengineering #database #opensource
2
Comments
7 min read
Real-Time Streaming Platform with Pulsar, Flink & ClickHouse
vijaya_bhaskarv_ba95adf9 profile

Real-Time Streaming Platform with Pulsar, Flink & ClickHouse

#analytics #dataengineering #performance #architecture
1
Comments
6 min read
Why Parquet Is Everywhere - And What Makes It Actually Fast?
mohhddhassan profile

Why Parquet Is Everywhere - And What Makes It Actually Fast?

#dataengineering #parquet #bigdata #dataarchitecture
3
Comments
3 min read
Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)
datapenguin profile

Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

#aws #iceberg #deltalake #dataengineering
4
Comments
4 min read
Big Data Processing (Hadoop, Spark)
godofgeeks profile

Big Data Processing (Hadoop, Spark)

#dataengineering #datascience #opensource
2
Comments
5 min read
Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)
anangwemike profile

Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)

#dataengineering #analytics #data #mongodb
Comments
1 min read
Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach
zenithai profile

Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach

#dataengineering #warehouse #snowflake #duckdb
5
Comments
14 min read
From APIs to Aquifers: A Developer's Guide to Smart Water Management Data
rachellovestowrite profile

From APIs to Aquifers: A Developer's Guide to Smart Water Management Data

#bigdata #iot #dataengineering
Comments
7 min read
Data in the Cloud: Understanding 6 Common Data Formats in Analytics
aishwarya_m23it007_c5d8e profile

Data in the Cloud: Understanding 6 Common Data Formats in Analytics

#dataengineering #analytics #data #cloud
Comments
3 min read
A real-world example of CsvPath schemas
david_kershaw_b6916404da6 profile

A real-world example of CsvPath schemas

#data #dataengineering #csv #csvpath
Comments
5 min read
Guia arquitetônico de ponta para a construção de uma plataforma de dados
_richardson_ profile

Guia arquitetônico de ponta para a construção de uma plataforma de dados

#dataengineering #data #architecture #googlecloud
Comments
6 min read
Inside the Edge: How Real-Time Data Pipelines Power Connected Devices
abdul_shamim profile

Inside the Edge: How Real-Time Data Pipelines Power Connected Devices

#dataengineering #iot #architecture #performance
1
Comments
3 min read
Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study
rosewabere profile

Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study

#spark #pyspark #grafana #dataengineering
Comments
5 min read
Python For Data Engineering
gilbert_korir profile

Python For Data Engineering

#python #dataengineering #etl
Comments
3 min read
Picking the Right Data Format for Your Workflow
haresh_kn_ profile

Picking the Right Data Format for Your Workflow

#data #dataengineering #performance
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.