DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A Modern Data Governance Framework for Google Cloud: Implementing Just-Enough and Just-in-Time Access
hikikomorineko profile

A Modern Data Governance Framework for Google Cloud: Implementing Just-Enough and Just-in-Time Access

#googlecloud #security #architecture #dataengineering
3
Comments
8 min read
Scaling Customer Analytics: Designing ML Pipelines for Millions of Users
adityaarora profile

Scaling Customer Analytics: Designing ML Pipelines for Millions of Users

#dataengineering #performance #architecture #machinelearning
Comments
7 min read
Temperature, Tokens, and Context Windows: The Three Pillars of LLM Control
fagundesv profile

Temperature, Tokens, and Context Windows: The Three Pillars of LLM Control

#ai #dataengineering #data #product
6
Comments
13 min read
Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)
alexmercedcoder profile

Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)

#architecture #dataengineering #opensource
Comments
4 min read
Building Intelligent, Metadata-Driven Pipelines with Azure Data Factory
sotiriav profile

Building Intelligent, Metadata-Driven Pipelines with Azure Data Factory

#dataengineering #azure #logicapps
2
Comments
6 min read
Why Your Enterprise Data Platform Is No Longer Just for Analytics
gigapress profile

Why Your Enterprise Data Platform Is No Longer Just for Analytics

#dataengineering #architecture #database #analytics
2
Comments 1
11 min read
Realtime Data Streaming Platform: Building a Unified Monitoring Stack
vijaya_bhaskarv_ba95adf9 profile

Realtime Data Streaming Platform: Building a Unified Monitoring Stack

#tutorial #dataengineering #monitoring #devops
3
Comments
8 min read
Real-Time Streaming Platform with Pulsar, Flink & ClickHouse
vijaya_bhaskarv_ba95adf9 profile

Real-Time Streaming Platform with Pulsar, Flink & ClickHouse

#analytics #dataengineering #performance #architecture
1
Comments
6 min read
Why Parquet Is Everywhere - And What Makes It Actually Fast?
mohhddhassan profile

Why Parquet Is Everywhere - And What Makes It Actually Fast?

#dataengineering #parquet #bigdata #dataarchitecture
3
Comments
3 min read
Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)
datapenguin profile

Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

#aws #iceberg #deltalake #dataengineering
4
Comments
4 min read
Big Data Processing (Hadoop, Spark)
godofgeeks profile

Big Data Processing (Hadoop, Spark)

#dataengineering #datascience #opensource
2
Comments
5 min read
Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)
anangwemike profile

Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)

#dataengineering #analytics #data #mongodb
Comments
1 min read
Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach
zenithai profile

Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach

#dataengineering #warehouse #snowflake #duckdb
5
Comments
14 min read
From APIs to Aquifers: A Developer's Guide to Smart Water Management Data
rachellovestowrite profile

From APIs to Aquifers: A Developer's Guide to Smart Water Management Data

#bigdata #iot #dataengineering
Comments
7 min read
Data in the Cloud: Understanding 6 Common Data Formats in Analytics
aishwarya_m23it007_c5d8e profile

Data in the Cloud: Understanding 6 Common Data Formats in Analytics

#dataengineering #analytics #data #cloud
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.